2024.10.22 00:06:58.777038 [ 466 ] {} Application: Will watch for the process with pid 468 2024.10.22 00:06:58.777294 [ 468 ] {} Application: Forked a child process to watch 2024.10.22 00:06:58.778539 [ 468 ] {} SentryWriter: Sending crash reports is disabled 2024.10.22 00:06:58.779066 [ 468 ] {} Pipe: Pipe capacity is 1.00 MiB 2024.10.22 00:06:59.882049 [ 468 ] {} Application: Starting ClickHouse 23.8.16.42.altinitystable (revision: 54477, git hash: 46d4f9bd6a40e43bf5543be25cc704364e0c737b, build id: 357BD09AC2B3A46F0B44F66168828D9D6CC8F70F), PID 468 2024.10.22 00:06:59.886041 [ 468 ] {} Application: starting up 2024.10.22 00:06:59.886300 [ 468 ] {} Application: OS name: Linux, version: 5.15.0-122-generic, architecture: x86_64 2024.10.22 00:06:59.936072 [ 468 ] {} Context: Server was built in debug mode. It will work slowly. 2024.10.22 00:06:59.939093 [ 468 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2024.10.22 00:06:59.944769 [ 468 ] {} Application: Available RAM: 30.60 GiB; physical cores: 16; logical cores: 16. 2024.10.22 00:07:00.034053 [ 468 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2024.10.22 00:07:00.147458 [ 468 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2024.10.22 00:07:00.148985 [ 468 ] {} AsynchronousMetrics: Scanning /sys/block 2024.10.22 00:07:00.172992 [ 468 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2024.10.22 00:07:00.174069 [ 468 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2024.10.22 00:07:17.598149 [ 468 ] {} Application: Integrity check of the executable successfully passed (checksum: 14165EF9ABB7482E2085E723F61605D4) 2024.10.22 00:07:17.607086 [ 468 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2024.10.22 00:07:17.643557 [ 468 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 471.31 MiB 2024.10.22 00:07:17.647243 [ 468 ] {} Application: Set OOM score adjustment to 555 2024.10.22 00:07:17.660767 [ 468 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2024.10.22 00:07:17.662155 [ 468 ] {} Application: rlimit on number of threads is 18446744073709551615 2024.10.22 00:07:17.677353 [ 468 ] {} Application: Initializing DateLUT. 2024.10.22 00:07:17.678916 [ 468 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2024.10.22 00:07:17.687043 [ 468 ] {} Context: Setting up /var/lib/clickhouse/tmp/ to store temporary data in it 2024.10.22 00:07:17.705397 [ 468 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2024.10.22 00:07:18.746543 [ 468 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2024.10.22 00:07:18.750631 [ 468 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2024.10.22 00:07:18.757018 [ 468 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2024.10.22 00:07:18.760904 [ 468 ] {} Context: The setting 'merge_tree_metadata_cache' is enabled. But the feature of 'metadata cache in RocksDB' is experimental and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. See the corresponding report at https://github.com/ClickHouse/ClickHouse/issues/51182 2024.10.22 00:07:18.866463 [ 468 ] {} Application: Initializing MergeTree metadata cache, lru_cache_size: 256.00 MiB continue_if_corrupted: true 2024.10.22 00:07:20.180193 [ 468 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'f111be1a9f3c' as replica host. 2024.10.22 00:07:20.186230 [ 468 ] {} Application: Initializing interserver credentials. 2024.10.22 00:07:20.868941 [ 468 ] {} NamedCollectionsUtils: Loaded 6 collections from config 2024.10.22 00:07:20.874594 [ 468 ] {} NamedCollectionsUtils: Loaded 0 collections from SQL 2024.10.22 00:07:20.881063 [ 468 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2024.10.22 00:07:20.900922 [ 468 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2024.10.22 00:07:23.825543 [ 468 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2024.10.22 00:07:25.969112 [ 468 ] {} Application: Setting max_server_memory_usage was set to 15.30 GiB (30.60 GiB available * 0.50 max_server_memory_usage_to_ram_ratio) 2024.10.22 00:07:25.970793 [ 468 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2024.10.22 00:07:25.972936 [ 468 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2024.10.22 00:07:28.255657 [ 468 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2024.10.22 00:07:28.276079 [ 468 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2024.10.22 00:07:29.047295 [ 468 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2024.10.22 00:07:29.232778 [ 468 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2024.10.22 00:07:29.398735 [ 468 ] {} CertificateReloader: Reloading certificate (/etc/clickhouse-server/server.crt) and key (/etc/clickhouse-server/server.key). 2024.10.22 00:07:29.438361 [ 468 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/server.crt) and key (/etc/clickhouse-server/server.key). 2024.10.22 00:07:29.441982 [ 468 ] {} CertificateReloader: Initializing certificate reloader. 2024.10.22 00:07:29.708652 [ 468 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2024.10.22 00:07:29.774310 [ 468 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2024.10.22 00:07:29.800319 [ 468 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2024.10.22 00:07:29.831605 [ 468 ] {} KeeperDispatcher: Initializing storage dispatcher 2024.10.22 00:07:29.968610 [ 468 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2024.10.22 00:07:29.975241 [ 468 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2024.10.22 00:07:29.976890 [ 468 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2024.10.22 00:07:29.990160 [ 468 ] {} KeeperContext: Disk type 'azure_blob_storage' is not supported for Keeper 2024.10.22 00:07:29.999630 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:33.677776 [ 468 ] {} S3Client: Provider type: Unknown 2024.10.22 00:07:33.678525 [ 468 ] {} S3Client: API mode of the S3 client: AWS 2024.10.22 00:07:35.675233 [ 468 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c 2024.10.22 00:07:35.676443 [ 468 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c. 2024.10.22 00:07:35.763984 [ 779 ] {} HTTPSessionAdapter: Created HTTP(S) session with localhost:11111 (::1:11111) 2024.10.22 00:07:35.799677 [ 779 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c, size 4 2024.10.22 00:07:35.803595 [ 468 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c. 2024.10.22 00:07:35.831997 [ 468 ] {} S3ObjectStorage: Objects with paths [common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c] were removed from S3 2024.10.22 00:07:36.567782 [ 468 ] {} S3ObjectStorage: Objects with paths [common/aag/piwkbzegjbuhpwvaypjgnwqsgsxmc] were removed from S3 2024.10.22 00:07:36.568913 [ 468 ] {} DiskObjectStorage(DiskS3): Starting up disk s3_disk 2024.10.22 00:07:36.570360 [ 468 ] {} DiskObjectStorage(DiskS3): Disk s3_disk started up 2024.10.22 00:07:36.573427 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:36.594167 [ 468 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2024.10.22 00:07:36.610629 [ 468 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2024.10.22 00:07:36.629061 [ 468 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2024.10.22 00:07:36.631786 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:36.736597 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:36.739484 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:36.744586 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:36.749505 [ 468 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2024.10.22 00:07:36.776699 [ 468 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2024.10.22 00:07:36.910462 [ 468 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2024.10.22 00:07:36.912321 [ 468 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2024.10.22 00:07:36.917318 [ 468 ] {} KeeperLogStore: force_sync disabled 2024.10.22 00:07:36.919184 [ 468 ] {} KeeperDispatcher: Waiting server to initialize 2024.10.22 00:07:36.920490 [ 468 ] {} KeeperStateMachine: Totally have 0 snapshots 2024.10.22 00:07:36.921397 [ 468 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2024.10.22 00:07:36.923808 [ 468 ] {} KeeperLogStore: Removing all changelogs 2024.10.22 00:07:36.925129 [ 468 ] {} Changelog: Starting new changelog changelog_1_100000.bin.zstd 2024.10.22 00:07:36.928521 [ 468 ] {} KeeperServer: Preprocessing 0 log entries 2024.10.22 00:07:36.929677 [ 468 ] {} KeeperServer: Preprocessing done 2024.10.22 00:07:36.931556 [ 468 ] {} KeeperServer: No config in log store and snapshot, probably it's initial run. Will use config from .xml on disk 2024.10.22 00:07:36.951133 [ 468 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2024.10.22 00:07:37.067766 [ 468 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2024.10.22 00:07:37.069622 [ 468 ] {} KeeperStateManager: No state was read 2024.10.22 00:07:37.072637 [ 468 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2024.10.22 00:07:37.074374 [ 468 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2024.10.22 00:07:37.075934 [ 468 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2024.10.22 00:07:37.078395 [ 468 ] {} RaftInstance: new election timeout range: 0 - 0 2024.10.22 00:07:37.096182 [ 468 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 0 election timer allowed log store start 1, end 0 config log idx 0, prev log idx 0 2024.10.22 00:07:37.099407 [ 468 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2024.10.22 00:07:37.102597 [ 468 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2024.10.22 00:07:37.103967 [ 468 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2024.10.22 00:07:37.181490 [ 468 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2024.10.22 00:07:37.178326 [ 794 ] {} RaftInstance: Election timeout, initiate leader election 2024.10.22 00:07:37.188627 [ 794 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2024.10.22 00:07:37.275154 [ 803 ] {} RaftInstance: bg append_entries thread initiated 2024.10.22 00:07:37.298383 [ 794 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 0, state term 0, target p 1, my p 1, hb dead, pre-vote NOT done 2024.10.22 00:07:37.446415 [ 794 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 1, log idx 0, log term 0, priority (target 1 / mine 1) 2024.10.22 00:07:37.494453 [ 794 ] {} RaftInstance: number of pending commit elements: 0 2024.10.22 00:07:37.525283 [ 794 ] {} RaftInstance: state machine commit index 0, precommit index 0, last log index 0 2024.10.22 00:07:37.644878 [ 794 ] {} RaftInstance: [BECOME LEADER] appended new config at 1 2024.10.22 00:07:37.772988 [ 802 ] {} RaftInstance: config at index 1 is committed, prev config log idx 0 2024.10.22 00:07:37.782955 [ 802 ] {} RaftInstance: new config log idx 1, prev log idx 0, cur config log idx 0, prev log idx 0 2024.10.22 00:07:37.791859 [ 802 ] {} RaftInstance: new configuration: log idx 1, prev log idx 0 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 1 2024.10.22 00:07:37.804050 [ 468 ] {} KeeperDispatcher: Quorum initialized 2024.10.22 00:07:37.805605 [ 468 ] {} KeeperDispatcher: Dispatcher initialized 2024.10.22 00:07:37.828036 [ 468 ] {} Application: Listening for Keeper (tcp): [::]:9181 2024.10.22 00:07:37.829815 [ 468 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2024.10.22 00:07:37.867691 [ 468 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2024.10.22 00:07:38.151090 [ 468 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2024.10.22 00:07:40.028786 [ 468 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2024.10.22 00:07:40.043611 [ 468 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2024.10.22 00:07:40.049749 [ 468 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2024.10.22 00:07:40.051188 [ 468 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2024.10.22 00:07:40.159557 [ 468 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2024.10.22 00:07:40.298112 [ 468 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2024.10.22 00:07:40.320177 [ 468 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2024.10.22 00:07:40.357061 [ 468 ] {} Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2024.10.22 00:07:40.395338 [ 468 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2024.10.22 00:07:40.531984 [ 468 ] {} DNSCacheUpdater: Update period 15 seconds 2024.10.22 00:07:40.546623 [ 468 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2024.10.22 00:07:40.566042 [ 596 ] {} DNSResolver: Updating DNS cache 2024.10.22 00:07:40.770446 [ 468 ] {} DatabaseAtomic (system): Metadata processed, database system has 0 tables and 0 dictionaries in total. 2024.10.22 00:07:40.774911 [ 468 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.026528865 sec 2024.10.22 00:07:40.778577 [ 468 ] {} ReferentialDeps: No tables 2024.10.22 00:07:40.779584 [ 468 ] {} LoadingDeps: No tables 2024.10.22 00:07:40.819462 [ 468 ] {} DatabaseAtomic (system): Starting up tables. 2024.10.22 00:07:40.859247 [ 596 ] {} DNSResolver: Updated DNS cache 2024.10.22 00:07:40.863775 [ 596 ] {} DNSCacheUpdater: Execution took 317 ms. 2024.10.22 00:07:40.938258 [ 468 ] {} SystemLog: Creating system.query_log from query_log 2024.10.22 00:07:42.080887 [ 468 ] {} SystemLog: Creating system.query_thread_log from query_thread_log 2024.10.22 00:07:42.227330 [ 468 ] {} SystemLog: Creating system.part_log from part_log 2024.10.22 00:07:42.268440 [ 468 ] {} SystemLog: Creating system.trace_log from trace_log 2024.10.22 00:07:42.298202 [ 468 ] {} SystemLog: Creating system.crash_log from crash_log 2024.10.22 00:07:42.312337 [ 468 ] {} SystemLog: Creating system.text_log from text_log 2024.10.22 00:07:42.346397 [ 468 ] {} SystemLog: Creating system.metric_log from metric_log 2024.10.22 00:07:44.203444 [ 468 ] {} SystemLog: Creating system.filesystem_cache_log from filesystem_cache_log 2024.10.22 00:07:44.447012 [ 468 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2024.10.22 00:07:44.452784 [ 468 ] {} SystemLog: Creating system.asynchronous_metric_log from asynchronous_metric_log 2024.10.22 00:07:44.479678 [ 468 ] {} SystemLog: Creating system.opentelemetry_span_log from opentelemetry_span_log 2024.10.22 00:07:44.634207 [ 468 ] {} SystemLog: Creating system.query_views_log from query_views_log 2024.10.22 00:07:44.765267 [ 468 ] {} SystemLog: Creating system.zookeeper_log from zookeeper_log 2024.10.22 00:07:45.174951 [ 468 ] {} SystemLog: Creating system.session_log from session_log 2024.10.22 00:07:45.546846 [ 468 ] {} SystemLog: Creating system.transactions_info_log from transactions_info_log 2024.10.22 00:07:45.698118 [ 468 ] {} SystemLog: Creating system.processors_profile_log from processors_profile_log 2024.10.22 00:07:45.820197 [ 468 ] {} SystemLog: Creating system.asynchronous_insert_log from asynchronous_insert_log 2024.10.22 00:07:46.104672 [ 468 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2024.10.22 00:07:50.282162 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 153 entries to flush up to offset 153 2024.10.22 00:07:50.329100 [ 895 ] {} SystemLog (system.text_log): Creating new table system.text_log for TextLog 2024.10.22 00:07:50.818250 [ 895 ] {} WriteBufferFromAzureBlobStorage: Staged block (id: ndtfceioigtawefdadvngyczoastmrlfetnhotraeitncgklbdqfcuswpfjrybnr) of size 4 (blob path: puxbbxevtjytsbvoqabfmktgxkzqzwxf). 2024.10.22 00:07:50.928491 [ 895 ] {} WriteBufferFromAzureBlobStorage: Committed 1 blocks for blob `puxbbxevtjytsbvoqabfmktgxkzqzwxf` 2024.10.22 00:07:51.250637 [ 895 ] {} DiskObjectStorage(DiskAzureBlobStorage): Starting up disk azure 2024.10.22 00:07:51.276183 [ 895 ] {} DiskObjectStorage(DiskAzureBlobStorage): Disk azure started up 2024.10.22 00:07:51.405943 [ 895 ] {} DiskCache: Registered cached disk (`cached_azure`) with structure: DiskObjectStorage-azure(CachedObjectStorage-cached_azure(AzureObjectStorage)) 2024.10.22 00:07:52.191716 [ 895 ] {} S3Client: Provider type: Unknown 2024.10.22 00:07:52.199357 [ 895 ] {} S3Client: API mode of the S3 client: AWS 2024.10.22 00:07:53.550403 [ 895 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c (LogSeriesLimiter: on interval from 2024-10-22 00:07:35 to 2024-10-22 00:07:53 accepted series 1 / 2 for the logger WriteBufferFromS3 : 1.7491308770058435e+38) 2024.10.22 00:07:53.555342 [ 895 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c. 2024.10.22 00:07:53.628461 [ 779 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c, size 4 2024.10.22 00:07:53.761279 [ 895 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c. 2024.10.22 00:07:53.766270 [ 896 ] {} SystemLog (system.metric_log): Flushing system log, 8 entries to flush up to offset 8 2024.10.22 00:07:53.773104 [ 896 ] {} SystemLog (system.metric_log): Creating new table system.metric_log for MetricLog 2024.10.22 00:07:53.774477 [ 895 ] {} S3ObjectStorage: Objects with paths [common/clickhouse_remove_objects_capability_fdaabc72-1a82-4137-b6d4-08f8e5beda7c] were removed from S3 2024.10.22 00:07:53.952611 [ 468 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2024.10.22 00:07:53.967616 [ 468 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2024.10.22 00:07:53.968214 [ 468 ] {} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.003088181 sec 2024.10.22 00:07:53.968955 [ 468 ] {} ReferentialDeps: No tables 2024.10.22 00:07:53.969640 [ 468 ] {} LoadingDeps: No tables 2024.10.22 00:07:53.971442 [ 468 ] {} DatabaseAtomic (default): Starting up tables. 2024.10.22 00:07:53.974641 [ 468 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/lib/clickhouse/user_defined/ 2024.10.22 00:07:53.975969 [ 468 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2024.10.22 00:07:53.976332 [ 468 ] {} Application: Loaded metadata. 2024.10.22 00:07:53.976940 [ 468 ] {} Pipe: Pipe capacity is 1.00 MiB 2024.10.22 00:07:53.979671 [ 468 ] {} bool DB::(anonymous namespace)::checkPermissionsImpl(): Code: 412. DB::Exception: Can't receive Netlink response: error -2. (NETLINK_ERROR) (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:07:53.980506 [ 468 ] {} Application: Tasks stats provider: procfs 2024.10.22 00:07:54.089249 [ 895 ] {} S3ObjectStorage: Objects with paths [common/xol/xblhfzmempufujlliezaibgzigsiw] were removed from S3 2024.10.22 00:07:54.090343 [ 895 ] {} DiskObjectStorage(DiskS3): Starting up disk s3_disk 2024.10.22 00:07:54.092025 [ 895 ] {} DiskObjectStorage(DiskS3): Disk s3_disk started up 2024.10.22 00:07:54.113125 [ 895 ] {} DiskCache: Registered cached disk (`s3_cache`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache(S3ObjectStorage)) 2024.10.22 00:07:54.191480 [ 895 ] {} DiskObjectStorage(Local): Starting up disk local_disk 2024.10.22 00:07:54.198598 [ 895 ] {} DiskObjectStorage(Local): Disk local_disk started up 2024.10.22 00:07:54.273052 [ 895 ] {} DiskObjectStorage(Local): Starting up disk local_disk_2 2024.10.22 00:07:54.273948 [ 895 ] {} DiskObjectStorage(Local): Disk local_disk_2 started up 2024.10.22 00:07:54.429723 [ 895 ] {} DiskObjectStorage(Local): Starting up disk local_disk_3 2024.10.22 00:07:54.443437 [ 895 ] {} DiskObjectStorage(Local): Disk local_disk_3 started up 2024.10.22 00:07:54.531228 [ 895 ] {} DiskCache: Registered cached disk (`local_cache`) with structure: DiskObjectStorage-local_disk(CachedObjectStorage-local_cache(LocalObjectStorage)) 2024.10.22 00:07:54.562199 [ 895 ] {} DiskCache: Registered cached disk (`local_cache_2`) with structure: DiskObjectStorage-local_disk(CachedObjectStorage-local_cache_2(LocalObjectStorage)) 2024.10.22 00:07:54.617248 [ 468 ] {} AsynchronousMetrics: MemoryTracking: was 62.38 MiB, peak 94.32 MiB, free memory in arenas 168.00 KiB, will set to 775.54 MiB (RSS), difference: 713.16 MiB 2024.10.22 00:07:54.695689 [ 895 ] {} DiskCache: Registered cached disk (`local_cache_3`) with structure: DiskObjectStorage-local_disk_3(CachedObjectStorage-local_cache_3(LocalObjectStorage)) 2024.10.22 00:07:54.725670 [ 895 ] {} DiskCache: Registered cached disk (`s3_cache_multi`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache_multi(CachedObjectStorage-s3_cache(S3ObjectStorage))) 2024.10.22 00:07:54.751046 [ 895 ] {} DiskCache: Registered cached disk (`s3_cache_multi_2`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache_multi_2(CachedObjectStorage-s3_cache_multi(CachedObjectStorage-s3_cache(S3ObjectStorage)))) 2024.10.22 00:07:54.757203 [ 895 ] {} StoragePolicy (azure_cache): Storage policy azure_cache created, total volumes 1 2024.10.22 00:07:54.757885 [ 895 ] {} StoragePolicySelector: Storage policy `azure_cache` loaded 2024.10.22 00:07:54.762569 [ 895 ] {} StoragePolicy (s3_cache): Storage policy s3_cache created, total volumes 1 2024.10.22 00:07:54.763375 [ 895 ] {} StoragePolicySelector: Storage policy `s3_cache` loaded 2024.10.22 00:07:54.769014 [ 895 ] {} StoragePolicy (s3_cache_multi): Storage policy s3_cache_multi created, total volumes 1 2024.10.22 00:07:54.769924 [ 895 ] {} StoragePolicySelector: Storage policy `s3_cache_multi` loaded 2024.10.22 00:07:54.773979 [ 895 ] {} StoragePolicy (local_cache): Storage policy local_cache created, total volumes 1 2024.10.22 00:07:54.774671 [ 895 ] {} StoragePolicySelector: Storage policy `local_cache` loaded 2024.10.22 00:07:54.779381 [ 895 ] {} StoragePolicy (local_cache_2): Storage policy local_cache_2 created, total volumes 1 2024.10.22 00:07:54.780794 [ 895 ] {} StoragePolicySelector: Storage policy `local_cache_2` loaded 2024.10.22 00:07:54.787793 [ 895 ] {} StoragePolicy (local_cache_3): Storage policy local_cache_3 created, total volumes 1 2024.10.22 00:07:54.789588 [ 895 ] {} StoragePolicySelector: Storage policy `local_cache_3` loaded 2024.10.22 00:07:54.794825 [ 895 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2024.10.22 00:07:54.818668 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Loading data parts 2024.10.22 00:07:54.831566 [ 592 ] {} DatabaseCatalog: Execution took 855 ms. 2024.10.22 00:07:54.859463 [ 468 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.003150557 sec. 2024.10.22 00:07:54.891426 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): There are no data parts 2024.10.22 00:07:55.061028 [ 468 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/decimals_dictionary.xml'. 2024.10.22 00:07:55.257040 [ 468 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/executable_dictionary.xml'. 2024.10.22 00:07:55.365031 [ 468 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/executable_pool_dictionary.xml'. 2024.10.22 00:07:55.464182 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 793.27 MiB, peak 793.27 MiB, free memory in arenas 368.00 KiB, will set to 777.86 MiB (RSS), difference: -15.41 MiB 2024.10.22 00:07:55.534297 [ 468 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/ints_dictionary.xml'. 2024.10.22 00:07:55.562670 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:07:55.565300 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.66 GiB. 2024.10.22 00:07:55.751573 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:07:55.891407 [ 617 ] {} DNSResolver: Updating DNS cache 2024.10.22 00:07:55.903486 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:07:55.918041 [ 617 ] {} DNSResolver: Updated DNS cache 2024.10.22 00:07:55.921997 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 153 2024.10.22 00:07:56.154500 [ 468 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/strings_dictionary.xml'. 2024.10.22 00:07:56.372746 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Loading config file '/etc/clickhouse-server/test_function.xml'. 2024.10.22 00:07:56.409792 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 792.35 MiB, peak 793.27 MiB, free memory in arenas 1.32 MiB, will set to 799.48 MiB (RSS), difference: 7.13 MiB 2024.10.22 00:07:56.499432 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Will load 'test_function' because always_load_everything flag is set. 2024.10.22 00:07:56.500515 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Will load the object 'test_function' immediately, force = false, loading_id = 1 2024.10.22 00:07:56.501651 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Start loading object 'test_function' 2024.10.22 00:07:56.514446 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Supposed update time for 'test_function' is never (loaded, lifetime 0) 2024.10.22 00:07:56.515850 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Next update time for 'test_function' was set to 294247-01-10 05:00:54 2024.10.22 00:07:56.536708 [ 468 ] {} Application: Listening for http://[::]:8123 2024.10.22 00:07:56.540348 [ 468 ] {} Application: Listening for https://[::]:8443 2024.10.22 00:07:56.543117 [ 468 ] {} Application: Listening for native protocol (tcp): [::]:9000 2024.10.22 00:07:56.545723 [ 468 ] {} Application: Listening for native protocol (tcp) with PROXY: [::]:9010 2024.10.22 00:07:56.548492 [ 468 ] {} Application: Listening for secure native protocol (tcp_secure): [::]:9440 2024.10.22 00:07:56.550630 [ 468 ] {} Application: Listening for MySQL compatibility protocol: [::]:9004 2024.10.22 00:07:56.552760 [ 468 ] {} Application: Listening for PostgreSQL compatibility protocol: [::]:9005 2024.10.22 00:07:56.554193 [ 468 ] {} Application: Listening for Prometheus: http://[::]:9988 2024.10.22 00:07:56.556320 [ 468 ] {} Application: Ready for connections. 2024.10.22 00:07:56.580029 [ 958 ] {} DDLWorker: Starting DDLWorker thread 2024.10.22 00:07:56.585511 [ 958 ] {} DDLWorker: Initializing DDLWorker thread 2024.10.22 00:07:56.589975 [ 473 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:36164 2024.10.22 00:07:56.619037 [ 473 ] {} TCPHandler: Connected ClickHouse client version 23.8.0, revision: 54465, user: default. 2024.10.22 00:07:56.730675 [ 473 ] {} TCP-Session: d1dae651-90ba-4adc-b7f1-6cd638c2f0f0 Authenticating user 'default' from [::1]:36164 2024.10.22 00:07:56.762177 [ 474 ] {} KeeperTCPHandlerFactory: Keeper request. Address: [::1]:37914 2024.10.22 00:07:56.770638 [ 959 ] {} DDLWorker: Started DDLWorker cleanup thread 2024.10.22 00:07:56.781224 [ 474 ] {} KeeperTCPHandler: Requesting session ID for the new client 2024.10.22 00:07:56.793333 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:07:56.811167 [ 802 ] {} KeeperStateMachine: Session ID response 1 with timeout 30000 2024.10.22 00:07:56.817212 [ 474 ] {} KeeperTCPHandler: Received session ID 1 2024.10.22 00:07:56.818174 [ 958 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:9181 with session_id 1 2024.10.22 00:07:56.834308 [ 473 ] {} TCP-Session: d1dae651-90ba-4adc-b7f1-6cd638c2f0f0 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:07:56.835645 [ 473 ] {} TCP-Session: d1dae651-90ba-4adc-b7f1-6cd638c2f0f0 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:07:56.993615 [ 958 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.10.22 00:07:56.994891 [ 958 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.10.22 00:07:56.995994 [ 958 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: enabled 2024.10.22 00:07:56.998267 [ 958 ] {} ZooKeeper: Initialized, hosts: localhost:9181 2024.10.22 00:07:57.000694 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 1 2024.10.22 00:07:57.017271 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 89 2024.10.22 00:07:57.059661 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 85 2024.10.22 00:07:57.081001 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 74 2024.10.22 00:07:57.121179 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 85 2024.10.22 00:07:57.231896 [ 473 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = false 2024.10.22 00:07:57.232941 [ 473 ] {} ContextAccess (default): List of all grants: GRANT ALL ON *.* WITH GRANT OPTION 2024.10.22 00:07:57.233907 [ 473 ] {} ContextAccess (default): List of all grants including implicit: GRANT ALL ON *.* WITH GRANT OPTION 2024.10.22 00:07:57.267648 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 89 2024.10.22 00:07:57.327847 [ 473 ] {} TCP-Session: d1dae651-90ba-4adc-b7f1-6cd638c2f0f0 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.10.22 00:07:57.341669 [ 473 ] {fd16f777-166c-4656-a5dd-a0788c85a204} executeQuery: Query span trace_id for opentelemetry log: ee555650-8437-3afc-5445-150eb3e354b9 2024.10.22 00:07:57.345533 [ 473 ] {fd16f777-166c-4656-a5dd-a0788c85a204} executeQuery: (from [::1]:36164) SELECT 1 (stage: Complete) 2024.10.22 00:07:57.371331 [ 473 ] {fd16f777-166c-4656-a5dd-a0788c85a204} ContextAccess (default): Access granted: SELECT(dummy) ON system.one 2024.10.22 00:07:57.377292 [ 473 ] {fd16f777-166c-4656-a5dd-a0788c85a204} InterpreterSelectQuery: FetchColumns -> Complete 2024.10.22 00:07:57.396102 [ 958 ] {} DDLWorker: Initialized DDLWorker thread 2024.10.22 00:07:57.397271 [ 958 ] {} DDLWorker: Scheduling tasks 2024.10.22 00:07:57.398175 [ 959 ] {} DDLWorker: Cleaning queue 2024.10.22 00:07:57.398472 [ 958 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.10.22 00:07:57.493602 [ 473 ] {fd16f777-166c-4656-a5dd-a0788c85a204} executeQuery: Read 1 rows, 1.00 B in 0.148654 sec., 6.727030554172777 rows/sec., 6.73 B/sec. 2024.10.22 00:07:57.510832 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 807.62 MiB, peak 807.62 MiB, free memory in arenas 1.16 MiB, will set to 811.21 MiB (RSS), difference: 3.60 MiB 2024.10.22 00:07:57.514737 [ 473 ] {fd16f777-166c-4656-a5dd-a0788c85a204} TCPHandler: Processed in 0.186210003 sec. 2024.10.22 00:07:57.551725 [ 958 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=0, queue_size=0, entries=none..none, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.10.22 00:07:57.654118 [ 958 ] {} DDLWorker: No tasks to schedule 2024.10.22 00:07:57.655184 [ 958 ] {} DDLWorker: Waiting for queue updates 2024.10.22 00:07:57.717688 [ 473 ] {} TCPHandler: Done processing connection. 2024.10.22 00:07:57.800220 [ 473 ] {} TCP-Session: d1dae651-90ba-4adc-b7f1-6cd638c2f0f0 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:12:26.025001 [ 474 ] {} KeeperTCPHandler: Session #1 expired 2024.10.22 00:12:26.045262 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 135 entries to flush up to offset 288 2024.10.22 00:12:26.057365 [ 890 ] {} SystemLog (system.query_log): Flushing system log, 2 entries to flush up to offset 2 2024.10.22 00:12:26.058594 [ 473 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:35786 2024.10.22 00:12:26.060729 [ 890 ] {} SystemLog (system.query_log): Creating new table system.query_log for QueryLog 2024.10.22 00:12:26.059829 [ 807 ] {} KeeperDispatcher: Found dead session 1, will try to close it 2024.10.22 00:12:26.063924 [ 473 ] {} TCPHandler: Connected ClickHouse client version 23.8.0, revision: 54465, user: default. 2024.10.22 00:12:26.065395 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:12:26.065550 [ 473 ] {} TCP-Session: 21401369-fd0a-458d-9c42-e7f04afc5f98 Authenticating user 'default' from [::1]:35786 2024.10.22 00:12:26.059559 [ 898 ] {} SystemLog (system.opentelemetry_span_log): Flushing system log, 5 entries to flush up to offset 5 2024.10.22 00:12:26.070610 [ 898 ] {} SystemLog (system.opentelemetry_span_log): Creating new table system.opentelemetry_span_log for OpenTelemetrySpanLog 2024.10.22 00:12:26.061657 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 1 entries to flush up to offset 1 2024.10.22 00:12:26.071329 [ 473 ] {} TCP-Session: 21401369-fd0a-458d-9c42-e7f04afc5f98 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:12:26.066737 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1059 entries to flush up to offset 1059 2024.10.22 00:12:26.072692 [ 473 ] {} TCP-Session: 21401369-fd0a-458d-9c42-e7f04afc5f98 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:12:26.074388 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Creating new table system.asynchronous_metric_log for AsynchronousMetricLog 2024.10.22 00:12:26.070547 [ 901 ] {} SystemLog (system.session_log): Flushing system log, 2 entries to flush up to offset 2 2024.10.22 00:12:26.078974 [ 902 ] {} SystemLog (system.transactions_info_log): Creating new table system.transactions_info_log for TransactionsInfoLog 2024.10.22 00:12:26.079632 [ 901 ] {} SystemLog (system.session_log): Creating new table system.session_log for SessionLog 2024.10.22 00:12:26.066110 [ 807 ] {} KeeperDispatcher: Dead session close request pushed 2024.10.22 00:12:26.089739 [ 594 ] {} DNSResolver: Updating DNS cache 2024.10.22 00:12:26.040387 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 18 entries to flush up to offset 18 2024.10.22 00:12:26.159911 [ 594 ] {} DNSResolver: Updated DNS cache 2024.10.22 00:12:26.160846 [ 900 ] {} SystemLog (system.zookeeper_log): Creating new table system.zookeeper_log for ZooKeeperLog 2024.10.22 00:12:26.062885 [ 893 ] {} SystemLog (system.trace_log): Flushing system log, 14 entries to flush up to offset 14 2024.10.22 00:12:26.166151 [ 893 ] {} SystemLog (system.trace_log): Creating new table system.trace_log for TraceLog 2024.10.22 00:12:26.451937 [ 473 ] {} TCP-Session: 21401369-fd0a-458d-9c42-e7f04afc5f98 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.10.22 00:12:26.464559 [ 473 ] {3d131524-2bb6-4e18-8cec-cf271298be06} executeQuery: (from [::1]:35786) SELECT 'Connected to clickhouse-server after attaching gdb' (stage: Complete) 2024.10.22 00:12:26.481710 [ 473 ] {3d131524-2bb6-4e18-8cec-cf271298be06} ContextAccess (default): Access granted: SELECT(dummy) ON system.one 2024.10.22 00:12:26.484146 [ 473 ] {3d131524-2bb6-4e18-8cec-cf271298be06} InterpreterSelectQuery: FetchColumns -> Complete 2024.10.22 00:12:26.546664 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:26.555839 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:26.576396 [ 473 ] {3d131524-2bb6-4e18-8cec-cf271298be06} executeQuery: Read 1 rows, 1.00 B in 0.111678 sec., 8.954315084439191 rows/sec., 8.95 B/sec. 2024.10.22 00:12:26.596892 [ 473 ] {3d131524-2bb6-4e18-8cec-cf271298be06} TCPHandler: Processed in 0.153060154 sec. 2024.10.22 00:12:26.746145 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:12:26.753581 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Loading data parts 2024.10.22 00:12:26.758935 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Loading data parts 2024.10.22 00:12:26.795462 [ 901 ] {} system.session_log (ed97c24a-3021-4d92-aee2-1ef2de3fa803): Loading data parts 2024.10.22 00:12:26.813219 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:26.812632 [ 473 ] {} TCPHandler: Done processing connection. 2024.10.22 00:12:26.818866 [ 898 ] {} system.opentelemetry_span_log (6ccc75a8-1522-4520-a414-6e81fb929787): Loading data parts 2024.10.22 00:12:26.834619 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): There are no data parts 2024.10.22 00:12:26.851755 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): There are no data parts 2024.10.22 00:12:26.933579 [ 901 ] {} system.session_log (ed97c24a-3021-4d92-aee2-1ef2de3fa803): There are no data parts 2024.10.22 00:12:26.969444 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Loading data parts 2024.10.22 00:12:26.995412 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 288 2024.10.22 00:12:27.003973 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Loading data parts 2024.10.22 00:12:27.008045 [ 898 ] {} system.opentelemetry_span_log (6ccc75a8-1522-4520-a414-6e81fb929787): There are no data parts 2024.10.22 00:12:27.025825 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): There are no data parts 2024.10.22 00:12:27.047506 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): There are no data parts 2024.10.22 00:12:27.050060 [ 473 ] {} TCP-Session: 21401369-fd0a-458d-9c42-e7f04afc5f98 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:12:27.164515 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Loading data parts 2024.10.22 00:12:27.206486 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:27.212612 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:27.271443 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:27.276476 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): There are no data parts 2024.10.22 00:12:27.278155 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:27.281254 [ 893 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:27.307283 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Loading data parts 2024.10.22 00:12:27.330609 [ 901 ] {} system.session_log (ed97c24a-3021-4d92-aee2-1ef2de3fa803): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:27.333658 [ 901 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:27.334429 [ 893 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:27.360266 [ 898 ] {} system.opentelemetry_span_log (6ccc75a8-1522-4520-a414-6e81fb929787): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:27.362012 [ 898 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:27.381145 [ 898 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:27.396144 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 821.41 MiB, peak 821.41 MiB, free memory in arenas 1.10 MiB, will set to 913.70 MiB (RSS), difference: 92.29 MiB 2024.10.22 00:12:27.404347 [ 898 ] {} system.opentelemetry_span_log (6ccc75a8-1522-4520-a414-6e81fb929787): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:27.405690 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): There are no data parts 2024.10.22 00:12:27.432588 [ 954 ] {} AsynchronousMetrics: Scanning /sys/block 2024.10.22 00:12:27.451195 [ 898 ] {} SystemLog (system.opentelemetry_span_log): Flushed system log up to offset 5 2024.10.22 00:12:27.452372 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:27.497836 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 1 2024.10.22 00:12:27.498523 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:27.517752 [ 901 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:27.568358 [ 901 ] {} system.session_log (ed97c24a-3021-4d92-aee2-1ef2de3fa803): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:27.621565 [ 901 ] {} SystemLog (system.session_log): Flushed system log up to offset 2 2024.10.22 00:12:27.664935 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:27.665489 [ 954 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.018651874 sec. 2024.10.22 00:12:27.666312 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:27.738580 [ 893 ] {} SystemLog (system.trace_log): Flushed system log up to offset 14 2024.10.22 00:12:27.839471 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:27.930271 [ 969 ] {} ZooKeeperClient: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x0000000013cf152c in /usr/bin/clickhouse 6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x0000000013cf07a0 in /usr/bin/clickhouse 7. /build/src/IO/ReadBuffer.h:71: DB::ReadBuffer::next() @ 0x000000000b21bd7c in /usr/bin/clickhouse 8. /build/src/IO/ReadBuffer.h:105: DB::ReadBuffer::read(char*, unsigned long) @ 0x000000000b21b973 in /usr/bin/clickhouse 9. /build/src/IO/ReadBuffer.h:196: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000b5e4468 in /usr/bin/clickhouse 10. /build/src/IO/ReadHelpers.h:117: void DB::readPODBinary(int&, DB::ReadBuffer&) @ 0x0000000013999f02 in /usr/bin/clickhouse 11. /build/src/IO/ReadHelpers.h:1099: void DB::readBinary(int&, DB::ReadBuffer&) @ 0x0000000013999ebd in /usr/bin/clickhouse 12. /build/src/IO/ReadHelpers.h:1136: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001e60277d in /usr/bin/clickhouse 13. /build/src/IO/ReadHelpers.h:1149: void DB::readBinaryBigEndian(int&, DB::ReadBuffer&) @ 0x000000001e60273d in /usr/bin/clickhouse 14. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read(int&, DB::ReadBuffer&) @ 0x000000001e5fdbbd in /usr/bin/clickhouse 15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:284: void Coordination::ZooKeeper::read(int&) @ 0x000000001f30be14 in /usr/bin/clickhouse 16. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:744: Coordination::ZooKeeper::receiveEvent() @ 0x000000001f30124c in /usr/bin/clickhouse 17. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:710: Coordination::ZooKeeper::receiveThread() @ 0x000000001f300cc4 in /usr/bin/clickhouse 18. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:356: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1::operator()() const @ 0x000000001f306af8 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&>()()) std::__invoke[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&) @ 0x000000001f306ad5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001f306ab9 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&) @ 0x000000001f306a1d in /usr/bin/clickhouse 22. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()::operator()() @ 0x000000001f306945 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&) @ 0x000000001f3068b5 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()&) @ 0x000000001f306895 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001f306875 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001f306840 in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 29. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 30. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:12:27.933490 [ 969 ] {} ZooKeeperClient: Finalizing session 1. finalization_started: false, queue_finished: false, reason: 'Exception in receiveThread' 2024.10.22 00:12:27.970434 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:27.971758 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:27.974058 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:28.015998 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 1059 2024.10.22 00:12:28.133498 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:28.397980 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:28.400571 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:28.400916 [ 890 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:28.477012 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 18 2024.10.22 00:12:28.518884 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 902.24 MiB, peak 913.70 MiB, free memory in arenas 3.14 MiB, will set to 919.52 MiB (RSS), difference: 17.28 MiB 2024.10.22 00:12:28.719817 [ 626 ] {} BackgroundJobsAssignee:DataProcessing: Execution took 218 ms. 2024.10.22 00:12:29.048657 [ 890 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:29.171221 [ 968 ] {} ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:37914 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/src/Common/Exception.h:73: DB::Exception::Exception(String&&, int, bool) @ 0x000000000b19878a in /usr/bin/clickhouse 5. /build/src/Common/NetException.h:26: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x0000000013cf30a8 in /usr/bin/clickhouse 6. /build/src/IO/WriteBufferFromPocoSocket.cpp:107: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x0000000013cf26c4 in /usr/bin/clickhouse 7. /build/src/IO/WriteBuffer.h:48: DB::WriteBuffer::next() @ 0x000000000b207e8d in /usr/bin/clickhouse 8. /build/src/Common/ZooKeeper/ZooKeeperCommon.cpp:51: Coordination::ZooKeeperRequest::write(DB::WriteBuffer&) const @ 0x000000001f2cf9e5 in /usr/bin/clickhouse 9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:645: Coordination::ZooKeeper::sendThread() @ 0x000000001f2fffbc in /usr/bin/clickhouse 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:355: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0::operator()() const @ 0x000000001f3062b8 in /usr/bin/clickhouse 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&>()()) std::__invoke[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&) @ 0x000000001f306295 in /usr/bin/clickhouse 12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001f306279 in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&, std::tuple<>&) @ 0x000000001f3061dd in /usr/bin/clickhouse 14. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'()::operator()() @ 0x000000001f306105 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'()&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&) @ 0x000000001f306075 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'()&) @ 0x000000001f306055 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001f306035 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001f306000 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 21. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 22. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 26. ? @ 0x00007fb76fa68ac3 in ? 27. ? @ 0x00007fb76fafa850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:12:29.195511 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:29.643675 [ 890 ] {} SystemLog (system.query_log): Flushed system log up to offset 2 2024.10.22 00:12:30.363120 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 923.62 MiB, peak 923.62 MiB, free memory in arenas 2.60 MiB, will set to 925.78 MiB (RSS), difference: 2.16 MiB 2024.10.22 00:12:30.752344 [ 969 ] {} ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x000000002495e5e7 in /usr/bin/clickhouse 4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000024962727 in /usr/bin/clickhouse 5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000024769587 in /usr/bin/clickhouse 6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x0000000024778ecb in /usr/bin/clickhouse 7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x0000000024777869 in /usr/bin/clickhouse 8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x000000002477a292 in /usr/bin/clickhouse 9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x000000002477dfbe in /usr/bin/clickhouse 10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:961: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001f2f963a in /usr/bin/clickhouse 11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:732: Coordination::ZooKeeper::receiveThread() @ 0x000000001f3010c3 in /usr/bin/clickhouse 12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:356: Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1::operator()() const @ 0x000000001f306af8 in /usr/bin/clickhouse 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&>()()) std::__invoke[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&) @ 0x000000001f306ad5 in /usr/bin/clickhouse 14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001f306ab9 in /usr/bin/clickhouse 15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&, std::tuple<>&) @ 0x000000001f306a1d in /usr/bin/clickhouse 16. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()::operator()() @ 0x000000001f306945 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>()()) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()&>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&) @ 0x000000001f3068b5 in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'()&) @ 0x000000001f306895 in /usr/bin/clickhouse 19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001f306875 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr, std::optional>&&)::$_1&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001f306840 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 23. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 24. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 28. ? @ 0x00007fb76fa68ac3 in ? 29. ? @ 0x00007fb76fafa850 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:12:30.755210 [ 958 ] {} DDLWorker: Scheduling tasks 2024.10.22 00:12:31.003513 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 100 entries to flush up to offset 388 2024.10.22 00:12:31.133782 [ 656 ] {} BackgroundJobsAssignee:DataProcessing: Execution took 249 ms. 2024.10.22 00:12:31.332208 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:31.336021 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:31.376999 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 929.84 MiB, peak 929.84 MiB, free memory in arenas 2.54 MiB, will set to 928.07 MiB (RSS), difference: -1.77 MiB 2024.10.22 00:12:31.391184 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:12:31.548472 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:31.590934 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 388 2024.10.22 00:12:32.792522 [ 958 ] {} DDLWorker: Lost ZooKeeper connection, will try to connect again: Code: 999. Coordination::Exception: Session expired. (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000000b1a6742 in /usr/bin/clickhouse 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000000b1a670d in /usr/bin/clickhouse 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000002495b180 in /usr/bin/clickhouse 3. /build/src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000138e1a6e in /usr/bin/clickhouse 4. /build/contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception(int, char const (&) [16]) @ 0x00000000138d58c0 in /usr/bin/clickhouse 5. /build/src/Common/ZooKeeper/IKeeper.h:469: Coordination::Exception::Exception(char const (&) [16], Coordination::Error) @ 0x000000001f2c306d in /usr/bin/clickhouse 6. /build/src/Common/ZooKeeper/IKeeper.h:503: Coordination::Exception Coordination::Exception::fromMessage(Coordination::Error, char const (&) [16]) @ 0x000000001f2ae166 in /usr/bin/clickhouse 7. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1116: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x000000001f302ba6 in /usr/bin/clickhouse 8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1328: Coordination::ZooKeeper::list(String const&, Coordination::ListRequestType, std::function, std::shared_ptr>) @ 0x000000001f304add in /usr/bin/clickhouse 9. /build/src/Common/ZooKeeper/ZooKeeper.cpp:1080: zkutil::ZooKeeper::asyncTryGetChildrenNoThrow(String const&, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001f272e9c in /usr/bin/clickhouse 10. /build/src/Common/ZooKeeper/ZooKeeper.cpp:217: zkutil::ZooKeeper::getChildrenImpl(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001f272a34 in /usr/bin/clickhouse 11. /build/src/Common/ZooKeeper/ZooKeeper.cpp:290: zkutil::ZooKeeper::tryGetChildrenWatch(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr>, Coordination::ListRequestType) @ 0x000000001f2735db in /usr/bin/clickhouse 12. /build/src/Common/ZooKeeper/ZooKeeper.cpp:266: zkutil::ZooKeeper::tryGetChildren(String const&, std::vector>&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x000000001f2731e2 in /usr/bin/clickhouse 13. /build/src/Common/ZooKeeper/ZooKeeper.cpp:241: zkutil::ZooKeeper::getChildren(String const&, Coordination::Stat*, std::shared_ptr const&, Coordination::ListRequestType) @ 0x000000001f272fdc in /usr/bin/clickhouse 14. /build/src/Interpreters/DDLWorker.cpp:314: DB::DDLWorker::scheduleTasks(bool) @ 0x000000001bec5a07 in /usr/bin/clickhouse 15. /build/src/Interpreters/DDLWorker.cpp:1126: DB::DDLWorker::runMainThread() @ 0x000000001bec0966 in /usr/bin/clickhouse 16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: decltype(*std::declval().*std::declval()()) std::__invoke[abi:v15000](void (DB::DDLWorker::*&)(), DB::DDLWorker*&) @ 0x000000001bedc009 in /usr/bin/clickhouse 17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]&, 0ul>(void (DB::DDLWorker::*&)(), std::tuple&, std::__tuple_indices<0ul>) @ 0x000000001bedbf8d in /usr/bin/clickhouse 18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]&>(void (DB::DDLWorker::*&)(), std::tuple&) @ 0x000000001bedbedd in /usr/bin/clickhouse 19. /build/src/Common/ThreadPool.h:242: ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()::operator()() @ 0x000000001bedbdf5 in /usr/bin/clickhouse 20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()(std::declval())) std::__invoke[abi:v15000]::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&) @ 0x000000001bedbd55 in /usr/bin/clickhouse 21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: void std::__invoke_void_return_wrapper::__call::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&>(ThreadFromGlobalPoolImpl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'()&) @ 0x000000001bedbd35 in /usr/bin/clickhouse 22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: std::__function::__default_alloc_func::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>::operator()[abi:v15000]() @ 0x000000001bedbd15 in /usr/bin/clickhouse 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(void (DB::DDLWorker::*&&)(), DB::DDLWorker*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001bedbce0 in /usr/bin/clickhouse 24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: std::__function::__policy_func::operator()[abi:v15000]() const @ 0x0000000013953756 in /usr/bin/clickhouse 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: std::function::operator()() const @ 0x0000000013952c35 in /usr/bin/clickhouse 26. /build/src/Common/ThreadPool.cpp:426: ThreadPoolImpl::worker(std::__list_iterator) @ 0x0000000013a5c843 in /usr/bin/clickhouse 27. /build/src/Common/ThreadPool.cpp:179: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()::operator()() const @ 0x0000000013a64ae4 in /usr/bin/clickhouse 28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: decltype(std::declval()()) std::__invoke[abi:v15000]::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(void&&) @ 0x0000000013a64a95 in /usr/bin/clickhouse 29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>(std::tuple::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x0000000013a649bd in /usr/bin/clickhouse 30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]>, void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda0'()>>(void*) @ 0x0000000013a644a2 in /usr/bin/clickhouse 31. ? @ 0x00007fb76fa68ac3 in ? (version 23.8.16.42.altinitystable (altinity build)) 2024.10.22 00:12:33.234448 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 928.07 MiB, peak 929.84 MiB, free memory in arenas 2.08 MiB, will set to 929.14 MiB (RSS), difference: 1.08 MiB 2024.10.22 00:12:33.794149 [ 958 ] {} DDLWorker: Initializing DDLWorker thread 2024.10.22 00:12:33.797540 [ 958 ] {} Context: Trying to establish a new connection with ZooKeeper 2024.10.22 00:12:33.816941 [ 474 ] {} KeeperTCPHandlerFactory: Keeper request. Address: [::1]:48272 2024.10.22 00:12:33.826447 [ 474 ] {} KeeperTCPHandler: Requesting session ID for the new client 2024.10.22 00:12:33.836599 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:12:33.851053 [ 802 ] {} KeeperStateMachine: Session ID response 2 with timeout 30000 2024.10.22 00:12:33.866527 [ 474 ] {} KeeperTCPHandler: Received session ID 2 2024.10.22 00:12:33.869533 [ 958 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:9181 with session_id 2 2024.10.22 00:12:34.007588 [ 958 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: enabled 2024.10.22 00:12:34.008724 [ 958 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2024.10.22 00:12:34.009456 [ 958 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: enabled 2024.10.22 00:12:34.010809 [ 958 ] {} ZooKeeper: Initialized, hosts: localhost:9181 2024.10.22 00:12:34.011693 [ 958 ] {} ZooKeeperClient: ZK send fault: 0.002% 2024.10.22 00:12:34.012761 [ 958 ] {} ZooKeeperClient: ZK recv fault: 0.002% 2024.10.22 00:12:34.013376 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 1 2024.10.22 00:12:34.013460 [ 958 ] {} ZooKeeperClient: ZK send sleep: 0.001% -> 10000ms 2024.10.22 00:12:34.014252 [ 958 ] {} Context: Establishing a new connection with ZooKeeper took 216 ms 2024.10.22 00:12:34.038911 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 89 2024.10.22 00:12:34.057458 [ 958 ] {} DDLWorker: Initialized DDLWorker thread 2024.10.22 00:12:34.058692 [ 958 ] {} DDLWorker: Scheduling tasks 2024.10.22 00:12:34.059083 [ 959 ] {} DDLWorker: Cleaning queue 2024.10.22 00:12:34.059698 [ 958 ] {} DDLWorker: Don't have unfinished tasks after restarting 2024.10.22 00:12:34.067095 [ 958 ] {} DDLWorker: scheduleTasks: initialized=true, size_before_filtering=0, queue_size=0, entries=none..none, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2024.10.22 00:12:34.067821 [ 958 ] {} DDLWorker: No tasks to schedule 2024.10.22 00:12:34.068398 [ 958 ] {} DDLWorker: Waiting for queue updates 2024.10.22 00:12:34.377666 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 934.19 MiB, peak 934.19 MiB, free memory in arenas 2.01 MiB, will set to 930.14 MiB (RSS), difference: -4.05 MiB 2024.10.22 00:12:35.000432 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 9 entries to flush up to offset 10 2024.10.22 00:12:35.019349 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 2545 entries to flush up to offset 3604 2024.10.22 00:12:35.094930 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:35.097140 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:35.118047 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:12:35.242646 [ 893 ] {} SystemLog (system.trace_log): Flushing system log, 18 entries to flush up to offset 32 2024.10.22 00:12:35.268188 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 934.34 MiB, peak 934.34 MiB, free memory in arenas 2.17 MiB, will set to 932.86 MiB (RSS), difference: -1.47 MiB 2024.10.22 00:12:35.356559 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:35.358029 [ 893 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.65 GiB. 2024.10.22 00:12:35.358352 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:35.380391 [ 893 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:12:35.383728 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 10 2024.10.22 00:12:35.512400 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:35.581192 [ 893 ] {} SystemLog (system.trace_log): Flushed system log up to offset 32 2024.10.22 00:12:35.597013 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 50 entries to flush up to offset 438 2024.10.22 00:12:35.763705 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:35.769816 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.61 GiB. 2024.10.22 00:12:35.978397 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 10 entries to flush up to offset 28 2024.10.22 00:12:36.021832 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 00:12:36.075617 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:36.099221 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:36.100936 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.58 GiB. 2024.10.22 00:12:36.202735 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 438 2024.10.22 00:12:36.276144 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:36.288946 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.56 GiB. 2024.10.22 00:12:36.299530 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:12:36.413546 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 936.97 MiB, peak 936.97 MiB, free memory in arenas 2.44 MiB, will set to 933.48 MiB (RSS), difference: -3.49 MiB 2024.10.22 00:12:36.500871 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:12:36.580860 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:36.620726 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 28 2024.10.22 00:12:36.657735 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:36.690405 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 3604 2024.10.22 00:12:37.144746 [ 890 ] {} SystemLog (system.query_log): Flushing system log, 2 entries to flush up to offset 4 2024.10.22 00:12:37.512509 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 925.36 MiB, peak 937.74 MiB, free memory in arenas 3.66 MiB, will set to 935.30 MiB (RSS), difference: 9.94 MiB 2024.10.22 00:12:38.426955 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:38.436524 [ 890 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.38 GiB. 2024.10.22 00:12:38.815721 [ 890 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:12:39.222611 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:39.370306 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 935.30 MiB, peak 937.74 MiB, free memory in arenas 2.72 MiB, will set to 936.36 MiB (RSS), difference: 1.05 MiB 2024.10.22 00:12:39.442550 [ 890 ] {} SystemLog (system.query_log): Flushed system log up to offset 4 2024.10.22 00:12:39.979093 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:39.981162 [ 896 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.25 GiB. 2024.10.22 00:12:40.208737 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 28 entries to flush up to offset 466 2024.10.22 00:12:40.441264 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:40.468026 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 301.21 GiB. 2024.10.22 00:12:40.534215 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 00:12:40.705227 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:40.767055 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 466 2024.10.22 00:12:41.263663 [ 630 ] {} DNSResolver: Updating DNS cache 2024.10.22 00:12:41.283716 [ 630 ] {} DNSResolver: Updated DNS cache 2024.10.22 00:12:42.408033 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 940.90 MiB, peak 940.90 MiB, free memory in arenas 2.97 MiB, will set to 938.08 MiB (RSS), difference: -2.82 MiB 2024.10.22 00:12:42.886833 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 7 entries to flush up to offset 17 2024.10.22 00:12:43.084204 [ 893 ] {} SystemLog (system.trace_log): Flushing system log, 4 entries to flush up to offset 36 2024.10.22 00:12:43.090881 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:43.093424 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.96 GiB. 2024.10.22 00:12:43.149415 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:12:43.348024 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:43.358668 [ 893 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.93 GiB. 2024.10.22 00:12:43.535591 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:43.538606 [ 893 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:12:43.608189 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 946.44 MiB, peak 946.44 MiB, free memory in arenas 3.04 MiB, will set to 938.09 MiB (RSS), difference: -8.34 MiB 2024.10.22 00:12:43.620150 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:43.680532 [ 893 ] {} SystemLog (system.trace_log): Flushed system log up to offset 36 2024.10.22 00:12:43.687329 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 17 2024.10.22 00:12:43.697485 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 2304 entries to flush up to offset 5908 2024.10.22 00:12:43.874349 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:12:43.874436 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:12:43.900302 [ 856 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): /var/lib/clickhouse/store/92e/92e05502-7cd1-42a9-b81b-a85674c93a09/tmp_insert_202410_1_1_0/ is in use (by merge/mutation/INSERT) (consider increasing temporary_directories_lifetime setting) 2024.10.22 00:12:44.002475 [ 896 ] {} MergedBlockOutputStream: filled checksums 202410_1_1_0 (state Temporary) 2024.10.22 00:12:44.123323 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 29 2024.10.22 00:12:44.349024 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:44.356436 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.81 GiB. 2024.10.22 00:12:44.403705 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:44.408680 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.80 GiB. 2024.10.22 00:12:44.582628 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:12:44.615428 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:12:44.619130 [ 655 ] {} BackgroundJobsAssignee:DataProcessing: Execution took 233 ms. 2024.10.22 00:12:44.704303 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:44.769893 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 36 entries to flush up to offset 502 2024.10.22 00:12:44.864875 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:44.879205 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 5908 2024.10.22 00:12:44.985519 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 29 2024.10.22 00:12:44.986826 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:44.989465 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.75 GiB. 2024.10.22 00:12:45.134378 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 00:12:45.274668 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:45.311956 [ 664 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 00:12:45.318318 [ 664 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:45.320022 [ 664 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.72 GiB. 2024.10.22 00:12:45.322359 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 502 2024.10.22 00:12:45.367778 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 00:12:45.502663 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:12:45.522887 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 153 rows starting from the beginning of the part 2024.10.22 00:12:45.557016 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 135 rows starting from the beginning of the part 2024.10.22 00:12:45.668868 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 934.27 MiB, peak 946.65 MiB, free memory in arenas 3.90 MiB, will set to 940.44 MiB (RSS), difference: 6.17 MiB 2024.10.22 00:12:45.668832 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 100 rows starting from the beginning of the part 2024.10.22 00:12:45.693102 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 50 rows starting from the beginning of the part 2024.10.22 00:12:45.717635 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 28 rows starting from the beginning of the part 2024.10.22 00:12:45.862745 [ 818 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 36 rows starting from the beginning of the part 2024.10.22 00:12:46.345653 [ 667 ] {} DatabaseCatalog: Execution took 219 ms. 2024.10.22 00:12:47.294749 [ 856 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): /var/lib/clickhouse/store/ffa/ffa745eb-8a28-47e2-b73e-5e0c8034f61b/tmp_merge_202410_1_6_1/ is in use (by merge/mutation/INSERT) (consider increasing temporary_directories_lifetime setting) 2024.10.22 00:12:47.381278 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 944.05 MiB, peak 946.65 MiB, free memory in arenas 3.67 MiB, will set to 942.05 MiB (RSS), difference: -1.99 MiB 2024.10.22 00:12:47.630781 [ 831 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 502 rows, containing 13 columns (13 merged, 0 gathered) in 2.276348425 sec., 220.52863018981813 rows/sec., 43.75 KiB/sec. 2024.10.22 00:12:47.774584 [ 827 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 00:12:47.868618 [ 832 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:47.898329 [ 832 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_6_1} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 00:12:47.952043 [ 832 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.21 MiB. 2024.10.22 00:12:48.882198 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 938.49 MiB, peak 946.65 MiB, free memory in arenas 2.67 MiB, will set to 942.89 MiB (RSS), difference: 4.40 MiB 2024.10.22 00:12:49.326682 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 30 entries to flush up to offset 532 2024.10.22 00:12:49.566443 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:49.568100 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.67 GiB. 2024.10.22 00:12:49.744714 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_7_7_0 (state Temporary) 2024.10.22 00:12:49.953573 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_7_7_0 to 202410_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:50.154933 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 532 2024.10.22 00:12:51.184467 [ 893 ] {} SystemLog (system.trace_log): Flushing system log, 13 entries to flush up to offset 49 2024.10.22 00:12:51.195038 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 13 entries to flush up to offset 30 2024.10.22 00:12:51.287951 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:51.293614 [ 893 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.47 GiB. 2024.10.22 00:12:51.346881 [ 893 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 00:12:51.363479 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:51.364441 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.47 GiB. 2024.10.22 00:12:51.368059 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:51.392444 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 00:12:51.393783 [ 893 ] {} SystemLog (system.trace_log): Flushed system log up to offset 49 2024.10.22 00:12:51.434860 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:51.464251 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 30 2024.10.22 00:12:51.887596 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1920 entries to flush up to offset 7828 2024.10.22 00:12:52.599508 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:52.603336 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.47 GiB. 2024.10.22 00:12:52.742896 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Renaming temporary part tmp_insert_202410_1_1_0 to 202410_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:52.805325 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 00:12:52.961693 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:53.079244 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 7828 2024.10.22 00:12:53.172904 [ 706 ] {} BackgroundJobsAssignee:DataProcessing: Execution took 219 ms. 2024.10.22 00:12:53.228053 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 937.74 MiB, peak 950.71 MiB, free memory in arenas 2.53 MiB, will set to 942.96 MiB (RSS), difference: 5.23 MiB 2024.10.22 00:12:53.875397 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:12:53.876406 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:12:54.160811 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 29 entries to flush up to offset 561 2024.10.22 00:12:54.243053 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:54.245239 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.47 GiB. 2024.10.22 00:12:54.373731 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_8_8_0 (state Temporary) 2024.10.22 00:12:54.603823 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_8_8_0 to 202410_8_8_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:54.628291 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 561 2024.10.22 00:12:55.472819 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 938.96 MiB, peak 950.71 MiB, free memory in arenas 5.39 MiB, will set to 942.13 MiB (RSS), difference: 3.16 MiB 2024.10.22 00:12:55.656907 [ 896 ] {} SystemLog (system.metric_log): Flushed system log up to offset 8 2024.10.22 00:12:56.289392 [ 603 ] {} DNSResolver: Updating DNS cache 2024.10.22 00:12:56.309719 [ 603 ] {} DNSResolver: Updated DNS cache 2024.10.22 00:12:58.639276 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 10 entries to flush up to offset 571 2024.10.22 00:12:58.897794 [ 893 ] {} SystemLog (system.trace_log): Flushing system log, 2 entries to flush up to offset 51 2024.10.22 00:12:58.915741 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:58.918254 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.45 GiB. 2024.10.22 00:12:58.965794 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 5 entries to flush up to offset 35 2024.10.22 00:12:58.970912 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_9_9_0 (state Temporary) 2024.10.22 00:12:59.010420 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:59.013601 [ 893 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.45 GiB. 2024.10.22 00:12:59.041151 [ 893 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 00:12:59.055683 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:12:59.056935 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.45 GiB. 2024.10.22 00:12:59.060815 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:59.071950 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 00:12:59.083353 [ 893 ] {} SystemLog (system.trace_log): Flushed system log up to offset 51 2024.10.22 00:12:59.122784 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_9_9_0 to 202410_9_9_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:59.124776 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:12:59.145544 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 35 2024.10.22 00:12:59.175267 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 571 2024.10.22 00:12:59.993125 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 30 2024.10.22 00:13:00.082366 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 2690 entries to flush up to offset 10518 2024.10.22 00:13:00.507415 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:00.523550 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.30 GiB. 2024.10.22 00:13:00.780425 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 00:13:00.882454 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:00.998684 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:01.000729 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.26 GiB. 2024.10.22 00:13:01.066144 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 30 2024.10.22 00:13:01.137038 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 00:13:01.177392 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:01.189598 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 10518 2024.10.22 00:13:01.273001 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 941.82 MiB, peak 950.71 MiB, free memory in arenas 3.43 MiB, will set to 940.34 MiB (RSS), difference: -1.48 MiB 2024.10.22 00:13:03.260777 [ 896 ] {} SystemLog (system.metric_log): Flushing system log, 42 entries to flush up to offset 50 2024.10.22 00:13:03.278767 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 31 entries to flush up to offset 602 2024.10.22 00:13:03.536879 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:03.646583 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 300.01 GiB. 2024.10.22 00:13:03.874444 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:13:03.875123 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:13:03.929335 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_10_10_0 (state Temporary) 2024.10.22 00:13:04.073819 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_10_10_0 to 202410_10_10_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:04.223434 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 602 2024.10.22 00:13:04.443005 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 941.18 MiB, peak 950.71 MiB, free memory in arenas 3.99 MiB, will set to 938.96 MiB (RSS), difference: -2.21 MiB 2024.10.22 00:13:06.048846 [ 473 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:39956 2024.10.22 00:13:06.053569 [ 473 ] {} TCPHandler: Connected ClickHouse client version 23.8.0, revision: 54465, user: default. 2024.10.22 00:13:06.054719 [ 473 ] {} TCP-Session: 9b86c8a8-00d9-44e8-8804-30436cb98398 Authenticating user 'default' from [::1]:39956 2024.10.22 00:13:06.056824 [ 473 ] {} TCP-Session: 9b86c8a8-00d9-44e8-8804-30436cb98398 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:13:06.057649 [ 473 ] {} TCP-Session: 9b86c8a8-00d9-44e8-8804-30436cb98398 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:13:06.165777 [ 473 ] {} TCP-Session: 9b86c8a8-00d9-44e8-8804-30436cb98398 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.10.22 00:13:06.183224 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} executeQuery: (from [::1]:39956) ATTACH DATABASE IF NOT EXISTS datasets ENGINE = Ordinary (stage: Complete) 2024.10.22 00:13:06.192141 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} ContextAccess (default): Access granted: CREATE DATABASE ON datasets.* 2024.10.22 00:13:06.493837 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} DatabaseOrdinary (datasets): Metadata processed, database datasets has 2 tables and 0 dictionaries in total. 2024.10.22 00:13:06.496085 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} TablesLoader: Parsed metadata of 2 tables in 1 databases in 0.298800622 sec 2024.10.22 00:13:06.501072 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} ReferentialDeps: No tables 2024.10.22 00:13:06.503284 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} LoadingDeps: Table datasets.visits_v1 has no dependencies (level 0) 2024.10.22 00:13:06.505074 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} LoadingDeps: Table datasets.hits_v1 has no dependencies (level 0) 2024.10.22 00:13:06.509103 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} TablesLoader: Loading 2 tables with dependency level 0 2024.10.22 00:13:06.647656 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 6 entries to flush up to offset 41 2024.10.22 00:13:06.815261 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:06.817073 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:06.831673 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 941.30 MiB, peak 950.71 MiB, free memory in arenas 3.27 MiB, will set to 938.34 MiB (RSS), difference: -2.96 MiB 2024.10.22 00:13:06.857214 [ 968 ] {} datasets.hits_v1: Loading data parts 2024.10.22 00:13:06.859663 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 00:13:06.878807 [ 968 ] {} datasets.hits_v1: Will load 1 parts using up to 64 threads 2024.10.22 00:13:06.881203 [ 1009 ] {} datasets.hits_v1: Loading Active part 201403_10_18_2 from disk default 2024.10.22 00:13:06.996833 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:07.013576 [ 664 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 00:13:07.021576 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 41 2024.10.22 00:13:07.118957 [ 664 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:07.121209 [ 664 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:07.163319 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 00:13:07.178876 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:13:07.181823 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 1 rows starting from the beginning of the part 2024.10.22 00:13:07.360451 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 9 rows starting from the beginning of the part 2024.10.22 00:13:07.367188 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 7 rows starting from the beginning of the part 2024.10.22 00:13:07.374960 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 13 rows starting from the beginning of the part 2024.10.22 00:13:07.408318 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 5 rows starting from the beginning of the part 2024.10.22 00:13:07.416317 [ 820 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 6 rows starting from the beginning of the part 2024.10.22 00:13:07.458644 [ 969 ] {} datasets.visits_v1: Loading data parts 2024.10.22 00:13:07.610401 [ 969 ] {} datasets.visits_v1: Will load 1 parts using up to 64 threads 2024.10.22 00:13:07.617776 [ 1011 ] {} datasets.visits_v1: Loading Active part 20140317_20140323_3_4_1 from disk default 2024.10.22 00:13:07.757328 [ 1009 ] {} datasets.hits_v1: Finished loading Active part 201403_10_18_2 on disk default 2024.10.22 00:13:07.773661 [ 968 ] {} datasets.hits_v1: Loaded data parts (1 items) 2024.10.22 00:13:08.113757 [ 821 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 41 rows, containing 12 columns (12 merged, 0 gathered) in 0.954221864 sec., 42.96694673095438 rows/sec., 5.70 KiB/sec. 2024.10.22 00:13:08.169770 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 941.78 MiB, peak 950.71 MiB, free memory in arenas 1.99 MiB, will set to 940.07 MiB (RSS), difference: -1.71 MiB 2024.10.22 00:13:08.201690 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1920 entries to flush up to offset 12438 2024.10.22 00:13:08.227888 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 53 entries to flush up to offset 655 2024.10.22 00:13:08.254691 [ 817 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 00:13:08.297741 [ 832 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:08.299475 [ 832 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_6_1} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 00:13:08.313191 [ 832 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.21 MiB. 2024.10.22 00:13:08.416474 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:08.417807 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:08.567765 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 31 2024.10.22 00:13:08.695579 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_11_11_0 (state Temporary) 2024.10.22 00:13:08.706041 [ 1011 ] {} datasets.visits_v1: Finished loading Active part 20140317_20140323_3_4_1 on disk default 2024.10.22 00:13:08.717294 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:08.723298 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:08.757299 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_11_11_0 to 202410_11_11_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:08.782945 [ 675 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b) (MergerMutator): Selected 6 parts from 202410_1_6_1 to 202410_11_11_0 2024.10.22 00:13:08.788010 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 655 2024.10.22 00:13:08.867562 [ 969 ] {} datasets.visits_v1: Loaded data parts (1 items) 2024.10.22 00:13:08.869081 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:08.871666 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:08.895935 [ 675 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:08.898136 [ 675 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:08.899363 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_5_5_0 (state Temporary) 2024.10.22 00:13:09.011522 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_6_1 to 202410_11_11_0 into Compact with storage Full 2024.10.22 00:13:09.053556 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 00:13:09.096026 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:09.098908 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} DatabaseOrdinary (datasets): Starting up tables. 2024.10.22 00:13:09.113502 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 12438 2024.10.22 00:13:09.118085 [ 676 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 00:13:09.126635 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:13:09.130553 [ 676 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:09.131872 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_6_1, total 502 rows starting from the beginning of the part 2024.10.22 00:13:09.133638 [ 676 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:09.173558 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_5_5_0 to 202410_5_5_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:09.180424 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_7_7_0, total 30 rows starting from the beginning of the part 2024.10.22 00:13:09.187970 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 00:13:09.188889 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_8_8_0, total 29 rows starting from the beginning of the part 2024.10.22 00:13:09.195009 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_9_9_0, total 10 rows starting from the beginning of the part 2024.10.22 00:13:09.201267 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_10_10_0, total 31 rows starting from the beginning of the part 2024.10.22 00:13:09.206670 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_11_11_0, total 53 rows starting from the beginning of the part 2024.10.22 00:13:09.221442 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 31 2024.10.22 00:13:09.284531 [ 473 ] {3c238157-6aab-4544-af5b-4c315fd81f00} TCPHandler: Processed in 3.123665061 sec. 2024.10.22 00:13:09.285703 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:13:09.301385 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 1059 rows starting from the beginning of the part 2024.10.22 00:13:09.307228 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 2545 rows starting from the beginning of the part 2024.10.22 00:13:09.309173 [ 473 ] {} TCPHandler: Done processing connection. 2024.10.22 00:13:09.311974 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 2304 rows starting from the beginning of the part 2024.10.22 00:13:09.316129 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 1920 rows starting from the beginning of the part 2024.10.22 00:13:09.327508 [ 473 ] {} TCP-Session: 9b86c8a8-00d9-44e8-8804-30436cb98398 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:13:09.420220 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 2690 rows starting from the beginning of the part 2024.10.22 00:13:09.452557 [ 890 ] {} SystemLog (system.query_log): Flushing system log, 2 entries to flush up to offset 6 2024.10.22 00:13:09.468856 [ 826 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 1920 rows starting from the beginning of the part 2024.10.22 00:13:09.735435 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 944.77 MiB, peak 950.71 MiB, free memory in arenas 2.16 MiB, will set to 941.23 MiB (RSS), difference: -3.54 MiB 2024.10.22 00:13:09.739547 [ 473 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:54816 2024.10.22 00:13:09.745795 [ 473 ] {} TCPHandler: Connected ClickHouse client version 23.8.0, revision: 54465, user: default. 2024.10.22 00:13:09.747580 [ 473 ] {} TCP-Session: f9a8c8ba-55d9-4f37-91f6-19d42b8926e2 Authenticating user 'default' from [::1]:54816 2024.10.22 00:13:09.750938 [ 473 ] {} TCP-Session: f9a8c8ba-55d9-4f37-91f6-19d42b8926e2 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:13:09.753325 [ 473 ] {} TCP-Session: f9a8c8ba-55d9-4f37-91f6-19d42b8926e2 Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:13:09.869045 [ 473 ] {} TCP-Session: f9a8c8ba-55d9-4f37-91f6-19d42b8926e2 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2024.10.22 00:13:09.875113 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} executeQuery: (from [::1]:54816) CREATE DATABASE IF NOT EXISTS test (stage: Complete) 2024.10.22 00:13:09.879944 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} ContextAccess (default): Access granted: CREATE DATABASE ON test.* 2024.10.22 00:13:09.905228 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} DatabaseAtomic (test): Metadata processed, database test has 0 tables and 0 dictionaries in total. 2024.10.22 00:13:09.908750 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} TablesLoader: Parsed metadata of 0 tables in 1 databases in 0.017984873 sec 2024.10.22 00:13:09.912486 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} ReferentialDeps: No tables 2024.10.22 00:13:09.915734 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} LoadingDeps: No tables 2024.10.22 00:13:09.921037 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} DatabaseAtomic (test): Starting up tables. 2024.10.22 00:13:09.931886 [ 473 ] {0c1640e3-0d54-48fa-8f83-5c9364b0611c} TCPHandler: Processed in 0.06439611 sec. 2024.10.22 00:13:09.957075 [ 473 ] {} TCPHandler: Done processing connection. 2024.10.22 00:13:10.004846 [ 473 ] {} TCP-Session: f9a8c8ba-55d9-4f37-91f6-19d42b8926e2 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2024.10.22 00:13:10.110282 [ 469 ] {} BaseDaemon: Received signal 15 2024.10.22 00:13:10.118038 [ 469 ] {} Application: Received termination signal (Terminated) 2024.10.22 00:13:10.123430 [ 468 ] {} Application: Received termination signal. 2024.10.22 00:13:10.134899 [ 468 ] {} Application: Waiting for current connections to close. 2024.10.22 00:13:10.269722 [ 820 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergeTask::MergeProjectionsStage: Merge sorted 655 rows, containing 13 columns (13 merged, 0 gathered) in 1.264935193 sec., 517.8130892591903 rows/sec., 94.39 KiB/sec. 2024.10.22 00:13:10.295135 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:10.296730 [ 890 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:10.399922 [ 819 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} MergedBlockOutputStream: filled checksums 202410_1_11_2 (state Temporary) 2024.10.22 00:13:10.408511 [ 890 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:13:10.435314 [ 829 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_merge_202410_1_11_2 to 202410_1_11_2 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:10.437373 [ 828 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 12438 rows, containing 4 columns (4 merged, 0 gathered) in 1.25706739 sec., 9894.457607400029 rows/sec., 154.60 KiB/sec. 2024.10.22 00:13:10.440340 [ 829 ] {ffa745eb-8a28-47e2-b73e-5e0c8034f61b::202410_1_11_2} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b) (MergerMutator): Merged 6 parts: [202410_1_6_1, 202410_11_11_0] -> 202410_1_11_2 2024.10.22 00:13:10.472251 [ 823 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 00:13:10.488451 [ 829 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.20 MiB. 2024.10.22 00:13:10.516583 [ 817 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:10.523285 [ 817 ] {77c672cd-125d-412b-9cb8-29507f0d4ac1::202410_1_6_1} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 00:13:10.667080 [ 817 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 8.20 MiB. 2024.10.22 00:13:10.859472 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:11.025974 [ 703 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac) (MergerMutator): Selected 5 parts from 202410_1_1_0 to 202410_5_5_0 2024.10.22 00:13:11.045166 [ 703 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:11.048745 [ 703 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:11.058715 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTask::PrepareStage: Merging 5 parts: from 202410_1_1_0 to 202410_5_5_0 into Compact with storage Full 2024.10.22 00:13:11.065057 [ 890 ] {} SystemLog (system.query_log): Flushed system log up to offset 6 2024.10.22 00:13:11.186453 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:13:11.191779 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 14 rows starting from the beginning of the part 2024.10.22 00:13:11.199026 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 18 rows starting from the beginning of the part 2024.10.22 00:13:11.208254 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 4 rows starting from the beginning of the part 2024.10.22 00:13:11.215540 [ 954 ] {} AsynchronousMetrics: MemoryTracking: was 931.67 MiB, peak 950.71 MiB, free memory in arenas 2.55 MiB, will set to 947.48 MiB (RSS), difference: 15.81 MiB 2024.10.22 00:13:11.238805 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 13 rows starting from the beginning of the part 2024.10.22 00:13:11.245056 [ 820 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 2 rows starting from the beginning of the part 2024.10.22 00:13:11.312279 [ 699 ] {} DNSResolver: Updating DNS cache 2024.10.22 00:13:11.323314 [ 699 ] {} DNSResolver: Updated DNS cache 2024.10.22 00:13:11.701375 [ 468 ] {} Application: Closed all listening sockets. 2024.10.22 00:13:11.703655 [ 468 ] {} Application: Closed connections. 2024.10.22 00:13:11.727105 [ 831 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergeTask::MergeProjectionsStage: Merge sorted 51 rows, containing 13 columns (13 merged, 0 gathered) in 0.670929311 sec., 76.01396922722907 rows/sec., 27.76 KiB/sec. 2024.10.22 00:13:11.743297 [ 823 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} MergedBlockOutputStream: filled checksums 202410_1_5_1 (state Temporary) 2024.10.22 00:13:11.889212 [ 818 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_merge_202410_1_5_1 to 202410_1_5_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:11.899790 [ 818 ] {b1d331ed-9402-47f3-92ba-69560d00c0ac::202410_1_5_1} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac) (MergerMutator): Merged 5 parts: [202410_1_1_0, 202410_5_5_0] -> 202410_1_5_1 2024.10.22 00:13:11.914382 [ 818 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.20 MiB. 2024.10.22 00:13:12.489674 [ 468 ] {} Application: Shutting down storages. 2024.10.22 00:13:12.492357 [ 468 ] {} Context: Shutdown disk azure 2024.10.22 00:13:12.493330 [ 468 ] {} DiskObjectStorage(DiskAzureBlobStorage): Shutting down disk azure 2024.10.22 00:13:12.494476 [ 468 ] {} DiskObjectStorage(DiskAzureBlobStorage): Disk azure shut down 2024.10.22 00:13:12.495494 [ 468 ] {} Context: Shutdown disk cached_azure 2024.10.22 00:13:12.496746 [ 468 ] {} DiskObjectStorage(azure): Shutting down disk azure 2024.10.22 00:13:12.498702 [ 468 ] {} DiskObjectStorage(azure): Disk azure shut down 2024.10.22 00:13:12.499832 [ 468 ] {} Context: Shutdown disk default 2024.10.22 00:13:12.501308 [ 468 ] {} Context: Shutdown disk local_cache 2024.10.22 00:13:12.503327 [ 468 ] {} DiskObjectStorage(local_disk): Shutting down disk local_disk 2024.10.22 00:13:12.504788 [ 468 ] {} DiskObjectStorage(local_disk): Disk local_disk shut down 2024.10.22 00:13:12.514622 [ 468 ] {} Context: Shutdown disk local_cache_2 2024.10.22 00:13:12.516006 [ 468 ] {} DiskObjectStorage(local_disk): Shutting down disk local_disk 2024.10.22 00:13:12.517459 [ 468 ] {} DiskObjectStorage(local_disk): Disk local_disk shut down 2024.10.22 00:13:12.518472 [ 468 ] {} Context: Shutdown disk local_cache_3 2024.10.22 00:13:12.519269 [ 468 ] {} DiskObjectStorage(local_disk_3): Shutting down disk local_disk_3 2024.10.22 00:13:12.520915 [ 468 ] {} DiskObjectStorage(local_disk_3): Disk local_disk_3 shut down 2024.10.22 00:13:12.522323 [ 468 ] {} Context: Shutdown disk local_disk 2024.10.22 00:13:12.534617 [ 468 ] {} DiskObjectStorage(Local): Shutting down disk local_disk 2024.10.22 00:13:12.536303 [ 468 ] {} DiskObjectStorage(Local): Disk local_disk shut down 2024.10.22 00:13:12.539022 [ 468 ] {} Context: Shutdown disk local_disk_2 2024.10.22 00:13:12.540339 [ 468 ] {} DiskObjectStorage(Local): Shutting down disk local_disk_2 2024.10.22 00:13:12.644185 [ 468 ] {} DiskObjectStorage(Local): Disk local_disk_2 shut down 2024.10.22 00:13:12.645591 [ 468 ] {} Context: Shutdown disk local_disk_3 2024.10.22 00:13:12.647954 [ 468 ] {} DiskObjectStorage(Local): Shutting down disk local_disk_3 2024.10.22 00:13:12.649400 [ 468 ] {} DiskObjectStorage(Local): Disk local_disk_3 shut down 2024.10.22 00:13:12.751500 [ 468 ] {} Context: Shutdown disk s3_cache 2024.10.22 00:13:12.752535 [ 468 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2024.10.22 00:13:12.754312 [ 468 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2024.10.22 00:13:12.755376 [ 468 ] {} Context: Shutdown disk s3_cache_multi 2024.10.22 00:13:12.756312 [ 468 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2024.10.22 00:13:12.757272 [ 468 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2024.10.22 00:13:12.758320 [ 468 ] {} Context: Shutdown disk s3_cache_multi_2 2024.10.22 00:13:12.758833 [ 468 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2024.10.22 00:13:12.759613 [ 468 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2024.10.22 00:13:12.760200 [ 468 ] {} Context: Shutdown disk s3_disk 2024.10.22 00:13:12.760662 [ 468 ] {} DiskObjectStorage(DiskS3): Shutting down disk s3_disk 2024.10.22 00:13:12.761551 [ 468 ] {} DiskObjectStorage(DiskS3): Disk s3_disk shut down 2024.10.22 00:13:12.762814 [ 468 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2024.10.22 00:13:12.794972 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 145 entries to flush up to offset 800 2024.10.22 00:13:12.882496 [ 468 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2024.10.22 00:13:12.885338 [ 468 ] {} Context: Shutting down dictionaries loader 2024.10.22 00:13:12.889800 [ 468 ] {} Context: Shutting down UDFs loader 2024.10.22 00:13:12.895136 [ 468 ] {} Context: Shutting down another UDFs loader 2024.10.22 00:13:12.895897 [ 468 ] {} Context: Shutting down named sessions 2024.10.22 00:13:12.897405 [ 468 ] {} Context: Shutting down system logs 2024.10.22 00:13:12.899477 [ 890 ] {} SystemLog (system.query_log): Flushing system log, 2 entries to flush up to offset 8 2024.10.22 00:13:13.024016 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:13.027568 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:13.172723 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_12_12_0 (state Temporary) 2024.10.22 00:13:13.217325 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_12_12_0 to 202410_12_12_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:13.360844 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 800 2024.10.22 00:13:13.622519 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:13.624708 [ 890 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:13.820953 [ 890 ] {} MergedBlockOutputStream: filled checksums 202410_4_4_0 (state Temporary) 2024.10.22 00:13:13.876110 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:13:13.877410 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:13:13.915620 [ 890 ] {} system.query_log (3c89ec5e-dff4-4fa3-aa5c-2c2b424d63ef): Renaming temporary part tmp_insert_202410_4_4_0 to 202410_4_4_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:14.085696 [ 893 ] {} SystemLog (system.trace_log): Flushing system log, 53 entries to flush up to offset 104 2024.10.22 00:13:14.116823 [ 890 ] {} SystemLog (system.query_log): Flushed system log up to offset 8 2024.10.22 00:13:14.118071 [ 890 ] {} SystemLog (system.query_log): Terminating 2024.10.22 00:13:14.164636 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:14.168038 [ 893 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:14.230690 [ 891 ] {} SystemLog (system.query_thread_log): Terminating 2024.10.22 00:13:14.260656 [ 892 ] {} SystemLog (system.part_log): Terminating 2024.10.22 00:13:14.293326 [ 893 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 00:13:14.431674 [ 893 ] {} system.trace_log (b1d331ed-9402-47f3-92ba-69560d00c0ac): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:14.474967 [ 893 ] {} SystemLog (system.trace_log): Flushed system log up to offset 104 2024.10.22 00:13:14.480540 [ 893 ] {} SystemLog (system.trace_log): Terminating 2024.10.22 00:13:14.501433 [ 894 ] {} SystemLog (system.crash_log): Terminating 2024.10.22 00:13:14.523681 [ 895 ] {} SystemLog (system.text_log): Flushing system log, 31 entries to flush up to offset 831 2024.10.22 00:13:14.616498 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 35 entries to flush up to offset 76 2024.10.22 00:13:14.690279 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:14.694635 [ 895 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:14.698426 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:14.701141 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:14.728748 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_7_7_0 (state Temporary) 2024.10.22 00:13:14.762451 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_7_7_0 to 202410_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:14.784265 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 76 2024.10.22 00:13:14.829362 [ 895 ] {} MergedBlockOutputStream: filled checksums 202410_13_13_0 (state Temporary) 2024.10.22 00:13:14.872209 [ 895 ] {} system.text_log (ffa745eb-8a28-47e2-b73e-5e0c8034f61b): Renaming temporary part tmp_insert_202410_13_13_0 to 202410_13_13_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:15.011412 [ 895 ] {} SystemLog (system.text_log): Flushed system log up to offset 831 2024.10.22 00:13:15.012786 [ 895 ] {} SystemLog (system.text_log): Terminating 2024.10.22 00:13:15.215730 [ 608 ] {} BackgroundJobsAssignee:DataProcessing: Execution took 223 ms. 2024.10.22 00:13:16.219502 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1152 entries to flush up to offset 13590 2024.10.22 00:13:16.682087 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:16.682941 [ 897 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:16.723175 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 32 2024.10.22 00:13:16.934053 [ 897 ] {} MergedBlockOutputStream: filled checksums 202410_7_7_0 (state Temporary) 2024.10.22 00:13:16.934673 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:16.938079 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:16.988759 [ 897 ] {} system.asynchronous_metric_log (77c672cd-125d-412b-9cb8-29507f0d4ac1): Renaming temporary part tmp_insert_202410_7_7_0 to 202410_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:17.025082 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 13590 2024.10.22 00:13:17.300720 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_6_6_0 (state Temporary) 2024.10.22 00:13:17.368506 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_6_6_0 to 202410_6_6_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:17.388739 [ 613 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e) (MergerMutator): Selected 6 parts from 202410_1_1_0 to 202410_6_6_0 2024.10.22 00:13:17.400158 [ 613 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:17.402502 [ 613 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:17.428617 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 32 2024.10.22 00:13:17.533416 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_1_0 to 202410_6_6_0 into Compact with storage Full 2024.10.22 00:13:17.570668 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:13:17.575342 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_1_0, total 18 rows starting from the beginning of the part 2024.10.22 00:13:17.785841 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_2_2_0, total 10 rows starting from the beginning of the part 2024.10.22 00:13:17.902279 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_3_3_0, total 1 rows starting from the beginning of the part 2024.10.22 00:13:17.918665 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_4_4_0, total 1 rows starting from the beginning of the part 2024.10.22 00:13:17.930921 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_5_5_0, total 1 rows starting from the beginning of the part 2024.10.22 00:13:17.953687 [ 820 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTreeSequentialSource: Reading 2 marks from part 202410_6_6_0, total 1 rows starting from the beginning of the part 2024.10.22 00:13:18.620686 [ 852 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): /var/lib/clickhouse/store/4de/4de457e0-9d34-4a1d-91af-81e270dc2c3e/tmp_merge_202410_1_6_1/ is in use (by merge/mutation/INSERT) (consider increasing temporary_directories_lifetime setting) 2024.10.22 00:13:19.016508 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:19.018685 [ 896 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:19.167034 [ 829 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergeTask::MergeProjectionsStage: Merge sorted 32 rows, containing 32 columns (32 merged, 0 gathered) in 1.650381022 sec., 19.389461932385213 rows/sec., 3.43 KiB/sec. 2024.10.22 00:13:19.308271 [ 817 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} MergedBlockOutputStream: filled checksums 202410_1_6_1 (state Temporary) 2024.10.22 00:13:19.417380 [ 818 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_merge_202410_1_6_1 to 202410_1_6_1 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:19.420251 [ 818 ] {4de457e0-9d34-4a1d-91af-81e270dc2c3e::202410_1_6_1} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e) (MergerMutator): Merged 6 parts: [202410_1_1_0, 202410_6_6_0] -> 202410_1_6_1 2024.10.22 00:13:19.458208 [ 818 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.26 MiB. 2024.10.22 00:13:22.297821 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 11 entries to flush up to offset 87 2024.10.22 00:13:22.369697 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:22.371149 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:22.387797 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_8_8_0 (state Temporary) 2024.10.22 00:13:22.418933 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_8_8_0 to 202410_8_8_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:22.536802 [ 896 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:13:22.760266 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 87 2024.10.22 00:13:23.875087 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:13:23.876376 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:13:24.460157 [ 851 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): /var/lib/clickhouse/store/92e/92e05502-7cd1-42a9-b81b-a85674c93a09/tmp_insert_202410_2_2_0/ is in use (by merge/mutation/INSERT) (consider increasing temporary_directories_lifetime setting) (skipped 1 similar messages) 2024.10.22 00:13:24.935284 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 33 2024.10.22 00:13:25.459692 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:25.462316 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:25.712700 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_7_7_0 (state Temporary) 2024.10.22 00:13:25.877472 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_7_7_0 to 202410_7_7_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:25.950141 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 33 2024.10.22 00:13:29.649424 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:30.261721 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 3 entries to flush up to offset 90 2024.10.22 00:13:30.628864 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:30.631174 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:30.856017 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_9_9_0 (state Temporary) 2024.10.22 00:13:31.101346 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_9_9_0 to 202410_9_9_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:31.145508 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 90 2024.10.22 00:13:31.682374 [ 896 ] {} SystemLog (system.metric_log): Flushed system log up to offset 50 2024.10.22 00:13:31.698519 [ 896 ] {} SystemLog (system.metric_log): Flushing system log, 12 entries to flush up to offset 62 2024.10.22 00:13:33.876094 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:13:33.877828 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:13:38.647703 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 1 entries to flush up to offset 91 2024.10.22 00:13:38.680384 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:38.681769 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:38.799941 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_10_10_0 (state Temporary) 2024.10.22 00:13:38.825326 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_10_10_0 to 202410_10_10_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:38.848535 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 91 2024.10.22 00:13:40.952594 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 34 2024.10.22 00:13:41.076013 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:41.078162 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:41.120222 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_8_8_0 (state Temporary) 2024.10.22 00:13:41.214571 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_8_8_0 to 202410_8_8_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:41.268281 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 34 2024.10.22 00:13:43.876143 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:13:43.877363 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:13:44.670412 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:44.672077 [ 896 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:46.350908 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 2 entries to flush up to offset 93 2024.10.22 00:13:46.424682 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:46.431230 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:46.572414 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_11_11_0 (state Temporary) 2024.10.22 00:13:46.715859 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_11_11_0 to 202410_11_11_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:46.758673 [ 592 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8) (MergerMutator): Selected 6 parts from 202410_1_6_1 to 202410_11_11_0 2024.10.22 00:13:46.766913 [ 592 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:46.768111 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 93 2024.10.22 00:13:46.769546 [ 592 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:46.780204 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTask::PrepareStage: Merging 6 parts: from 202410_1_6_1 to 202410_11_11_0 into Compact with storage Full 2024.10.22 00:13:46.796308 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2024.10.22 00:13:46.913622 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_1_6_1, total 41 rows starting from the beginning of the part 2024.10.22 00:13:46.927311 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_7_7_0, total 35 rows starting from the beginning of the part 2024.10.22 00:13:47.042568 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_8_8_0, total 11 rows starting from the beginning of the part 2024.10.22 00:13:47.053468 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_9_9_0, total 3 rows starting from the beginning of the part 2024.10.22 00:13:47.072211 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_10_10_0, total 1 rows starting from the beginning of the part 2024.10.22 00:13:47.082525 [ 822 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTreeSequentialSource: Reading 2 marks from part 202410_11_11_0, total 2 rows starting from the beginning of the part 2024.10.22 00:13:47.154081 [ 896 ] {} MergedBlockOutputStream: filled checksums 202410_3_3_0 (state Temporary) 2024.10.22 00:13:47.713727 [ 823 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergeTask::MergeProjectionsStage: Merge sorted 93 rows, containing 12 columns (12 merged, 0 gathered) in 0.938982808 sec., 99.04334691503745 rows/sec., 14.67 KiB/sec. 2024.10.22 00:13:47.748082 [ 832 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} MergedBlockOutputStream: filled checksums 202410_1_11_2 (state Temporary) 2024.10.22 00:13:48.096780 [ 818 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_merge_202410_1_11_2 to 202410_1_11_2 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:48.099562 [ 818 ] {5276570e-a364-404e-a403-3e186cba01a8::202410_1_11_2} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8) (MergerMutator): Merged 6 parts: [202410_1_6_1, 202410_11_11_0] -> 202410_1_11_2 2024.10.22 00:13:48.143563 [ 818 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 5.20 MiB. 2024.10.22 00:13:48.770623 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 35 2024.10.22 00:13:49.007887 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:49.013367 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:49.186166 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_9_9_0 (state Temporary) 2024.10.22 00:13:49.575048 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_9_9_0 to 202410_9_9_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:49.962447 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 35 2024.10.22 00:13:53.877929 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:13:53.879943 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:13:54.270631 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 9 entries to flush up to offset 102 2024.10.22 00:13:54.874210 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:54.876751 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:54.904505 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_12_12_0 (state Temporary) 2024.10.22 00:13:55.159688 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_12_12_0 to 202410_12_12_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:55.228233 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 102 2024.10.22 00:13:56.154092 [ 896 ] {} system.metric_log (92e05502-7cd1-42a9-b81b-a85674c93a09): Renaming temporary part tmp_insert_202410_3_3_0 to 202410_3_3_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:57.465161 [ 900 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1 entries to flush up to offset 36 2024.10.22 00:13:57.646211 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:57.649299 [ 900 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:57.691477 [ 900 ] {} MergedBlockOutputStream: filled checksums 202410_10_10_0 (state Temporary) 2024.10.22 00:13:57.743233 [ 900 ] {} system.zookeeper_log (4de457e0-9d34-4a1d-91af-81e270dc2c3e): Renaming temporary part tmp_insert_202410_10_10_0 to 202410_10_10_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:57.770272 [ 900 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 36 2024.10.22 00:13:58.433128 [ 896 ] {} SystemLog (system.metric_log): Flushed system log up to offset 62 2024.10.22 00:13:58.434139 [ 896 ] {} SystemLog (system.metric_log): Terminating 2024.10.22 00:13:58.443645 [ 897 ] {} SystemLog (system.asynchronous_metric_log): Terminating 2024.10.22 00:13:58.452053 [ 898 ] {} SystemLog (system.opentelemetry_span_log): Terminating 2024.10.22 00:13:58.470404 [ 899 ] {} SystemLog (system.query_views_log): Terminating 2024.10.22 00:13:58.487888 [ 900 ] {} SystemLog (system.zookeeper_log): Terminating 2024.10.22 00:13:58.500506 [ 901 ] {} SystemLog (system.session_log): Flushing system log, 6 entries to flush up to offset 8 2024.10.22 00:13:58.637604 [ 901 ] {} system.session_log (ed97c24a-3021-4d92-aee2-1ef2de3fa803): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:58.639437 [ 901 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:58.876048 [ 901 ] {} MergedBlockOutputStream: filled checksums 202410_2_2_0 (state Temporary) 2024.10.22 00:13:59.014832 [ 901 ] {} system.session_log (ed97c24a-3021-4d92-aee2-1ef2de3fa803): Renaming temporary part tmp_insert_202410_2_2_0 to 202410_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:59.150692 [ 901 ] {} SystemLog (system.session_log): Flushed system log up to offset 8 2024.10.22 00:13:59.151741 [ 901 ] {} SystemLog (system.session_log): Terminating 2024.10.22 00:13:59.160122 [ 902 ] {} SystemLog (system.transactions_info_log): Flushing system log, 4 entries to flush up to offset 106 2024.10.22 00:13:59.722618 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2024.10.22 00:13:59.724836 [ 902 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 299.94 GiB. 2024.10.22 00:13:59.849723 [ 902 ] {} MergedBlockOutputStream: filled checksums 202410_13_13_0 (state Temporary) 2024.10.22 00:13:59.888807 [ 902 ] {} system.transactions_info_log (5276570e-a364-404e-a403-3e186cba01a8): Renaming temporary part tmp_insert_202410_13_13_0 to 202410_13_13_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2024.10.22 00:13:59.920660 [ 902 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 106 2024.10.22 00:13:59.921841 [ 902 ] {} SystemLog (system.transactions_info_log): Terminating 2024.10.22 00:13:59.944498 [ 903 ] {} SystemLog (system.processors_profile_log): Terminating 2024.10.22 00:13:59.962341 [ 904 ] {} SystemLog (system.filesystem_cache_log): Terminating 2024.10.22 00:14:00.081401 [ 906 ] {} SystemLog (system.asynchronous_insert_log): Terminating 2024.10.22 00:14:00.088490 [ 468 ] {} Context: Shutting down database catalog 2024.10.22 00:14:00.102770 [ 468 ] {} DatabaseCatalog: Shutting down database INFORMATION_SCHEMA 2024.10.22 00:14:00.242656 [ 468 ] {} DatabaseCatalog: Shutting down database datasets 2024.10.22 00:14:00.890824 [ 468 ] {} DatabaseCatalog: Shutting down database default 2024.10.22 00:14:00.894903 [ 468 ] {} DatabaseCatalog: Shutting down database information_schema 2024.10.22 00:14:00.958745 [ 468 ] {} DatabaseCatalog: Shutting down database test 2024.10.22 00:14:00.960216 [ 468 ] {} DatabaseCatalog: Shutting down system databases 2024.10.22 00:14:03.879949 [ 474 ] {} KeeperTCPHandler: Received heartbeat for session #2 2024.10.22 00:14:03.883188 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:14:05.772445 [ 468 ] {} Context: Shutting down merges executor 2024.10.22 00:14:05.778601 [ 468 ] {} Context: Shutting down fetches executor 2024.10.22 00:14:05.785022 [ 468 ] {} Context: Shutting down moves executor 2024.10.22 00:14:05.789254 [ 468 ] {} Context: Shutting down common executor 2024.10.22 00:14:05.793360 [ 468 ] {} Context: Shutting down DDLWorker 2024.10.22 00:14:05.902929 [ 468 ] {} Context: Shutting down caches 2024.10.22 00:14:05.955292 [ 468 ] {} Context: Shutting down AccessControl 2024.10.22 00:14:06.396888 [ 468 ] {} ExternalUserDefinedExecutableFunctionsLoader: Unloading 'test_function' because its configuration has been removed or detached 2024.10.22 00:14:06.407292 [ 468 ] {} ZooKeeperClient: Finalizing session 2. finalization_started: false, queue_finished: false, reason: 'Destructor called' 2024.10.22 00:14:06.410534 [ 474 ] {} KeeperTCPHandler: Received close event with xid 2147483647 for session id #2 2024.10.22 00:14:06.412004 [ 757 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2024.10.22 00:14:06.551817 [ 474 ] {} KeeperTCPHandler: Session #2 successfully closed 2024.10.22 00:14:06.746832 [ 468 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2024.10.22 00:14:06.765706 [ 468 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2024.10.22 00:14:06.958315 [ 468 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2024.10.22 00:14:06.985402 [ 468 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2024.10.22 00:14:07.029501 [ 468 ] {} Application: Shut down storages. 2024.10.22 00:14:07.031477 [ 468 ] {} Application: Waiting for current connections to servers for tables to finish. 2024.10.22 00:14:07.508342 [ 468 ] {} Application: Closed all listening sockets. 2024.10.22 00:14:07.510677 [ 468 ] {} Application: Closed connections to servers for tables. 2024.10.22 00:14:07.511679 [ 468 ] {} KeeperDispatcher: Shutting down storage dispatcher 2024.10.22 00:14:07.556953 [ 468 ] {} RaftInstance: shutting down raft core 2024.10.22 00:14:07.558640 [ 468 ] {} RaftInstance: sent stop signal to the commit thread. 2024.10.22 00:14:07.559479 [ 468 ] {} RaftInstance: cancelled all schedulers. 2024.10.22 00:14:07.560139 [ 468 ] {} RaftInstance: commit thread stopped. 2024.10.22 00:14:07.561388 [ 468 ] {} RaftInstance: all pending commit elements dropped. 2024.10.22 00:14:07.562604 [ 468 ] {} RaftInstance: reset all pointers. 2024.10.22 00:14:07.711841 [ 468 ] {} RaftInstance: joined terminated commit thread. 2024.10.22 00:14:07.713998 [ 468 ] {} RaftInstance: sent stop signal to background append thread. 2024.10.22 00:14:07.714043 [ 803 ] {} RaftInstance: bg append_entries thread terminated 2024.10.22 00:14:07.758789 [ 468 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2024.10.22 00:14:07.760788 [ 468 ] {} RaftInstance: clean up auto-forwarding clients 2024.10.22 00:14:07.772763 [ 468 ] {} RaftInstance: raft_server shutdown completed. 2024.10.22 00:14:07.774005 [ 468 ] {} RaftInstance: manually create a snapshot on 22 2024.10.22 00:14:07.776820 [ 468 ] {} RaftInstance: creating a snapshot for index 22 2024.10.22 00:14:07.778501 [ 468 ] {} RaftInstance: create snapshot idx 22 log_term 1 2024.10.22 00:14:07.780117 [ 468 ] {} KeeperStateMachine: Creating snapshot 22 2024.10.22 00:14:07.783832 [ 468 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2024.10.22 00:14:07.797738 [ 468 ] {} KeeperStateMachine: Created persistent snapshot 22 with path snapshot_22.bin.zstd 2024.10.22 00:14:07.801718 [ 468 ] {} KeeperStateMachine: Clearing garbage after snapshot 2024.10.22 00:14:07.803589 [ 468 ] {} KeeperStateMachine: Cleared garbage after snapshot 2024.10.22 00:14:07.805096 [ 468 ] {} RaftInstance: snapshot idx 22 log_term 1 created, compact the log store if needed 2024.10.22 00:14:07.809231 [ 468 ] {} KeeperStateMachine: Uploading snapshot snapshot_22.bin.zstd during shutdown because 'upload_snapshot_on_exit' is enabled. 2024.10.22 00:14:07.812357 [ 468 ] {} RaftInstance: create snapshot idx 22 log_term 1 done: 31902 us elapsed 2024.10.22 00:14:07.830270 [ 794 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2024.10.22 00:14:07.843103 [ 786 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2024.10.22 00:14:07.852673 [ 789 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2024.10.22 00:14:07.854883 [ 799 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2024.10.22 00:14:07.856397 [ 791 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2024.10.22 00:14:07.856774 [ 800 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2024.10.22 00:14:07.857648 [ 792 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2024.10.22 00:14:07.859706 [ 797 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2024.10.22 00:14:07.861182 [ 801 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2024.10.22 00:14:07.863711 [ 786 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2024.10.22 00:14:07.865147 [ 795 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2024.10.22 00:14:07.856901 [ 793 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2024.10.22 00:14:07.959318 [ 790 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2024.10.22 00:14:07.960000 [ 798 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2024.10.22 00:14:07.971168 [ 796 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2024.10.22 00:14:08.006438 [ 788 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2024.10.22 00:14:08.008981 [ 787 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2024.10.22 00:14:08.270497 [ 785 ] {} KeeperLogStore: Raft server is not set in LogStore. 2024.10.22 00:14:08.276526 [ 468 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2024.10.22 00:14:08.279863 [ 468 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2024.10.22 00:14:08.282201 [ 468 ] {} KeeperDispatcher: Dispatcher shut down 2024.10.22 00:14:08.284564 [ 468 ] {} Context: Destructing remote fs threadpool reader 2024.10.22 00:14:08.287630 [ 468 ] {} Context: Destructing threadpool writer 2024.10.22 00:14:08.293812 [ 468 ] {} Context: Destructing marks loader 2024.10.22 00:14:10.734934 [ 468 ] {} Application: Destroyed global context. 2024.10.22 00:14:10.768660 [ 468 ] {} KeeperLogStore: Changelog is shut down 2024.10.22 00:14:12.968722 [ 468 ] {} Application: shutting down 2024.10.22 00:14:12.969298 [ 468 ] {} Application: Uninitializing subsystem: Logging Subsystem 2024.10.22 00:14:13.075846 [ 469 ] {} BaseDaemon: Received signal -2 2024.10.22 00:14:13.091913 [ 469 ] {} BaseDaemon: Stop SignalListener thread 2024.10.22 00:14:16.127283 [ 466 ] {} Application: Child process exited normally with code 0.