2025.06.18 08:40:08.924316 [ 65989 ] {} Application: Will watch for the process with pid 65992 2025.06.18 08:40:08.924585 [ 65992 ] {} Application: Forked a child process to watch 2025.06.18 08:40:08.925199 [ 65992 ] {} StatusFile: Status file /var/run/clickhouse-server/clickhouse-server.pid already exists - unclean restart. Contents: 2643 2025.06.18 08:40:08.926041 [ 65992 ] {} SentryWriter: Sending crash reports is disabled 2025.06.18 08:40:09.380896 [ 65992 ] {} Application: Starting ClickHouse 24.8.14.10063.altinitytest (revision: 4294967295, git hash: 24f827ee7dd261554ab6028af35dcf9b8318ca50, build id: 3302FFCB7466FD129D232FB123B30A2ADA56BF42), PID 65992 2025.06.18 08:40:09.381865 [ 65992 ] {} Application: starting up 2025.06.18 08:40:09.381968 [ 65992 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.06.18 08:40:09.414872 [ 65992 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.06.18 08:40:09.415137 [ 65992 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.06.18 08:40:09.415203 [ 65992 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.06.18 08:40:09.415233 [ 65992 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.06.18 08:40:09.415259 [ 65992 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.06.18 08:40:09.416823 [ 65992 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.06.18 08:40:09.416870 [ 65992 ] {} AsynchronousMetrics: Scanning /sys/block 2025.06.18 08:40:09.417060 [ 65992 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.06.18 08:40:09.417107 [ 65992 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.06.18 08:40:09.417308 [ 65992 ] {} StatusFile: Status file /var/lib/clickhouse/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:27 Revision: 4294967295 2025.06.18 08:40:09.454081 [ 65992 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.06.18 08:40:09.455510 [ 65992 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.06.18 08:40:09.456608 [ 65992 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.06.18 08:40:10.200230 [ 65992 ] {} Application: Integrity check of the executable successfully passed (checksum: 19939316FB49C543A2831DD4F0B2BC96) 2025.06.18 08:40:10.202192 [ 65992 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.06.18 08:40:10.202275 [ 65992 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 418.57 MiB 2025.06.18 08:40:10.202685 [ 65992 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.06.18 08:40:10.202723 [ 65992 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.06.18 08:40:10.202765 [ 65992 ] {} Application: Initializing DateLUT. 2025.06.18 08:40:10.202802 [ 65992 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.06.18 08:40:10.203018 [ 65992 ] {} Context: Setting up /var/lib/clickhouse/tmp/ to store temporary data in it 2025.06.18 08:40:10.203410 [ 65992 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.06.18 08:40:10.215974 [ 65992 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.06.18 08:40:10.216054 [ 65992 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.06.18 08:40:10.216385 [ 65992 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.06.18 08:40:10.216797 [ 65992 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'ed9ac44a8c3c' as replica host. 2025.06.18 08:40:10.216874 [ 65992 ] {} Application: Initializing interserver credentials. 2025.06.18 08:40:10.217696 [ 65992 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.06.18 08:40:10.222950 [ 65992 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.06.18 08:40:10.223008 [ 65992 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.06.18 08:40:10.223399 [ 65992 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.06.18 08:40:10.223665 [ 65992 ] {} CgroupsMemoryUsageObserver: Will read the current memory usage from '/sys/fs/cgroup/' (cgroups version: v2), wait time is 15 sec 2025.06.18 08:40:10.234812 [ 65992 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.06.18 08:40:10.234867 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.06.18 08:40:10.241860 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/CORS.xml'. 2025.06.18 08:40:10.242472 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.06.18 08:40:10.243405 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.06.18 08:40:10.243773 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.06.18 08:40:10.244206 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.06.18 08:40:10.244631 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/block_number.xml'. 2025.06.18 08:40:10.244983 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.06.18 08:40:10.245300 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.06.18 08:40:10.249669 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.06.18 08:40:10.250081 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.06.18 08:40:10.250463 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.06.18 08:40:10.250793 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.06.18 08:40:10.251141 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.06.18 08:40:10.251577 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.06.18 08:40:10.251905 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.06.18 08:40:10.252247 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.06.18 08:40:10.252570 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.06.18 08:40:10.253113 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.06.18 08:40:10.253466 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.06.18 08:40:10.253885 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.06.18 08:40:10.254272 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.06.18 08:40:10.254709 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.06.18 08:40:10.255080 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.06.18 08:40:10.255461 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.06.18 08:40:10.255849 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.06.18 08:40:10.256527 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.06.18 08:40:10.257556 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.06.18 08:40:10.257948 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.06.18 08:40:10.258880 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.06.18 08:40:10.259901 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.06.18 08:40:10.260295 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.06.18 08:40:10.260658 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.06.18 08:40:10.261026 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.06.18 08:40:10.261401 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.06.18 08:40:10.261796 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.06.18 08:40:10.262294 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.06.18 08:40:10.262690 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.06.18 08:40:10.263195 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.06.18 08:40:10.263609 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.06.18 08:40:10.264102 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.06.18 08:40:10.264624 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.06.18 08:40:10.265066 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.06.18 08:40:10.266203 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.06.18 08:40:10.266823 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.06.18 08:40:10.267226 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.06.18 08:40:10.267670 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.06.18 08:40:10.268108 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.06.18 08:40:10.268528 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.06.18 08:40:10.269065 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.06.18 08:40:10.269488 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.06.18 08:40:10.269991 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.06.18 08:40:10.270487 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.06.18 08:40:10.273085 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.06.18 08:40:10.273966 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.06.18 08:40:10.274939 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.06.18 08:40:10.275568 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.06.18 08:40:10.275988 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.06.18 08:40:10.276378 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.06.18 08:40:10.277067 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.06.18 08:40:10.277528 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.06.18 08:40:10.277993 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.06.18 08:40:10.278469 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.06.18 08:40:10.279152 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.06.18 08:40:10.279578 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.06.18 08:40:10.280104 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.06.18 08:40:10.280764 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.06.18 08:40:10.281261 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.06.18 08:40:10.327392 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.06.18 08:40:10.328752 [ 65992 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.06.18 08:40:10.357203 [ 65992 ] {} Application: Setting max_server_memory_usage was set to 15.30 GiB (30.60 GiB available * 0.50 max_server_memory_usage_to_ram_ratio) 2025.06.18 08:40:10.357283 [ 65992 ] {} CgroupsMemoryUsageObserver: Set new limits, soft limit: 13.77 GiB, hard limit: 14.54 GiB 2025.06.18 08:40:10.357335 [ 65992 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.06.18 08:40:10.357368 [ 65992 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.06.18 08:40:10.371215 [ 65992 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.06.18 08:40:10.376996 [ 65992 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.06.18 08:40:10.553243 [ 65992 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.06.18 08:40:10.559643 [ 65992 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.06.18 08:40:10.576704 [ 65992 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.06.18 08:40:10.577230 [ 65992 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.06.18 08:40:10.577407 [ 65992 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.06.18 08:40:10.580659 [ 65992 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.06.18 08:40:10.581495 [ 65992 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.06.18 08:40:10.581915 [ 65992 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.06.18 08:40:10.583386 [ 65992 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.06.18 08:40:10.583488 [ 65992 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.06.18 08:40:10.585587 [ 65992 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: disabled 2025.06.18 08:40:10.585649 [ 65992 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.06.18 08:40:10.585689 [ 65992 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.06.18 08:40:10.585759 [ 65992 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.06.18 08:40:10.586029 [ 65992 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.06.18 08:40:10.586133 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.660599 [ 65992 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:10.660663 [ 65992 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:10.661074 [ 65992 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor 2025.06.18 08:40:10.661298 [ 65992 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor. 2025.06.18 08:40:10.661342 [ 65992 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor 2025.06.18 08:40:10.661380 [ 65992 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor, size 4 2025.06.18 08:40:10.661953 [ 66574 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor 2025.06.18 08:40:10.668142 [ 66574 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor, size 4 2025.06.18 08:40:10.668536 [ 65992 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/fgt/kqwgnsragghrphmduvuqffmgpvpor. 2025.06.18 08:40:10.672335 [ 65992 ] {} S3ObjectStorage: Objects with paths [s3/fgt/kqwgnsragghrphmduvuqffmgpvpor] were removed from S3 2025.06.18 08:40:10.672888 [ 65992 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:10.679585 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zrl/zfffvkzeomwccyylfxaepnkuzvmzn (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.682431 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zrl/zfffvkzeomwccyylfxaepnkuzvmzn (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.682502 [ 65992 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/zrl/zfffvkzeomwccyylfxaepnkuzvmzn, Version: Latest, Offset: 2 2025.06.18 08:40:10.687743 [ 65992 ] {} S3ObjectStorage: Objects with paths [s3/zrl/zfffvkzeomwccyylfxaepnkuzvmzn] were removed from S3 2025.06.18 08:40:10.687802 [ 65992 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.06.18 08:40:10.687839 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.06.18 08:40:10.699759 [ 65992 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:10.699811 [ 65992 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:10.709199 [ 65992 ] {} S3ObjectStorage: Objects with paths [s3_plain/clickhouse_remove_objects_capability_853c0f67-c27f-4a36-9d7b-b6985f8ffd25] were removed from S3 2025.06.18 08:40:10.709496 [ 65992 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:10.717494 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.722025 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.722094 [ 65992 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25, Version: Latest, Offset: 2 2025.06.18 08:40:10.735085 [ 65992 ] {} S3ObjectStorage: Objects with paths [s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25] were removed from S3 2025.06.18 08:40:10.735141 [ 65992 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.06.18 08:40:10.735179 [ 65992 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.06.18 08:40:10.735264 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.735329 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.735384 [ 65992 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.06.18 08:40:10.735434 [ 65992 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.06.18 08:40:10.735482 [ 65992 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.06.18 08:40:10.735540 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.735604 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.735652 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.735699 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.735745 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.747206 [ 65992 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:10.747257 [ 65992 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:10.756170 [ 65992 ] {} S3ObjectStorage: Objects with paths [special/eat/ggvsboskozrmbgjdvbnhwarniqliq] were removed from S3 2025.06.18 08:40:10.756562 [ 65992 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:10.762644 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/kdl/cumoxbgfqsxxmszjucaztvbstfwmc (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.765337 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/kdl/cumoxbgfqsxxmszjucaztvbstfwmc (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.765398 [ 65992 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/kdl/cumoxbgfqsxxmszjucaztvbstfwmc, Version: Latest, Offset: 2 2025.06.18 08:40:10.770139 [ 65992 ] {} S3ObjectStorage: Objects with paths [special/kdl/cumoxbgfqsxxmszjucaztvbstfwmc] were removed from S3 2025.06.18 08:40:10.770191 [ 65992 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.06.18 08:40:10.770234 [ 65992 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.06.18 08:40:10.781437 [ 65992 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:10.781479 [ 65992 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:10.789436 [ 65992 ] {} S3ObjectStorage: Objects with paths [test_02944/ojb/oqdfmzxvnsvbkosdccuqxqyeqkgoh] were removed from S3 2025.06.18 08:40:10.789830 [ 65992 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:10.795349 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/fer/gbgdxfptcqfaconviujpxjotkaqmg (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.797512 [ 65992 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/fer/gbgdxfptcqfaconviujpxjotkaqmg (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:10.797581 [ 65992 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/fer/gbgdxfptcqfaconviujpxjotkaqmg, Version: Latest, Offset: 2 2025.06.18 08:40:10.802953 [ 65992 ] {} S3ObjectStorage: Objects with paths [test_02944/fer/gbgdxfptcqfaconviujpxjotkaqmg] were removed from S3 2025.06.18 08:40:10.803012 [ 65992 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.06.18 08:40:10.803045 [ 65992 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.06.18 08:40:10.803116 [ 65992 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.06.18 08:40:10.805464 [ 65992 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.06.18 08:40:10.807961 [ 65992 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.06.18 08:40:10.808055 [ 65992 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.06.18 08:40:10.809221 [ 65992 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.06.18 08:40:10.809385 [ 65992 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.06.18 08:40:10.810322 [ 65992 ] {} KeeperLogStore: force_sync disabled 2025.06.18 08:40:10.810381 [ 65992 ] {} KeeperDispatcher: Waiting server to initialize 2025.06.18 08:40:10.810462 [ 65992 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.06.18 08:40:10.810513 [ 65992 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.06.18 08:40:10.810554 [ 65992 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.06.18 08:40:10.876975 [ 65992 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 9171 entries 2025.06.18 08:40:10.877149 [ 65992 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.06.18 08:40:10.877267 [ 65992 ] {} KeeperServer: Last local log idx 9171 2025.06.18 08:40:10.877318 [ 65992 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 35 2025.06.18 08:40:10.878271 [ 65992 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.06.18 08:40:10.887809 [ 65992 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.06.18 08:40:10.887957 [ 65992 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.06.18 08:40:10.888036 [ 65992 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.06.18 08:40:10.888085 [ 65992 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.06.18 08:40:10.888145 [ 65992 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.06.18 08:40:10.888183 [ 65992 ] {} RaftInstance: new election timeout range: 0 - 0 2025.06.18 08:40:10.888258 [ 65992 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 3 election timer allowed log store start 1, end 9171 config log idx 35, prev log idx 10 -- ASYNC REPLICATION -- 2025.06.18 08:40:10.888299 [ 65992 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.06.18 08:40:10.888356 [ 65992 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.06.18 08:40:10.888409 [ 65992 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.06.18 08:40:10.889002 [ 65992 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.06.18 08:40:10.889086 [ 66605 ] {} RaftInstance: bg append_entries thread initiated 2025.06.18 08:40:10.939289 [ 66588 ] {} RaftInstance: Election timeout, initiate leader election 2025.06.18 08:40:10.939454 [ 66588 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.06.18 08:40:10.939538 [ 66588 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 3, state term 3, target p 1, my p 1, hb dead, pre-vote NOT done 2025.06.18 08:40:10.939608 [ 66588 ] {} RaftInstance: pre-vote term (0) is different, reset it to 3 2025.06.18 08:40:10.939712 [ 65992 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.06.18 08:40:10.939819 [ 66588 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.06.18 08:40:10.943281 [ 66588 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 4, log idx 9171, log term 3, priority (target 1 / mine 1) 2025.06.18 08:40:10.943345 [ 66588 ] {} RaftInstance: number of pending commit elements: 0 2025.06.18 08:40:10.943399 [ 66588 ] {} RaftInstance: state machine commit index 0, precommit index 9171, last log index 9171 2025.06.18 08:40:10.943451 [ 66588 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.06.18 08:40:10.943694 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:10.943950 [ 66588 ] {} RaftInstance: [BECOME LEADER] appended new config at 9172 2025.06.18 08:40:10.944325 [ 66604 ] {} RaftInstance: config at index 1 is committed, prev config log idx 35 2025.06.18 08:40:10.944463 [ 66604 ] {} RaftInstance: skipped config 1, latest config 35 2025.06.18 08:40:10.944801 [ 66604 ] {} KeeperStateMachine: Session ID response 1 with timeout 30000 2025.06.18 08:40:10.946645 [ 66604 ] {} RaftInstance: config at index 10 is committed, prev config log idx 35 2025.06.18 08:40:10.946727 [ 66604 ] {} RaftInstance: skipped config 10, latest config 35 2025.06.18 08:40:10.946857 [ 66604 ] {} KeeperStateMachine: Session ID response 2 with timeout 30000 2025.06.18 08:40:10.948428 [ 66604 ] {} RaftInstance: config at index 35 is committed, prev config log idx 35 2025.06.18 08:40:10.948493 [ 66604 ] {} RaftInstance: skipped config 35, latest config 35 2025.06.18 08:40:10.948658 [ 66604 ] {} KeeperStateMachine: Session ID response 3 with timeout 30000 2025.06.18 08:40:11.018652 [ 66604 ] {} KeeperStateMachine: Session ID response 4 with timeout 10000 2025.06.18 08:40:11.020525 [ 66604 ] {} KeeperStateMachine: Session ID response 5 with timeout 10000 2025.06.18 08:40:11.020630 [ 66604 ] {} KeeperStateMachine: Session ID response 6 with timeout 10000 2025.06.18 08:40:11.020707 [ 66604 ] {} KeeperStateMachine: Session ID response 7 with timeout 10000 2025.06.18 08:40:11.020817 [ 66604 ] {} KeeperStateMachine: Session ID response 8 with timeout 10000 2025.06.18 08:40:11.020897 [ 66604 ] {} KeeperStateMachine: Session ID response 9 with timeout 10000 2025.06.18 08:40:11.021112 [ 66604 ] {} KeeperStateMachine: Session ID response 10 with timeout 10000 2025.06.18 08:40:11.021188 [ 66604 ] {} KeeperStateMachine: Session ID response 11 with timeout 10000 2025.06.18 08:40:11.021258 [ 66604 ] {} KeeperStateMachine: Session ID response 12 with timeout 10000 2025.06.18 08:40:11.021349 [ 66604 ] {} KeeperStateMachine: Session ID response 13 with timeout 10000 2025.06.18 08:40:11.021420 [ 66604 ] {} KeeperStateMachine: Session ID response 14 with timeout 10000 2025.06.18 08:40:11.021615 [ 66604 ] {} KeeperStateMachine: Session ID response 15 with timeout 10000 2025.06.18 08:40:11.021689 [ 66604 ] {} KeeperStateMachine: Session ID response 16 with timeout 10000 2025.06.18 08:40:11.021759 [ 66604 ] {} KeeperStateMachine: Session ID response 17 with timeout 10000 2025.06.18 08:40:11.021864 [ 66604 ] {} KeeperStateMachine: Session ID response 18 with timeout 10000 2025.06.18 08:40:11.021938 [ 66604 ] {} KeeperStateMachine: Session ID response 19 with timeout 10000 2025.06.18 08:40:11.022143 [ 66604 ] {} KeeperStateMachine: Session ID response 20 with timeout 10000 2025.06.18 08:40:11.022218 [ 66604 ] {} KeeperStateMachine: Session ID response 21 with timeout 10000 2025.06.18 08:40:11.022313 [ 66604 ] {} KeeperStateMachine: Session ID response 22 with timeout 10000 2025.06.18 08:40:11.022414 [ 66604 ] {} KeeperStateMachine: Session ID response 23 with timeout 10000 2025.06.18 08:40:11.022486 [ 66604 ] {} KeeperStateMachine: Session ID response 24 with timeout 10000 2025.06.18 08:40:11.022586 [ 66604 ] {} KeeperStateMachine: Session ID response 25 with timeout 10000 2025.06.18 08:40:11.022658 [ 66604 ] {} KeeperStateMachine: Session ID response 26 with timeout 10000 2025.06.18 08:40:11.022728 [ 66604 ] {} KeeperStateMachine: Session ID response 27 with timeout 10000 2025.06.18 08:40:11.022809 [ 66604 ] {} KeeperStateMachine: Session ID response 28 with timeout 10000 2025.06.18 08:40:11.022879 [ 66604 ] {} KeeperStateMachine: Session ID response 29 with timeout 10000 2025.06.18 08:40:11.023067 [ 66604 ] {} KeeperStateMachine: Session ID response 30 with timeout 10000 2025.06.18 08:40:11.023149 [ 66604 ] {} KeeperStateMachine: Session ID response 31 with timeout 10000 2025.06.18 08:40:11.023220 [ 66604 ] {} KeeperStateMachine: Session ID response 32 with timeout 10000 2025.06.18 08:40:11.023312 [ 66604 ] {} KeeperStateMachine: Session ID response 33 with timeout 10000 2025.06.18 08:40:11.023383 [ 66604 ] {} KeeperStateMachine: Session ID response 34 with timeout 10000 2025.06.18 08:40:11.023512 [ 66604 ] {} KeeperStateMachine: Session ID response 35 with timeout 10000 2025.06.18 08:40:11.023596 [ 66604 ] {} KeeperStateMachine: Session ID response 36 with timeout 10000 2025.06.18 08:40:11.023689 [ 66604 ] {} KeeperStateMachine: Session ID response 37 with timeout 10000 2025.06.18 08:40:11.023797 [ 66604 ] {} KeeperStateMachine: Session ID response 38 with timeout 10000 2025.06.18 08:40:11.023870 [ 66604 ] {} KeeperStateMachine: Session ID response 39 with timeout 10000 2025.06.18 08:40:11.024023 [ 66604 ] {} KeeperStateMachine: Session ID response 40 with timeout 10000 2025.06.18 08:40:11.024098 [ 66604 ] {} KeeperStateMachine: Session ID response 41 with timeout 10000 2025.06.18 08:40:11.024168 [ 66604 ] {} KeeperStateMachine: Session ID response 42 with timeout 10000 2025.06.18 08:40:11.024269 [ 66604 ] {} KeeperStateMachine: Session ID response 43 with timeout 10000 2025.06.18 08:40:11.024340 [ 66604 ] {} KeeperStateMachine: Session ID response 44 with timeout 10000 2025.06.18 08:40:11.024472 [ 66604 ] {} KeeperStateMachine: Session ID response 45 with timeout 10000 2025.06.18 08:40:11.024557 [ 66604 ] {} KeeperStateMachine: Session ID response 46 with timeout 10000 2025.06.18 08:40:11.024631 [ 66604 ] {} KeeperStateMachine: Session ID response 47 with timeout 10000 2025.06.18 08:40:11.024710 [ 66604 ] {} KeeperStateMachine: Session ID response 48 with timeout 10000 2025.06.18 08:40:11.024780 [ 66604 ] {} KeeperStateMachine: Session ID response 49 with timeout 10000 2025.06.18 08:40:11.024965 [ 66604 ] {} KeeperStateMachine: Session ID response 50 with timeout 10000 2025.06.18 08:40:11.025039 [ 66604 ] {} KeeperStateMachine: Session ID response 51 with timeout 10000 2025.06.18 08:40:11.025119 [ 66604 ] {} KeeperStateMachine: Session ID response 52 with timeout 10000 2025.06.18 08:40:11.025190 [ 66604 ] {} KeeperStateMachine: Session ID response 53 with timeout 10000 2025.06.18 08:40:11.025284 [ 66604 ] {} KeeperStateMachine: Session ID response 54 with timeout 10000 2025.06.18 08:40:11.025475 [ 66604 ] {} KeeperStateMachine: Session ID response 55 with timeout 10000 2025.06.18 08:40:11.025557 [ 66604 ] {} KeeperStateMachine: Session ID response 56 with timeout 10000 2025.06.18 08:40:11.025636 [ 66604 ] {} KeeperStateMachine: Session ID response 57 with timeout 10000 2025.06.18 08:40:11.025729 [ 66604 ] {} KeeperStateMachine: Session ID response 58 with timeout 10000 2025.06.18 08:40:11.025801 [ 66604 ] {} KeeperStateMachine: Session ID response 59 with timeout 10000 2025.06.18 08:40:11.025949 [ 66604 ] {} KeeperStateMachine: Session ID response 60 with timeout 10000 2025.06.18 08:40:11.026037 [ 66604 ] {} KeeperStateMachine: Session ID response 61 with timeout 10000 2025.06.18 08:40:11.026117 [ 66604 ] {} KeeperStateMachine: Session ID response 62 with timeout 10000 2025.06.18 08:40:11.026189 [ 66604 ] {} KeeperStateMachine: Session ID response 63 with timeout 10000 2025.06.18 08:40:11.026265 [ 66604 ] {} KeeperStateMachine: Session ID response 64 with timeout 10000 2025.06.18 08:40:11.026471 [ 66604 ] {} KeeperStateMachine: Session ID response 65 with timeout 10000 2025.06.18 08:40:11.026555 [ 66604 ] {} KeeperStateMachine: Session ID response 66 with timeout 10000 2025.06.18 08:40:11.026639 [ 66604 ] {} KeeperStateMachine: Session ID response 67 with timeout 10000 2025.06.18 08:40:11.026719 [ 66604 ] {} KeeperStateMachine: Session ID response 68 with timeout 10000 2025.06.18 08:40:11.026791 [ 66604 ] {} KeeperStateMachine: Session ID response 69 with timeout 10000 2025.06.18 08:40:11.026976 [ 66604 ] {} KeeperStateMachine: Session ID response 70 with timeout 10000 2025.06.18 08:40:11.027053 [ 66604 ] {} KeeperStateMachine: Session ID response 71 with timeout 10000 2025.06.18 08:40:11.027133 [ 66604 ] {} KeeperStateMachine: Session ID response 72 with timeout 10000 2025.06.18 08:40:11.027206 [ 66604 ] {} KeeperStateMachine: Session ID response 73 with timeout 10000 2025.06.18 08:40:11.027285 [ 66604 ] {} KeeperStateMachine: Session ID response 74 with timeout 10000 2025.06.18 08:40:11.027416 [ 66604 ] {} KeeperStateMachine: Session ID response 75 with timeout 10000 2025.06.18 08:40:11.027493 [ 66604 ] {} KeeperStateMachine: Session ID response 76 with timeout 10000 2025.06.18 08:40:11.027586 [ 66604 ] {} KeeperStateMachine: Session ID response 77 with timeout 10000 2025.06.18 08:40:11.027659 [ 66604 ] {} KeeperStateMachine: Session ID response 78 with timeout 10000 2025.06.18 08:40:11.027732 [ 66604 ] {} KeeperStateMachine: Session ID response 79 with timeout 10000 2025.06.18 08:40:11.027916 [ 66604 ] {} KeeperStateMachine: Session ID response 80 with timeout 10000 2025.06.18 08:40:11.027992 [ 66604 ] {} KeeperStateMachine: Session ID response 81 with timeout 10000 2025.06.18 08:40:11.028071 [ 66604 ] {} KeeperStateMachine: Session ID response 82 with timeout 10000 2025.06.18 08:40:11.028145 [ 66604 ] {} KeeperStateMachine: Session ID response 83 with timeout 10000 2025.06.18 08:40:11.028221 [ 66604 ] {} KeeperStateMachine: Session ID response 84 with timeout 10000 2025.06.18 08:40:11.028355 [ 66604 ] {} KeeperStateMachine: Session ID response 85 with timeout 10000 2025.06.18 08:40:11.028431 [ 66604 ] {} KeeperStateMachine: Session ID response 86 with timeout 10000 2025.06.18 08:40:11.028514 [ 66604 ] {} KeeperStateMachine: Session ID response 87 with timeout 10000 2025.06.18 08:40:11.028600 [ 66604 ] {} KeeperStateMachine: Session ID response 88 with timeout 10000 2025.06.18 08:40:11.028674 [ 66604 ] {} KeeperStateMachine: Session ID response 89 with timeout 10000 2025.06.18 08:40:11.028862 [ 66604 ] {} KeeperStateMachine: Session ID response 90 with timeout 10000 2025.06.18 08:40:11.028939 [ 66604 ] {} KeeperStateMachine: Session ID response 91 with timeout 10000 2025.06.18 08:40:11.029041 [ 66604 ] {} KeeperStateMachine: Session ID response 92 with timeout 10000 2025.06.18 08:40:11.029145 [ 66604 ] {} KeeperStateMachine: Session ID response 93 with timeout 10000 2025.06.18 08:40:11.029221 [ 66604 ] {} KeeperStateMachine: Session ID response 94 with timeout 10000 2025.06.18 08:40:11.029429 [ 66604 ] {} KeeperStateMachine: Session ID response 95 with timeout 10000 2025.06.18 08:40:11.029506 [ 66604 ] {} KeeperStateMachine: Session ID response 96 with timeout 10000 2025.06.18 08:40:11.029597 [ 66604 ] {} KeeperStateMachine: Session ID response 97 with timeout 10000 2025.06.18 08:40:11.029671 [ 66604 ] {} KeeperStateMachine: Session ID response 98 with timeout 10000 2025.06.18 08:40:11.029744 [ 66604 ] {} KeeperStateMachine: Session ID response 99 with timeout 10000 2025.06.18 08:40:11.029958 [ 66604 ] {} KeeperStateMachine: Session ID response 100 with timeout 10000 2025.06.18 08:40:11.030036 [ 66604 ] {} KeeperStateMachine: Session ID response 101 with timeout 10000 2025.06.18 08:40:11.030113 [ 66604 ] {} KeeperStateMachine: Session ID response 102 with timeout 10000 2025.06.18 08:40:11.030184 [ 66604 ] {} KeeperStateMachine: Session ID response 103 with timeout 10000 2025.06.18 08:40:11.030264 [ 66604 ] {} KeeperStateMachine: Session ID response 104 with timeout 10000 2025.06.18 08:40:11.030423 [ 66604 ] {} KeeperStateMachine: Session ID response 105 with timeout 10000 2025.06.18 08:40:11.030525 [ 66604 ] {} KeeperStateMachine: Session ID response 106 with timeout 10000 2025.06.18 08:40:11.030631 [ 66604 ] {} KeeperStateMachine: Session ID response 107 with timeout 10000 2025.06.18 08:40:11.030710 [ 66604 ] {} KeeperStateMachine: Session ID response 108 with timeout 10000 2025.06.18 08:40:11.030786 [ 66604 ] {} KeeperStateMachine: Session ID response 109 with timeout 10000 2025.06.18 08:40:11.030932 [ 66604 ] {} KeeperStateMachine: Session ID response 110 with timeout 10000 2025.06.18 08:40:11.031018 [ 66604 ] {} KeeperStateMachine: Session ID response 111 with timeout 10000 2025.06.18 08:40:11.031096 [ 66604 ] {} KeeperStateMachine: Session ID response 112 with timeout 10000 2025.06.18 08:40:11.031167 [ 66604 ] {} KeeperStateMachine: Session ID response 113 with timeout 10000 2025.06.18 08:40:11.031241 [ 66604 ] {} KeeperStateMachine: Session ID response 114 with timeout 10000 2025.06.18 08:40:11.031435 [ 66604 ] {} KeeperStateMachine: Session ID response 115 with timeout 10000 2025.06.18 08:40:11.031518 [ 66604 ] {} KeeperStateMachine: Session ID response 116 with timeout 10000 2025.06.18 08:40:11.032647 [ 66604 ] {} KeeperStateMachine: Session ID response 117 with timeout 10000 2025.06.18 08:40:11.032735 [ 66604 ] {} KeeperStateMachine: Session ID response 118 with timeout 10000 2025.06.18 08:40:11.241516 [ 66604 ] {} KeeperStateMachine: Session ID response 119 with timeout 30000 2025.06.18 08:40:12.091962 [ 66604 ] {} KeeperServer: Preprocessing 1 log entries 2025.06.18 08:40:12.092035 [ 66604 ] {} KeeperServer: Preprocessing done 2025.06.18 08:40:12.092088 [ 66604 ] {} RaftInstance: config at index 9172 is committed, prev config log idx 35 2025.06.18 08:40:12.092142 [ 66604 ] {} RaftInstance: new config log idx 9172, prev log idx 35, cur config log idx 35, prev log idx 10 2025.06.18 08:40:12.092208 [ 66604 ] {} RaftInstance: new configuration: log idx 9172, prev log idx 35 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 4 2025.06.18 08:40:12.092381 [ 65992 ] {} KeeperDispatcher: Quorum initialized 2025.06.18 08:40:12.093253 [ 65992 ] {} KeeperDispatcher: Dispatcher initialized 2025.06.18 08:40:12.095074 [ 65992 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.06.18 08:40:12.095589 [ 65992 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.06.18 08:40:12.108767 [ 65992 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.06.18 08:40:12.108831 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.06.18 08:40:12.109959 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.06.18 08:40:12.110352 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.06.18 08:40:12.110897 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.06.18 08:40:12.111170 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.06.18 08:40:12.111448 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.06.18 08:40:12.111726 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.06.18 08:40:12.111979 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.06.18 08:40:12.112309 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.06.18 08:40:12.112567 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.06.18 08:40:12.112813 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.06.18 08:40:12.113092 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.06.18 08:40:12.113357 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.06.18 08:40:12.113630 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.06.18 08:40:12.113912 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.06.18 08:40:12.114252 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.06.18 08:40:12.114692 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.06.18 08:40:12.115092 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.06.18 08:40:12.115378 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.06.18 08:40:12.115714 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.06.18 08:40:12.116000 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.06.18 08:40:12.116527 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.06.18 08:40:12.117318 [ 65992 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.06.18 08:40:12.124454 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.06.18 08:40:12.124661 [ 65992 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.06.18 08:40:12.130440 [ 65992 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.06.18 08:40:12.130511 [ 65992 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.06.18 08:40:12.133755 [ 65992 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.06.18 08:40:12.134976 [ 65992 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.06.18 08:40:12.135440 [ 65992 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.06.18 08:40:12.135734 [ 66617 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.06.18 08:40:12.143655 [ 65992 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.06.18 08:40:12.147457 [ 65992 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.06.18 08:40:12.154055 [ 65992 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.06.18 08:40:12.156863 [ 65992 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.06.18 08:40:12.165011 [ 65992 ] {} DNSCacheUpdater: Update period 15 seconds 2025.06.18 08:40:12.165095 [ 65992 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.06.18 08:40:12.165280 [ 66026 ] {} DNSResolver: Updating DNS cache 2025.06.18 08:40:12.166444 [ 66026 ] {} DNSResolver: Updated DNS cache 2025.06.18 08:40:12.187462 [ 66684 ] {} DiskObjectStorage(azure): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.187556 [ 66684 ] {} AzureObjectStorage: Writing file: bpgnclltfzswenurtpgtipepkehfmcsj 2025.06.18 08:40:12.194024 [ 66684 ] {} WriteBufferFromAzureBlobStorage: Committed single block for blob `bpgnclltfzswenurtpgtipepkehfmcsj` 2025.06.18 08:40:12.194341 [ 66684 ] {} WriteBufferFromAzureBlobStorage: finalizeImpl WriteBufferFromAzureBlobStorage bpgnclltfzswenurtpgtipepkehfmcsj 2025.06.18 08:40:12.194770 [ 66684 ] {} WriteBufferFromAzureBlobStorage: Close WriteBufferFromAzureBlobStorage. bpgnclltfzswenurtpgtipepkehfmcsj. 2025.06.18 08:40:12.194978 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: bpgnclltfzswenurtpgtipepkehfmcsj (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.197649 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: bpgnclltfzswenurtpgtipepkehfmcsj (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.201067 [ 66684 ] {} AzureObjectStorage: Removing single object: bpgnclltfzswenurtpgtipepkehfmcsj 2025.06.18 08:40:12.202659 [ 66684 ] {} DiskObjectStorage(azure): Starting up disk azure 2025.06.18 08:40:12.202708 [ 66684 ] {} DiskObjectStorage(azure): Disk azure started up 2025.06.18 08:40:12.203926 [ 66684 ] {} FileCache(cached_azure): Using LRU cache policy 2025.06.18 08:40:12.204203 [ 66684 ] {} FileCache(cached_azure): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/azure_cache/ 2025.06.18 08:40:12.210119 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/azure_cache/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.210291 [ 66684 ] {} DiskCache: Registered cached disk (`cached_azure`) with structure: DiskObjectStorage-azure(CachedObjectStorage-cached_azure(AzureObjectStorage)) 2025.06.18 08:40:12.224519 [ 66684 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:12.224577 [ 66684 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:12.239444 [ 66684 ] {} S3ObjectStorage: Objects with paths [s3/dmq/liikgynjzsurglaxhpsiodrtrdrdb] were removed from S3 2025.06.18 08:40:12.239805 [ 66684 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.249731 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vry/paxhjhzunupyiunbvakwtytcjhwvd (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.252111 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vry/paxhjhzunupyiunbvakwtytcjhwvd (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.252173 [ 66684 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/vry/paxhjhzunupyiunbvakwtytcjhwvd, Version: Latest, Offset: 2 2025.06.18 08:40:12.257490 [ 66684 ] {} S3ObjectStorage: Objects with paths [s3/vry/paxhjhzunupyiunbvakwtytcjhwvd] were removed from S3 2025.06.18 08:40:12.257555 [ 66684 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.06.18 08:40:12.257589 [ 66684 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.06.18 08:40:12.269439 [ 66684 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:12.269489 [ 66684 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:12.281684 [ 66684 ] {} S3ObjectStorage: Objects with paths [s3_plain/clickhouse_remove_objects_capability_853c0f67-c27f-4a36-9d7b-b6985f8ffd25] were removed from S3 2025.06.18 08:40:12.281990 [ 66684 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.293238 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.297260 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.297322 [ 66684 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25, Version: Latest, Offset: 2 2025.06.18 08:40:12.309972 [ 66684 ] {} S3ObjectStorage: Objects with paths [s3_plain/clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25] were removed from S3 2025.06.18 08:40:12.310027 [ 66684 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.06.18 08:40:12.310060 [ 66684 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.06.18 08:40:12.311311 [ 66684 ] {} FileCache(s3_cache): Using LRU cache policy 2025.06.18 08:40:12.311610 [ 66684 ] {} FileCache(s3_cache): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/s3_cache/ 2025.06.18 08:40:12.313664 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/s3_cache/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.313842 [ 66684 ] {} DiskCache: Registered cached disk (`s3_cache`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache(S3ObjectStorage)) 2025.06.18 08:40:12.314843 [ 66684 ] {} FileCache(s3_cache_02933): Using LRU cache policy 2025.06.18 08:40:12.315098 [ 66684 ] {} FileCache(s3_cache_02933): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/s3_cache_02933/ 2025.06.18 08:40:12.317352 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/s3_cache_02933/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.317466 [ 66684 ] {} DiskCache: Registered cached disk (`s3_cache_02933`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache_02933(S3ObjectStorage)) 2025.06.18 08:40:12.318072 [ 66684 ] {} DiskObjectStorage(local_disk): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.318124 [ 66684 ] {} LocalObjectStorage: Write object: local_disk/otrsxukmkeeiytensiyvfwgvrkhbncux 2025.06.18 08:40:12.318863 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: local_disk/otrsxukmkeeiytensiyvfwgvrkhbncux (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.319233 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: local_disk/otrsxukmkeeiytensiyvfwgvrkhbncux (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.319678 [ 66684 ] {} DiskObjectStorage(local_disk): Starting up disk local_disk 2025.06.18 08:40:12.319714 [ 66684 ] {} DiskObjectStorage(local_disk): Disk local_disk started up 2025.06.18 08:40:12.320256 [ 66684 ] {} DiskObjectStorage(local_disk_2): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.320297 [ 66684 ] {} LocalObjectStorage: Write object: local_disk_2/lxjokouryofoqlpfwzkuctnskulpxsbn 2025.06.18 08:40:12.320903 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: local_disk_2/lxjokouryofoqlpfwzkuctnskulpxsbn (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.321241 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: local_disk_2/lxjokouryofoqlpfwzkuctnskulpxsbn (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.321669 [ 66684 ] {} DiskObjectStorage(local_disk_2): Starting up disk local_disk_2 2025.06.18 08:40:12.321703 [ 66684 ] {} DiskObjectStorage(local_disk_2): Disk local_disk_2 started up 2025.06.18 08:40:12.322270 [ 66684 ] {} DiskObjectStorage(local_disk_3): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.322308 [ 66684 ] {} LocalObjectStorage: Write object: local_disk_3/reinnkxwdlajajlpabbdowxtoyxwlach 2025.06.18 08:40:12.322977 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: local_disk_3/reinnkxwdlajajlpabbdowxtoyxwlach (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.323303 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: local_disk_3/reinnkxwdlajajlpabbdowxtoyxwlach (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.323708 [ 66684 ] {} DiskObjectStorage(local_disk_3): Starting up disk local_disk_3 2025.06.18 08:40:12.323739 [ 66684 ] {} DiskObjectStorage(local_disk_3): Disk local_disk_3 started up 2025.06.18 08:40:12.324643 [ 66684 ] {} FileCache(local_cache): Using LRU cache policy 2025.06.18 08:40:12.324877 [ 66684 ] {} FileCache(local_cache): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/local_cache/ 2025.06.18 08:40:12.327848 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/local_cache/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.327963 [ 66684 ] {} DiskCache: Registered cached disk (`local_cache`) with structure: DiskObjectStorage-local_disk(CachedObjectStorage-local_cache(LocalObjectStorage)) 2025.06.18 08:40:12.328837 [ 66684 ] {} FileCache(local_cache_2): Using LRU cache policy 2025.06.18 08:40:12.329056 [ 66684 ] {} FileCache(local_cache_2): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/local_cache_2/ 2025.06.18 08:40:12.330575 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/local_cache_2/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.330682 [ 66684 ] {} DiskCache: Registered cached disk (`local_cache_2`) with structure: DiskObjectStorage-local_disk(CachedObjectStorage-local_cache_2(LocalObjectStorage)) 2025.06.18 08:40:12.331563 [ 66684 ] {} FileCache(local_cache_3): Using LRU cache policy 2025.06.18 08:40:12.331777 [ 66684 ] {} FileCache(local_cache_3): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/local_cache_3/ 2025.06.18 08:40:12.333569 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/local_cache_3/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.333697 [ 66684 ] {} DiskCache: Registered cached disk (`local_cache_3`) with structure: DiskObjectStorage-local_disk_3(CachedObjectStorage-local_cache_3(LocalObjectStorage)) 2025.06.18 08:40:12.334725 [ 66684 ] {} FileCache(s3_cache_multi): Using LRU cache policy 2025.06.18 08:40:12.334965 [ 66684 ] {} FileCache(s3_cache_multi): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/s3_cache_multi/ 2025.06.18 08:40:12.336978 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/s3_cache_multi/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.337101 [ 66684 ] {} DiskCache: Registered cached disk (`s3_cache_multi`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache_multi(CachedObjectStorage-s3_cache(S3ObjectStorage))) 2025.06.18 08:40:12.337995 [ 66684 ] {} FileCache(s3_cache_multi_2): Using LRU cache policy 2025.06.18 08:40:12.338255 [ 66684 ] {} FileCache(s3_cache_multi_2): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/s3_cache_multi_2/ 2025.06.18 08:40:12.340003 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/s3_cache_multi_2/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.340127 [ 66684 ] {} DiskCache: Registered cached disk (`s3_cache_multi_2`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache_multi_2(CachedObjectStorage-s3_cache_multi(CachedObjectStorage-s3_cache(S3ObjectStorage)))) 2025.06.18 08:40:12.351612 [ 66684 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:12.351665 [ 66684 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:12.360344 [ 66684 ] {} S3ObjectStorage: Objects with paths [special/bdn/phdozqlvutpbjxpbeolojeccegnrw] were removed from S3 2025.06.18 08:40:12.360719 [ 66684 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.365998 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/pob/cftjxnxqrvnluhrnwboarjonquesg (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.368473 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/pob/cftjxnxqrvnluhrnwboarjonquesg (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.368535 [ 66684 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/pob/cftjxnxqrvnluhrnwboarjonquesg, Version: Latest, Offset: 2 2025.06.18 08:40:12.373563 [ 66684 ] {} S3ObjectStorage: Objects with paths [special/pob/cftjxnxqrvnluhrnwboarjonquesg] were removed from S3 2025.06.18 08:40:12.373615 [ 66684 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.06.18 08:40:12.373648 [ 66684 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.06.18 08:40:12.384752 [ 66684 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:12.384794 [ 66684 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:12.398355 [ 66684 ] {} S3ObjectStorage: Objects with paths [test_02944/bju/mvabbprhrfccvpwcrcspqoshvxsdt] were removed from S3 2025.06.18 08:40:12.398715 [ 66684 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.407462 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/xst/uyjutuicsysniinvdlgfumjepwzek (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.409481 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/xst/uyjutuicsysniinvdlgfumjepwzek (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.409537 [ 66684 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/xst/uyjutuicsysniinvdlgfumjepwzek, Version: Latest, Offset: 2 2025.06.18 08:40:12.414559 [ 66684 ] {} S3ObjectStorage: Objects with paths [test_02944/xst/uyjutuicsysniinvdlgfumjepwzek] were removed from S3 2025.06.18 08:40:12.414610 [ 66684 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.06.18 08:40:12.414651 [ 66684 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.06.18 08:40:12.415652 [ 66684 ] {} FileCache(s3_cache_02944): Using LRU cache policy 2025.06.18 08:40:12.415888 [ 66684 ] {} FileCache(s3_cache_02944): Loading filesystem cache with 16 threads from /var/lib/clickhouse/filesystem_caches/s3_cache_02944/ 2025.06.18 08:40:12.417949 [ 66684 ] {} StatusFile: Status file /var/lib/clickhouse/filesystem_caches/s3_cache_02944/status already exists - unclean restart. Contents: PID: 2643 Started at: 2025-06-18 08:11:30 Revision: 4294967295 2025.06.18 08:40:12.418070 [ 66684 ] {} DiskCache: Registered cached disk (`s3_cache_02944`) with structure: DiskObjectStorage-s3_disk(CachedObjectStorage-s3_cache_02944(S3ObjectStorage)) 2025.06.18 08:40:12.431421 [ 66684 ] {} S3Client: Provider type: Unknown 2025.06.18 08:40:12.431466 [ 66684 ] {} S3Client: API mode of the S3 client: AWS 2025.06.18 08:40:12.443772 [ 66684 ] {} S3ObjectStorage: Objects with paths [common/ppq/oswrejsmdyxdrwsdwiunkuerxumjj] were removed from S3 2025.06.18 08:40:12.444306 [ 66684 ] {} DiskObjectStorage(s3_disk_02963): Write file: clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25 2025.06.18 08:40:12.454302 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: common/ffl/dvadigaysoxxjvjdnmtflrpqrxzwl (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.456637 [ 66684 ] {} ReadBufferFromRemoteFSGather: Reading from file: common/ffl/dvadigaysoxxjvjdnmtflrpqrxzwl (clickhouse_access_check_853c0f67-c27f-4a36-9d7b-b6985f8ffd25) 2025.06.18 08:40:12.456692 [ 66684 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: common/ffl/dvadigaysoxxjvjdnmtflrpqrxzwl, Version: Latest, Offset: 2 2025.06.18 08:40:12.461667 [ 66684 ] {} S3ObjectStorage: Objects with paths [common/ffl/dvadigaysoxxjvjdnmtflrpqrxzwl] were removed from S3 2025.06.18 08:40:12.461726 [ 66684 ] {} DiskObjectStorage(s3_disk_02963): Starting up disk s3_disk_02963 2025.06.18 08:40:12.461760 [ 66684 ] {} DiskObjectStorage(s3_disk_02963): Disk s3_disk_02963 started up 2025.06.18 08:40:12.462338 [ 66684 ] {} StoragePolicy (azure_cache): Storage policy azure_cache created, total volumes 1 2025.06.18 08:40:12.462391 [ 66684 ] {} StoragePolicySelector: Storage policy `azure_cache` loaded 2025.06.18 08:40:12.462997 [ 66684 ] {} StoragePolicy (local_remote): Storage policy local_remote created, total volumes 2 2025.06.18 08:40:12.463039 [ 66684 ] {} StoragePolicySelector: Storage policy `local_remote` loaded 2025.06.18 08:40:12.463363 [ 66684 ] {} StoragePolicy (s3_cache): Storage policy s3_cache created, total volumes 1 2025.06.18 08:40:12.463393 [ 66684 ] {} StoragePolicySelector: Storage policy `s3_cache` loaded 2025.06.18 08:40:12.463727 [ 66684 ] {} StoragePolicy (s3_no_cache): Storage policy s3_no_cache created, total volumes 1 2025.06.18 08:40:12.463757 [ 66684 ] {} StoragePolicySelector: Storage policy `s3_no_cache` loaded 2025.06.18 08:40:12.464092 [ 66684 ] {} StoragePolicy (s3_cache_multi): Storage policy s3_cache_multi created, total volumes 1 2025.06.18 08:40:12.464123 [ 66684 ] {} StoragePolicySelector: Storage policy `s3_cache_multi` loaded 2025.06.18 08:40:12.464441 [ 66684 ] {} StoragePolicy (local_cache): Storage policy local_cache created, total volumes 1 2025.06.18 08:40:12.464476 [ 66684 ] {} StoragePolicySelector: Storage policy `local_cache` loaded 2025.06.18 08:40:12.464805 [ 66684 ] {} StoragePolicy (local_cache_2): Storage policy local_cache_2 created, total volumes 1 2025.06.18 08:40:12.464841 [ 66684 ] {} StoragePolicySelector: Storage policy `local_cache_2` loaded 2025.06.18 08:40:12.465173 [ 66684 ] {} StoragePolicy (local_cache_3): Storage policy local_cache_3 created, total volumes 1 2025.06.18 08:40:12.465202 [ 66684 ] {} StoragePolicySelector: Storage policy `local_cache_3` loaded 2025.06.18 08:40:12.466350 [ 66684 ] {} StoragePolicy (policy_02961): Storage policy policy_02961 created, total volumes 4 2025.06.18 08:40:12.466416 [ 66684 ] {} StoragePolicySelector: Storage policy `policy_02961` loaded 2025.06.18 08:40:12.466553 [ 66684 ] {} StoragePolicy (default): Storage policy default created, total volumes 1 2025.06.18 08:40:12.589909 [ 65992 ] {} DatabaseAtomic (system): Metadata processed, database system has 20 tables and 0 dictionaries in total. 2025.06.18 08:40:12.590113 [ 65992 ] {} TablesLoader: Parsed metadata of 20 tables in 1 databases in 0.423440107 sec 2025.06.18 08:40:12.597011 [ 65992 ] {} ReferentialDeps: No tables 2025.06.18 08:40:12.597152 [ 65992 ] {} LoadingDeps: Table system.zookeeper_log has no dependencies (level 0) 2025.06.18 08:40:12.597211 [ 65992 ] {} LoadingDeps: Table system.transactions_info_log has no dependencies (level 0) 2025.06.18 08:40:12.597248 [ 65992 ] {} LoadingDeps: Table system.trace_log has no dependencies (level 0) 2025.06.18 08:40:12.597281 [ 65992 ] {} LoadingDeps: Table system.session_log has no dependencies (level 0) 2025.06.18 08:40:12.597310 [ 65992 ] {} LoadingDeps: Table system.s3queue_log has no dependencies (level 0) 2025.06.18 08:40:12.597341 [ 65992 ] {} LoadingDeps: Table system.query_views_log has no dependencies (level 0) 2025.06.18 08:40:12.597381 [ 65992 ] {} LoadingDeps: Table system.query_thread_log has no dependencies (level 0) 2025.06.18 08:40:12.597414 [ 65992 ] {} LoadingDeps: Table system.filesystem_cache_log has no dependencies (level 0) 2025.06.18 08:40:12.597446 [ 65992 ] {} LoadingDeps: Table system.processors_profile_log has no dependencies (level 0) 2025.06.18 08:40:12.597477 [ 65992 ] {} LoadingDeps: Table system.query_log has no dependencies (level 0) 2025.06.18 08:40:12.597507 [ 65992 ] {} LoadingDeps: Table system.opentelemetry_span_log has no dependencies (level 0) 2025.06.18 08:40:12.597556 [ 65992 ] {} LoadingDeps: Table system.text_log has no dependencies (level 0) 2025.06.18 08:40:12.597592 [ 65992 ] {} LoadingDeps: Table system.metric_log has no dependencies (level 0) 2025.06.18 08:40:12.597621 [ 65992 ] {} LoadingDeps: Table system.backup_log has no dependencies (level 0) 2025.06.18 08:40:12.597649 [ 65992 ] {} LoadingDeps: Table system.part_log has no dependencies (level 0) 2025.06.18 08:40:12.597678 [ 65992 ] {} LoadingDeps: Table system.error_log has no dependencies (level 0) 2025.06.18 08:40:12.597717 [ 65992 ] {} LoadingDeps: Table system.asynchronous_insert_log has no dependencies (level 0) 2025.06.18 08:40:12.597748 [ 65992 ] {} LoadingDeps: Table system.crash_log has no dependencies (level 0) 2025.06.18 08:40:12.597778 [ 65992 ] {} LoadingDeps: Table system.blob_storage_log has no dependencies (level 0) 2025.06.18 08:40:12.597809 [ 65992 ] {} LoadingDeps: Table system.asynchronous_metric_log has no dependencies (level 0) 2025.06.18 08:40:12.598437 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.zookeeper_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598497 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.transactions_info_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598531 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.trace_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598573 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.session_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598603 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.s3queue_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598631 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.query_views_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598667 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.query_thread_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598698 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.filesystem_cache_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598727 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.processors_profile_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598766 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.query_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598795 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.opentelemetry_span_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598828 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.text_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598858 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.metric_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598885 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.backup_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598912 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.part_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598939 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.error_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.598973 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.asynchronous_insert_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.599002 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.crash_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.599029 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.blob_storage_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.599058 [ 65992 ] {} AsyncLoader: Prioritize load job 'load table system.asynchronous_metric_log': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:12.599181 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.zookeeper_log' into ForegroundLoad 2025.06.18 08:40:12.599223 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.metric_log' into ForegroundLoad 2025.06.18 08:40:12.599253 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.part_log' into ForegroundLoad 2025.06.18 08:40:12.599288 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.asynchronous_metric_log' into ForegroundLoad 2025.06.18 08:40:12.599316 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.filesystem_cache_log' into ForegroundLoad 2025.06.18 08:40:12.599350 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.error_log' into ForegroundLoad 2025.06.18 08:40:12.599377 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.crash_log' into ForegroundLoad 2025.06.18 08:40:12.599404 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.opentelemetry_span_log' into ForegroundLoad 2025.06.18 08:40:12.599431 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.asynchronous_insert_log' into ForegroundLoad 2025.06.18 08:40:12.599458 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.transactions_info_log' into ForegroundLoad 2025.06.18 08:40:12.599490 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.trace_log' into ForegroundLoad 2025.06.18 08:40:12.599519 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.session_log' into ForegroundLoad 2025.06.18 08:40:12.599556 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.s3queue_log' into ForegroundLoad 2025.06.18 08:40:12.599586 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.query_log' into ForegroundLoad 2025.06.18 08:40:12.599615 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.query_views_log' into ForegroundLoad 2025.06.18 08:40:12.599649 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.query_thread_log' into ForegroundLoad 2025.06.18 08:40:12.599676 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.text_log' into ForegroundLoad 2025.06.18 08:40:12.599701 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.backup_log' into ForegroundLoad 2025.06.18 08:40:12.599734 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.processors_profile_log' into ForegroundLoad 2025.06.18 08:40:12.599768 [ 65992 ] {} AsyncLoader: Schedule load job 'load table system.blob_storage_log' into ForegroundLoad 2025.06.18 08:40:12.599809 [ 65992 ] {} AsyncLoader: Change current priority: none -> 0 2025.06.18 08:40:12.599846 [ 65992 ] {} AsyncLoader: Spawn loader worker #1 in ForegroundLoad 2025.06.18 08:40:12.599925 [ 65992 ] {} AsyncLoader: Spawn loader worker #2 in ForegroundLoad 2025.06.18 08:40:12.600011 [ 65992 ] {} AsyncLoader: Spawn loader worker #3 in ForegroundLoad 2025.06.18 08:40:12.600158 [ 65992 ] {} AsyncLoader: Spawn loader worker #4 in ForegroundLoad 2025.06.18 08:40:12.600247 [ 65992 ] {} AsyncLoader: Spawn loader worker #5 in ForegroundLoad 2025.06.18 08:40:12.600310 [ 65992 ] {} AsyncLoader: Spawn loader worker #6 in ForegroundLoad 2025.06.18 08:40:12.600368 [ 65992 ] {} AsyncLoader: Spawn loader worker #7 in ForegroundLoad 2025.06.18 08:40:12.600600 [ 65992 ] {} AsyncLoader: Spawn loader worker #8 in ForegroundLoad 2025.06.18 08:40:12.600683 [ 65992 ] {} AsyncLoader: Spawn loader worker #9 in ForegroundLoad 2025.06.18 08:40:12.600770 [ 65992 ] {} AsyncLoader: Spawn loader worker #10 in ForegroundLoad 2025.06.18 08:40:12.600827 [ 65992 ] {} AsyncLoader: Spawn loader worker #11 in ForegroundLoad 2025.06.18 08:40:12.600938 [ 65992 ] {} AsyncLoader: Spawn loader worker #12 in ForegroundLoad 2025.06.18 08:40:12.600994 [ 65992 ] {} AsyncLoader: Spawn loader worker #13 in ForegroundLoad 2025.06.18 08:40:12.601042 [ 65992 ] {} AsyncLoader: Spawn loader worker #14 in ForegroundLoad 2025.06.18 08:40:12.601098 [ 65992 ] {} AsyncLoader: Spawn loader worker #15 in ForegroundLoad 2025.06.18 08:40:12.601148 [ 65992 ] {} AsyncLoader: Spawn loader worker #16 in ForegroundLoad 2025.06.18 08:40:12.601599 [ 65992 ] {} AsyncLoader: Wait load job 'load table system.zookeeper_log' in ForegroundLoad 2025.06.18 08:40:12.601652 [ 66703 ] {} AsyncLoader: Execute load job 'load table system.zookeeper_log' in ForegroundLoad 2025.06.18 08:40:12.601761 [ 66703 ] {} DatabaseAtomic (system): Loading table system.zookeeper_log 2025.06.18 08:40:12.601879 [ 66696 ] {} AsyncLoader: Execute load job 'load table system.metric_log' in ForegroundLoad 2025.06.18 08:40:12.602238 [ 66696 ] {} DatabaseAtomic (system): Loading table system.metric_log 2025.06.18 08:40:12.602242 [ 66710 ] {} AsyncLoader: Execute load job 'load table system.part_log' in ForegroundLoad 2025.06.18 08:40:12.602388 [ 66710 ] {} DatabaseAtomic (system): Loading table system.part_log 2025.06.18 08:40:12.602481 [ 66694 ] {} AsyncLoader: Execute load job 'load table system.asynchronous_metric_log' in ForegroundLoad 2025.06.18 08:40:12.602938 [ 66694 ] {} DatabaseAtomic (system): Loading table system.asynchronous_metric_log 2025.06.18 08:40:12.602864 [ 66711 ] {} AsyncLoader: Execute load job 'load table system.filesystem_cache_log' in ForegroundLoad 2025.06.18 08:40:12.603304 [ 66711 ] {} DatabaseAtomic (system): Loading table system.filesystem_cache_log 2025.06.18 08:40:12.603375 [ 66693 ] {} AsyncLoader: Execute load job 'load table system.error_log' in ForegroundLoad 2025.06.18 08:40:12.603595 [ 66682 ] {} AsyncLoader: Execute load job 'load table system.crash_log' in ForegroundLoad 2025.06.18 08:40:12.603618 [ 66693 ] {} DatabaseAtomic (system): Loading table system.error_log 2025.06.18 08:40:12.603710 [ 66682 ] {} DatabaseAtomic (system): Loading table system.crash_log 2025.06.18 08:40:12.603837 [ 66685 ] {} AsyncLoader: Execute load job 'load table system.opentelemetry_span_log' in ForegroundLoad 2025.06.18 08:40:12.604015 [ 66685 ] {} DatabaseAtomic (system): Loading table system.opentelemetry_span_log 2025.06.18 08:40:12.604078 [ 66684 ] {} AsyncLoader: Execute load job 'load table system.asynchronous_insert_log' in ForegroundLoad 2025.06.18 08:40:12.604331 [ 66684 ] {} DatabaseAtomic (system): Loading table system.asynchronous_insert_log 2025.06.18 08:40:12.604406 [ 66691 ] {} AsyncLoader: Execute load job 'load table system.transactions_info_log' in ForegroundLoad 2025.06.18 08:40:12.604619 [ 66691 ] {} DatabaseAtomic (system): Loading table system.transactions_info_log 2025.06.18 08:40:12.604664 [ 66686 ] {} AsyncLoader: Execute load job 'load table system.trace_log' in ForegroundLoad 2025.06.18 08:40:12.604893 [ 66687 ] {} AsyncLoader: Execute load job 'load table system.session_log' in ForegroundLoad 2025.06.18 08:40:12.604882 [ 66686 ] {} DatabaseAtomic (system): Loading table system.trace_log 2025.06.18 08:40:12.604994 [ 66687 ] {} DatabaseAtomic (system): Loading table system.session_log 2025.06.18 08:40:12.605082 [ 66688 ] {} AsyncLoader: Execute load job 'load table system.s3queue_log' in ForegroundLoad 2025.06.18 08:40:12.605248 [ 66688 ] {} DatabaseAtomic (system): Loading table system.s3queue_log 2025.06.18 08:40:12.605304 [ 66683 ] {} AsyncLoader: Execute load job 'load table system.query_log' in ForegroundLoad 2025.06.18 08:40:12.605444 [ 66683 ] {} DatabaseAtomic (system): Loading table system.query_log 2025.06.18 08:40:12.605495 [ 66690 ] {} AsyncLoader: Execute load job 'load table system.query_views_log' in ForegroundLoad 2025.06.18 08:40:12.605671 [ 66690 ] {} DatabaseAtomic (system): Loading table system.query_views_log 2025.06.18 08:40:12.605767 [ 66712 ] {} AsyncLoader: Execute load job 'load table system.query_thread_log' in ForegroundLoad 2025.06.18 08:40:12.606011 [ 66712 ] {} DatabaseAtomic (system): Loading table system.query_thread_log 2025.06.18 08:40:12.620011 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading data parts 2025.06.18 08:40:12.621399 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.621572 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Will load 5 parts using up to 64 threads 2025.06.18 08:40:12.621956 [ 66689 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Active part 202506_148_148_0 from disk default 2025.06.18 08:40:12.622619 [ 66714 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Active part 202506_146_146_0 from disk default 2025.06.18 08:40:12.623295 [ 66716 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Active part 202506_1_145_41 from disk default 2025.06.18 08:40:12.624431 [ 66715 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Active part 202506_147_147_0 from disk default 2025.06.18 08:40:12.624815 [ 66718 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Active part 202506_149_149_0 from disk default 2025.06.18 08:40:12.628317 [ 66716 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_145_41 (state Active) into data_parts_indexes 2025.06.18 08:40:12.628469 [ 66716 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Active part 202506_1_145_41 on disk default 2025.06.18 08:40:12.628477 [ 66714 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_146_146_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.628564 [ 66714 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Active part 202506_146_146_0 on disk default 2025.06.18 08:40:12.628771 [ 66718 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_149_149_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.628846 [ 66718 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Active part 202506_149_149_0 on disk default 2025.06.18 08:40:12.629722 [ 66689 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_148_148_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.629909 [ 66689 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Active part 202506_148_148_0 on disk default 2025.06.18 08:40:12.632157 [ 66715 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_147_147_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.632291 [ 66715 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Active part 202506_147_147_0 on disk default 2025.06.18 08:40:12.632700 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Found 13 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.632888 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loaded data parts (5 items) 2025.06.18 08:40:12.633910 [ 66685 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.634019 [ 66685 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.634200 [ 66685 ] {} AsyncLoader: Finish load job 'load table system.opentelemetry_span_log' with status OK 2025.06.18 08:40:12.634322 [ 66685 ] {} AsyncLoader: Execute load job 'load table system.text_log' in ForegroundLoad 2025.06.18 08:40:12.634412 [ 66685 ] {} DatabaseAtomic (system): Loading table system.text_log 2025.06.18 08:40:12.666705 [ 66710 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading data parts 2025.06.18 08:40:12.666759 [ 66688 ] {} system.s3queue_log (0d84882e-e8cf-4d52-8c5c-60329a9d62f1): Loading data parts 2025.06.18 08:40:12.667027 [ 66682 ] {} system.crash_log (645ba020-dd4c-4e4a-a193-9a212ee008cb): Loading data parts 2025.06.18 08:40:12.667280 [ 66710 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.667382 [ 66710 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Will load 3 parts using up to 64 threads 2025.06.18 08:40:12.667539 [ 66688 ] {} system.s3queue_log (0d84882e-e8cf-4d52-8c5c-60329a9d62f1): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.667523 [ 66682 ] {} system.crash_log (645ba020-dd4c-4e4a-a193-9a212ee008cb): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.667607 [ 66718 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Active part 202506_108_108_0 from disk default 2025.06.18 08:40:12.667626 [ 66688 ] {} system.s3queue_log (0d84882e-e8cf-4d52-8c5c-60329a9d62f1): There are no data parts 2025.06.18 08:40:12.667703 [ 66682 ] {} system.crash_log (645ba020-dd4c-4e4a-a193-9a212ee008cb): There are no data parts 2025.06.18 08:40:12.667837 [ 66715 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Active part 202506_107_107_0 from disk default 2025.06.18 08:40:12.667836 [ 66689 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Active part 202506_1_106_21 from disk default 2025.06.18 08:40:12.668012 [ 66691 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading data parts 2025.06.18 08:40:12.668349 [ 66688 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.668395 [ 66688 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.668478 [ 66688 ] {} AsyncLoader: Finish load job 'load table system.s3queue_log' with status OK 2025.06.18 08:40:12.668528 [ 66682 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.668552 [ 66688 ] {} AsyncLoader: Execute load job 'load table system.backup_log' in ForegroundLoad 2025.06.18 08:40:12.668642 [ 66682 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.668696 [ 66688 ] {} DatabaseAtomic (system): Loading table system.backup_log 2025.06.18 08:40:12.668784 [ 66682 ] {} AsyncLoader: Finish load job 'load table system.crash_log' with status OK 2025.06.18 08:40:12.668877 [ 66682 ] {} AsyncLoader: Execute load job 'load table system.processors_profile_log' in ForegroundLoad 2025.06.18 08:40:12.668943 [ 66682 ] {} DatabaseAtomic (system): Loading table system.processors_profile_log 2025.06.18 08:40:12.671360 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading data parts 2025.06.18 08:40:12.672927 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading data parts 2025.06.18 08:40:12.672929 [ 66691 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.673120 [ 66691 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Will load 5 parts using up to 64 threads 2025.06.18 08:40:12.673419 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading data parts 2025.06.18 08:40:12.673533 [ 66716 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Active part 202506_269_269_0 from disk default 2025.06.18 08:40:12.673503 [ 66712 ] {} system.query_thread_log (1dc25a06-d415-4fe2-9292-c3fc6670d43d): Loading data parts 2025.06.18 08:40:12.674086 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.674293 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Will load 6 parts using up to 64 threads 2025.06.18 08:40:12.675179 [ 66718 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_108_108_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.675237 [ 66718 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Active part 202506_108_108_0 on disk default 2025.06.18 08:40:12.675632 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.675739 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Will load 1 parts using up to 64 threads 2025.06.18 08:40:12.676083 [ 66686 ] {} system.trace_log (c51a343f-21b1-43ab-91d7-ff35d1414834): Loading data parts 2025.06.18 08:40:12.676152 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading data parts 2025.06.18 08:40:12.675661 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Active part 202506_268_268_0 from disk default 2025.06.18 08:40:12.677476 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Active part 202506_242_242_0 from disk default 2025.06.18 08:40:12.678500 [ 66712 ] {} system.query_thread_log (1dc25a06-d415-4fe2-9292-c3fc6670d43d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.678640 [ 66712 ] {} system.query_thread_log (1dc25a06-d415-4fe2-9292-c3fc6670d43d): There are no data parts 2025.06.18 08:40:12.678777 [ 66715 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_107_107_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.678863 [ 66715 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Active part 202506_107_107_0 on disk default 2025.06.18 08:40:12.679658 [ 66711 ] {} system.filesystem_cache_log (6923c23a-2581-4596-a541-10d2fbd38a20): Loading data parts 2025.06.18 08:40:12.680525 [ 66712 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.680625 [ 66712 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.680844 [ 66712 ] {} AsyncLoader: Finish load job 'load table system.query_thread_log' with status OK 2025.06.18 08:40:12.680929 [ 66689 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_1_106_21 (state Active) into data_parts_indexes 2025.06.18 08:40:12.681003 [ 66689 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Active part 202506_1_106_21 on disk default 2025.06.18 08:40:12.681418 [ 66712 ] {} AsyncLoader: Execute load job 'load table system.blob_storage_log' in ForegroundLoad 2025.06.18 08:40:12.681496 [ 66712 ] {} DatabaseAtomic (system): Loading table system.blob_storage_log 2025.06.18 08:40:12.681672 [ 66684 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading data parts 2025.06.18 08:40:12.681862 [ 66686 ] {} system.trace_log (c51a343f-21b1-43ab-91d7-ff35d1414834): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.681955 [ 66710 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Found 6 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.681965 [ 66686 ] {} system.trace_log (c51a343f-21b1-43ab-91d7-ff35d1414834): There are no data parts 2025.06.18 08:40:12.682362 [ 66689 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Active part 202506_1_239_48 from disk default 2025.06.18 08:40:12.682682 [ 66686 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.682736 [ 66686 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.682816 [ 66710 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loaded data parts (3 items) 2025.06.18 08:40:12.683143 [ 66686 ] {} AsyncLoader: Finish load job 'load table system.trace_log' with status OK 2025.06.18 08:40:12.683369 [ 66686 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.682900 [ 66721 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Active part 202506_267_267_0 from disk default 2025.06.18 08:40:12.683637 [ 66716 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_269_269_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.683721 [ 66716 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Active part 202506_269_269_0 on disk default 2025.06.18 08:40:12.685043 [ 66686 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Active part 202506_190_241_13 from disk default 2025.06.18 08:40:12.685219 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Active part 202506_244_244_0 from disk default 2025.06.18 08:40:12.685399 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Active part 202506_243_243_0 from disk default 2025.06.18 08:40:12.686097 [ 66714 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Active part 202506_245_245_0 from disk default 2025.06.18 08:40:12.686407 [ 66710 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.686451 [ 66710 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.686552 [ 66710 ] {} AsyncLoader: Finish load job 'load table system.part_log' with status OK 2025.06.18 08:40:12.686606 [ 66710 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.686731 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Active part 202506_1_265_53 from disk default 2025.06.18 08:40:12.686808 [ 66684 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.686865 [ 66684 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Will load 3 parts using up to 64 threads 2025.06.18 08:40:12.687494 [ 66682 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading data parts 2025.06.18 08:40:12.687735 [ 66688 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Loading data parts 2025.06.18 08:40:12.687818 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Active part 202506_266_266_0 from disk default 2025.06.18 08:40:12.686002 [ 66727 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Active part 202506_1_189_74 from disk default 2025.06.18 08:40:12.688198 [ 66723 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Active part 20250618_1_6_1 from disk default 2025.06.18 08:40:12.688914 [ 66710 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Active part 20250618_8_8_0 from disk default 2025.06.18 08:40:12.691738 [ 66711 ] {} system.filesystem_cache_log (6923c23a-2581-4596-a541-10d2fbd38a20): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.691844 [ 66711 ] {} system.filesystem_cache_log (6923c23a-2581-4596-a541-10d2fbd38a20): There are no data parts 2025.06.18 08:40:12.692016 [ 66690 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Loading data parts 2025.06.18 08:40:12.692075 [ 66724 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Active part 20250618_7_7_0 from disk default 2025.06.18 08:40:12.694574 [ 66687 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading data parts 2025.06.18 08:40:12.694714 [ 66711 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.695374 [ 66711 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.695564 [ 66682 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.695622 [ 66682 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Will load 6 parts using up to 64 threads 2025.06.18 08:40:12.695752 [ 66711 ] {} AsyncLoader: Finish load job 'load table system.filesystem_cache_log' with status OK 2025.06.18 08:40:12.695855 [ 66711 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.695856 [ 66687 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.696102 [ 66687 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Will load 5 parts using up to 64 threads 2025.06.18 08:40:12.696122 [ 66720 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Active part 202506_159_159_0 from disk default 2025.06.18 08:40:12.696488 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.697069 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Will load 2 parts using up to 64 threads 2025.06.18 08:40:12.697583 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.696706 [ 66726 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Active part 202506_162_162_0 from disk default 2025.06.18 08:40:12.698023 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Will load 6 parts using up to 64 threads 2025.06.18 08:40:12.698597 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_268_268_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.699104 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Active part 202506_268_268_0 on disk default 2025.06.18 08:40:12.700690 [ 66711 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Active part 202506_160_160_0 from disk default 2025.06.18 08:40:12.699926 [ 66729 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Active part 202506_1_34_7 from disk default 2025.06.18 08:40:12.704999 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Active part 202506_1_282_61 from disk default 2025.06.18 08:40:12.706126 [ 66731 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Active part 202506_486_486_0 from disk default 2025.06.18 08:40:12.706589 [ 66710 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_8_8_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.706705 [ 66710 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Active part 20250618_8_8_0 on disk default 2025.06.18 08:40:12.707590 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_266_266_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.707639 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Active part 202506_266_266_0 on disk default 2025.06.18 08:40:12.706354 [ 66730 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Active part 202506_37_37_0 from disk default 2025.06.18 08:40:12.709971 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Active part 202506_485_485_0 from disk default 2025.06.18 08:40:12.711413 [ 66734 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Active part 202506_161_161_0 from disk default 2025.06.18 08:40:12.711939 [ 66721 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_267_267_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.712047 [ 66721 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Active part 202506_267_267_0 on disk default 2025.06.18 08:40:12.714058 [ 66710 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Active part 202506_283_283_0 from disk default 2025.06.18 08:40:12.714505 [ 66712 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): Loading data parts 2025.06.18 08:40:12.715134 [ 66683 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading data parts 2025.06.18 08:40:12.715809 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Active part 202506_272_473_81 from disk default 2025.06.18 08:40:12.716631 [ 66712 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.717229 [ 66723 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_1_6_1 (state Active) into data_parts_indexes 2025.06.18 08:40:12.717325 [ 66723 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Active part 20250618_1_6_1 on disk default 2025.06.18 08:40:12.717498 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_282_61 (state Active) into data_parts_indexes 2025.06.18 08:40:12.717615 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Active part 202506_1_282_61 on disk default 2025.06.18 08:40:12.717134 [ 66712 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): Will load 1 parts using up to 64 threads 2025.06.18 08:40:12.718147 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_242_242_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.718238 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Active part 202506_242_242_0 on disk default 2025.06.18 08:40:12.718393 [ 66723 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Active part 202506_38_38_0 from disk default 2025.06.18 08:40:12.718974 [ 66721 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Active part 202506_36_36_0 from disk default 2025.06.18 08:40:12.719190 [ 66686 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_241_13 (state Active) into data_parts_indexes 2025.06.18 08:40:12.719253 [ 66686 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Active part 202506_190_241_13 on disk default 2025.06.18 08:40:12.721306 [ 66688 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.721384 [ 66688 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Will load 2 parts using up to 64 threads 2025.06.18 08:40:12.721571 [ 66710 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_283_283_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.721682 [ 66710 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Active part 202506_283_283_0 on disk default 2025.06.18 08:40:12.721856 [ 66710 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): Loading Active part 202506_1_14_3 from disk default 2025.06.18 08:40:12.721938 [ 66711 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_160_160_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.722029 [ 66711 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Active part 202506_160_160_0 on disk default 2025.06.18 08:40:12.722248 [ 66717 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Loading Active part 202506_2_2_0 from disk default 2025.06.18 08:40:12.722290 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Active part 202506_487_487_0 from disk default 2025.06.18 08:40:12.722673 [ 66726 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_162_162_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.722722 [ 66726 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Active part 202506_162_162_0 on disk default 2025.06.18 08:40:12.723740 [ 66690 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.724147 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_244_244_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.724209 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Active part 202506_244_244_0 on disk default 2025.06.18 08:40:12.724294 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_265_53 (state Active) into data_parts_indexes 2025.06.18 08:40:12.724325 [ 66686 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Active part 202506_1_271_20 from disk default 2025.06.18 08:40:12.724422 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Active part 202506_1_265_53 on disk default 2025.06.18 08:40:12.724688 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Found 90 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.724777 [ 66690 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Will load 2 parts using up to 64 threads 2025.06.18 08:40:12.725698 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loaded data parts (2 items) 2025.06.18 08:40:12.726182 [ 66691 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Found 77 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.724175 [ 66736 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Active part 202506_35_35_0 from disk default 2025.06.18 08:40:12.726569 [ 66683 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.726824 [ 66683 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Will load 2 parts using up to 64 threads 2025.06.18 08:40:12.726864 [ 66737 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Active part 202506_474_484_2 from disk default 2025.06.18 08:40:12.727061 [ 66711 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Loading Active part 202506_16_16_0 from disk default 2025.06.18 08:40:12.725452 [ 66725 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Active part 202506_154_158_1 from disk default 2025.06.18 08:40:12.727505 [ 66691 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loaded data parts (5 items) 2025.06.18 08:40:12.727673 [ 66726 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Active part 202506_1_136_22 from disk default 2025.06.18 08:40:12.727866 [ 66714 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_245_245_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.727931 [ 66714 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Active part 202506_245_245_0 on disk default 2025.06.18 08:40:12.728056 [ 66728 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Loading Active part 202506_1_15_3 from disk default 2025.06.18 08:40:12.728319 [ 66735 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Loading Active part 202506_1_1_0 from disk default 2025.06.18 08:40:12.730099 [ 66691 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.730148 [ 66691 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.730223 [ 66691 ] {} AsyncLoader: Finish load job 'load table system.transactions_info_log' with status OK 2025.06.18 08:40:12.730264 [ 66691 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.728847 [ 66738 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Active part 202506_1_153_61 from disk default 2025.06.18 08:40:12.731337 [ 66739 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Active part 202506_137_167_6 from disk default 2025.06.18 08:40:12.734002 [ 66694 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.734088 [ 66694 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.734215 [ 66694 ] {} AsyncLoader: Finish load job 'load table system.asynchronous_metric_log' with status OK 2025.06.18 08:40:12.734842 [ 66720 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_159_159_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.734927 [ 66720 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Active part 202506_159_159_0 on disk default 2025.06.18 08:40:12.734913 [ 66689 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_239_48 (state Active) into data_parts_indexes 2025.06.18 08:40:12.735067 [ 66689 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Active part 202506_1_239_48 on disk default 2025.06.18 08:40:12.736502 [ 66710 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): loadDataPart: inserting 202506_1_14_3 (state Active) into data_parts_indexes 2025.06.18 08:40:12.736672 [ 66710 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): Finished loading Active part 202506_1_14_3 on disk default 2025.06.18 08:40:12.736797 [ 66694 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.737084 [ 66712 ] {} system.blob_storage_log (56a32b54-0cbe-4193-b664-f4f3d3981c83): Loaded data parts (1 items) 2025.06.18 08:40:12.739053 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Found 72 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.739166 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loaded data parts (1 items) 2025.06.18 08:40:12.741060 [ 66712 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.741147 [ 66712 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.741246 [ 66712 ] {} AsyncLoader: Finish load job 'load table system.blob_storage_log' with status OK 2025.06.18 08:40:12.742081 [ 66712 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.744262 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_487_487_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.744320 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Active part 202506_487_487_0 on disk default 2025.06.18 08:40:12.745654 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_243_243_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.745762 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Active part 202506_243_243_0 on disk default 2025.06.18 08:40:12.746966 [ 66693 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.747053 [ 66693 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.747693 [ 66693 ] {} AsyncLoader: Finish load job 'load table system.error_log' with status OK 2025.06.18 08:40:12.747783 [ 66693 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.749742 [ 66717 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): loadDataPart: inserting 202506_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.749792 [ 66717 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Finished loading Active part 202506_2_2_0 on disk default 2025.06.18 08:40:12.750919 [ 66728 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): loadDataPart: inserting 202506_1_15_3 (state Active) into data_parts_indexes 2025.06.18 08:40:12.750914 [ 66721 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_36_36_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.750990 [ 66728 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Finished loading Active part 202506_1_15_3 on disk default 2025.06.18 08:40:12.751093 [ 66721 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Active part 202506_36_36_0 on disk default 2025.06.18 08:40:12.751418 [ 66723 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_38_38_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.752058 [ 66734 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_161_161_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.752122 [ 66734 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Active part 202506_161_161_0 on disk default 2025.06.18 08:40:12.751477 [ 66723 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Active part 202506_38_38_0 on disk default 2025.06.18 08:40:12.753180 [ 66731 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_486_486_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.753297 [ 66731 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Active part 202506_486_486_0 on disk default 2025.06.18 08:40:12.753898 [ 66711 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): loadDataPart: inserting 202506_16_16_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.754112 [ 66711 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Finished loading Active part 202506_16_16_0 on disk default 2025.06.18 08:40:12.754562 [ 66690 ] {} system.query_views_log (fbf2156c-4e3f-4023-b80a-5a47f6871a7e): Loaded data parts (2 items) 2025.06.18 08:40:12.755077 [ 66738 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_1_153_61 (state Active) into data_parts_indexes 2025.06.18 08:40:12.755170 [ 66738 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Active part 202506_1_153_61 on disk default 2025.06.18 08:40:12.755858 [ 66690 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.755923 [ 66690 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.756029 [ 66690 ] {} AsyncLoader: Finish load job 'load table system.query_views_log' with status OK 2025.06.18 08:40:12.756134 [ 66690 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.756510 [ 66736 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_35_35_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.756573 [ 66736 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Active part 202506_35_35_0 on disk default 2025.06.18 08:40:12.756793 [ 66729 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_1_34_7 (state Active) into data_parts_indexes 2025.06.18 08:40:12.756861 [ 66729 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Active part 202506_1_34_7 on disk default 2025.06.18 08:40:12.756922 [ 66724 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_7_7_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.757047 [ 66724 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Active part 20250618_7_7_0 on disk default 2025.06.18 08:40:12.757279 [ 66735 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): loadDataPart: inserting 202506_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.757356 [ 66684 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Found 6 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.757397 [ 66735 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Finished loading Active part 202506_1_1_0 on disk default 2025.06.18 08:40:12.757374 [ 66725 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_154_158_1 (state Active) into data_parts_indexes 2025.06.18 08:40:12.757516 [ 66684 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loaded data parts (3 items) 2025.06.18 08:40:12.757639 [ 66688 ] {} system.backup_log (0c0d3c14-53c8-407f-a011-fa142f24001e): Loaded data parts (2 items) 2025.06.18 08:40:12.757649 [ 66725 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Active part 202506_154_158_1 on disk default 2025.06.18 08:40:12.757963 [ 66682 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Found 9 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.758100 [ 66684 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.758103 [ 66682 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loaded data parts (6 items) 2025.06.18 08:40:12.758161 [ 66684 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.758253 [ 66688 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.758254 [ 66684 ] {} AsyncLoader: Finish load job 'load table system.asynchronous_insert_log' with status OK 2025.06.18 08:40:12.758311 [ 66688 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.758465 [ 66730 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_37_37_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.758487 [ 66684 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.758670 [ 66730 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Active part 202506_37_37_0 on disk default 2025.06.18 08:40:12.758692 [ 66688 ] {} AsyncLoader: Finish load job 'load table system.backup_log' with status OK 2025.06.18 08:40:12.758728 [ 66682 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.758747 [ 66688 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.758815 [ 66682 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.758881 [ 66682 ] {} AsyncLoader: Finish load job 'load table system.processors_profile_log' with status OK 2025.06.18 08:40:12.758919 [ 66682 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.758950 [ 66687 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Found 6 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.759090 [ 66687 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loaded data parts (5 items) 2025.06.18 08:40:12.759079 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_485_485_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.759212 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Active part 202506_485_485_0 on disk default 2025.06.18 08:40:12.759431 [ 66686 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_1_271_20 (state Active) into data_parts_indexes 2025.06.18 08:40:12.759497 [ 66686 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Active part 202506_1_271_20 on disk default 2025.06.18 08:40:12.759639 [ 66687 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.759684 [ 66687 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.759777 [ 66687 ] {} AsyncLoader: Finish load job 'load table system.session_log' with status OK 2025.06.18 08:40:12.759818 [ 66687 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.760038 [ 66737 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_474_484_2 (state Active) into data_parts_indexes 2025.06.18 08:40:12.760135 [ 66737 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Active part 202506_474_484_2 on disk default 2025.06.18 08:40:12.762096 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_473_81 (state Active) into data_parts_indexes 2025.06.18 08:40:12.762194 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Active part 202506_272_473_81 on disk default 2025.06.18 08:40:12.762637 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Found 184 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.762727 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loaded data parts (6 items) 2025.06.18 08:40:12.764023 [ 66685 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.764090 [ 66685 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.764181 [ 66685 ] {} AsyncLoader: Finish load job 'load table system.text_log' with status OK 2025.06.18 08:40:12.764242 [ 66685 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.767640 [ 66727 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_1_189_74 (state Active) into data_parts_indexes 2025.06.18 08:40:12.767716 [ 66727 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Active part 202506_1_189_74 on disk default 2025.06.18 08:40:12.768125 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Found 70 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.768182 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loaded data parts (6 items) 2025.06.18 08:40:12.769119 [ 66703 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.769170 [ 66703 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.769296 [ 66703 ] {} AsyncLoader: Finish load job 'load table system.zookeeper_log' with status OK 2025.06.18 08:40:12.769348 [ 66703 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.769452 [ 65992 ] {} AsyncLoader: Wait load job 'load table system.query_log' in ForegroundLoad 2025.06.18 08:40:12.772289 [ 66726 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_1_136_22 (state Active) into data_parts_indexes 2025.06.18 08:40:12.772346 [ 66726 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Active part 202506_1_136_22 on disk default 2025.06.18 08:40:12.772572 [ 66739 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_137_167_6 (state Active) into data_parts_indexes 2025.06.18 08:40:12.772650 [ 66739 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Active part 202506_137_167_6 on disk default 2025.06.18 08:40:12.773038 [ 66683 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Found 12 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.773099 [ 66683 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loaded data parts (2 items) 2025.06.18 08:40:12.774065 [ 66683 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.774114 [ 66683 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.774197 [ 66683 ] {} AsyncLoader: Finish load job 'load table system.query_log' with status OK 2025.06.18 08:40:12.774279 [ 66683 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.774361 [ 65992 ] {} AsyncLoader: Wait load job 'load table system.metric_log' in ForegroundLoad 2025.06.18 08:40:12.843494 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading data parts 2025.06.18 08:40:12.845512 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:12.845611 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Will load 5 parts using up to 64 threads 2025.06.18 08:40:12.845908 [ 66715 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Active part 202506_225_225_0 from disk default 2025.06.18 08:40:12.846032 [ 66718 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Active part 202506_223_223_0 from disk default 2025.06.18 08:40:12.846091 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Active part 202506_222_222_0 from disk default 2025.06.18 08:40:12.846054 [ 66741 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Active part 202506_224_224_0 from disk default 2025.06.18 08:40:12.846123 [ 66714 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Active part 202506_1_221_44 from disk default 2025.06.18 08:40:12.945851 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_222_222_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.945942 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Active part 202506_222_222_0 on disk default 2025.06.18 08:40:12.946007 [ 66714 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_221_44 (state Active) into data_parts_indexes 2025.06.18 08:40:12.946082 [ 66714 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Active part 202506_1_221_44 on disk default 2025.06.18 08:40:12.947521 [ 66715 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_225_225_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.947610 [ 66715 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Active part 202506_225_225_0 on disk default 2025.06.18 08:40:12.961651 [ 66741 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_224_224_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.961740 [ 66718 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_223_223_0 (state Active) into data_parts_indexes 2025.06.18 08:40:12.961746 [ 66741 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Active part 202506_224_224_0 on disk default 2025.06.18 08:40:12.961833 [ 66718 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Active part 202506_223_223_0 on disk default 2025.06.18 08:40:12.966738 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Found 60 outdated data parts. They will be loaded asynchronously 2025.06.18 08:40:12.966968 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loaded data parts (5 items) 2025.06.18 08:40:12.973168 [ 66696 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:12.973298 [ 66696 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:12.973453 [ 66696 ] {} AsyncLoader: Finish load job 'load table system.metric_log' with status OK 2025.06.18 08:40:12.973528 [ 66696 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:12.973601 [ 66696 ] {} AsyncLoader: Change current priority: 0 -> none 2025.06.18 08:40:12.984363 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.zookeeper_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984435 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.transactions_info_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984479 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.trace_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984518 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.session_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984558 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.s3queue_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984588 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.query_views_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984614 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.query_thread_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984641 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.filesystem_cache_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984673 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.processors_profile_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984700 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.query_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984726 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.opentelemetry_span_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984751 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.text_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984776 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.metric_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984805 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.backup_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984831 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.part_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984855 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.error_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984880 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.asynchronous_insert_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984905 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.crash_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984935 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.blob_storage_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984962 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup table system.asynchronous_metric_log': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.984987 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup Atomic database system': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.985019 [ 65992 ] {} AsyncLoader: Prioritize load job 'startup Ordinary database system': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:12.985170 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.backup_log' into ForegroundLoad 2025.06.18 08:40:12.985213 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.query_thread_log' into ForegroundLoad 2025.06.18 08:40:12.985253 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.filesystem_cache_log' into ForegroundLoad 2025.06.18 08:40:12.985278 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.metric_log' into ForegroundLoad 2025.06.18 08:40:12.985302 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.query_log' into ForegroundLoad 2025.06.18 08:40:12.985327 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.opentelemetry_span_log' into ForegroundLoad 2025.06.18 08:40:12.985356 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.query_views_log' into ForegroundLoad 2025.06.18 08:40:12.985381 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.zookeeper_log' into ForegroundLoad 2025.06.18 08:40:12.985404 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.session_log' into ForegroundLoad 2025.06.18 08:40:12.985428 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.transactions_info_log' into ForegroundLoad 2025.06.18 08:40:12.985450 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.trace_log' into ForegroundLoad 2025.06.18 08:40:12.985476 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.text_log' into ForegroundLoad 2025.06.18 08:40:12.985499 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.crash_log' into ForegroundLoad 2025.06.18 08:40:12.985521 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database system' into ForegroundLoad 2025.06.18 08:40:12.985552 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.part_log' into ForegroundLoad 2025.06.18 08:40:12.985576 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database system' into ForegroundLoad 2025.06.18 08:40:12.985604 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.error_log' into ForegroundLoad 2025.06.18 08:40:12.985628 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.processors_profile_log' into ForegroundLoad 2025.06.18 08:40:12.985650 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.s3queue_log' into ForegroundLoad 2025.06.18 08:40:12.985672 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.asynchronous_insert_log' into ForegroundLoad 2025.06.18 08:40:12.985695 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.blob_storage_log' into ForegroundLoad 2025.06.18 08:40:12.985723 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table system.asynchronous_metric_log' into ForegroundLoad 2025.06.18 08:40:12.985758 [ 65992 ] {} AsyncLoader: Change current priority: none -> 0 2025.06.18 08:40:12.985793 [ 65992 ] {} AsyncLoader: Spawn loader worker #1 in ForegroundLoad 2025.06.18 08:40:12.985883 [ 65992 ] {} AsyncLoader: Spawn loader worker #2 in ForegroundLoad 2025.06.18 08:40:12.985958 [ 65992 ] {} AsyncLoader: Spawn loader worker #3 in ForegroundLoad 2025.06.18 08:40:12.986020 [ 65992 ] {} AsyncLoader: Spawn loader worker #4 in ForegroundLoad 2025.06.18 08:40:12.986062 [ 65992 ] {} AsyncLoader: Spawn loader worker #5 in ForegroundLoad 2025.06.18 08:40:12.986109 [ 65992 ] {} AsyncLoader: Spawn loader worker #6 in ForegroundLoad 2025.06.18 08:40:12.986201 [ 65992 ] {} AsyncLoader: Spawn loader worker #7 in ForegroundLoad 2025.06.18 08:40:12.986299 [ 65992 ] {} AsyncLoader: Spawn loader worker #8 in ForegroundLoad 2025.06.18 08:40:12.986345 [ 65992 ] {} AsyncLoader: Spawn loader worker #9 in ForegroundLoad 2025.06.18 08:40:12.986389 [ 65992 ] {} AsyncLoader: Spawn loader worker #10 in ForegroundLoad 2025.06.18 08:40:12.986431 [ 65992 ] {} AsyncLoader: Spawn loader worker #11 in ForegroundLoad 2025.06.18 08:40:12.986488 [ 65992 ] {} AsyncLoader: Spawn loader worker #12 in ForegroundLoad 2025.06.18 08:40:12.986581 [ 65992 ] {} AsyncLoader: Spawn loader worker #13 in ForegroundLoad 2025.06.18 08:40:12.986659 [ 65992 ] {} AsyncLoader: Spawn loader worker #14 in ForegroundLoad 2025.06.18 08:40:12.986746 [ 65992 ] {} AsyncLoader: Spawn loader worker #15 in ForegroundLoad 2025.06.18 08:40:12.986801 [ 65992 ] {} AsyncLoader: Spawn loader worker #16 in ForegroundLoad 2025.06.18 08:40:12.986925 [ 65992 ] {} AsyncLoader: Wait load job 'startup table system.zookeeper_log' in ForegroundLoad 2025.06.18 08:40:12.986953 [ 66711 ] {} AsyncLoader: Execute load job 'startup table system.backup_log' in ForegroundLoad 2025.06.18 08:40:12.987062 [ 66720 ] {} AsyncLoader: Execute load job 'startup table system.query_thread_log' in ForegroundLoad 2025.06.18 08:40:12.987165 [ 66694 ] {} AsyncLoader: Execute load job 'startup table system.filesystem_cache_log' in ForegroundLoad 2025.06.18 08:40:12.987264 [ 66710 ] {} AsyncLoader: Execute load job 'startup table system.metric_log' in ForegroundLoad 2025.06.18 08:40:12.987377 [ 66689 ] {} AsyncLoader: Execute load job 'startup table system.query_log' in ForegroundLoad 2025.06.18 08:40:12.987572 [ 66712 ] {} AsyncLoader: Execute load job 'startup table system.opentelemetry_span_log' in ForegroundLoad 2025.06.18 08:40:12.987744 [ 66719 ] {} AsyncLoader: Execute load job 'startup table system.query_views_log' in ForegroundLoad 2025.06.18 08:40:12.987910 [ 66716 ] {} AsyncLoader: Execute load job 'startup table system.zookeeper_log' in ForegroundLoad 2025.06.18 08:40:12.988008 [ 66693 ] {} AsyncLoader: Execute load job 'startup table system.session_log' in ForegroundLoad 2025.06.18 08:40:12.988102 [ 66717 ] {} AsyncLoader: Execute load job 'startup table system.transactions_info_log' in ForegroundLoad 2025.06.18 08:40:12.988247 [ 66728 ] {} AsyncLoader: Execute load job 'startup table system.trace_log' in ForegroundLoad 2025.06.18 08:40:12.988372 [ 66721 ] {} AsyncLoader: Execute load job 'startup table system.text_log' in ForegroundLoad 2025.06.18 08:40:12.988468 [ 66032 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading 12 outdated data parts asynchronously 2025.06.18 08:40:12.988506 [ 66734 ] {} AsyncLoader: Execute load job 'startup table system.crash_log' in ForegroundLoad 2025.06.18 08:40:12.988629 [ 66031 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading 70 outdated data parts asynchronously 2025.06.18 08:40:12.988693 [ 66731 ] {} AsyncLoader: Execute load job 'startup table system.part_log' in ForegroundLoad 2025.06.18 08:40:12.988785 [ 66738 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_167_167_0 from disk default 2025.06.18 08:40:12.988793 [ 66717 ] {} AsyncLoader: Finish load job 'startup table system.transactions_info_log' with status OK 2025.06.18 08:40:12.988834 [ 66690 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_166_166_0 from disk default 2025.06.18 08:40:12.988860 [ 66036 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading 77 outdated data parts asynchronously 2025.06.18 08:40:12.988920 [ 66736 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_241_241_0 from disk default 2025.06.18 08:40:12.988905 [ 66717 ] {} AsyncLoader: Execute load job 'startup table system.error_log' in ForegroundLoad 2025.06.18 08:40:12.989033 [ 66729 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_164_164_0 from disk default 2025.06.18 08:40:12.989049 [ 66725 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_240_240_0 from disk default 2025.06.18 08:40:12.989022 [ 66724 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_165_165_0 from disk default 2025.06.18 08:40:12.989210 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_237_237_0 from disk default 2025.06.18 08:40:12.989211 [ 66688 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_163_163_0 from disk default 2025.06.18 08:40:12.989116 [ 66684 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_239_239_0 from disk default 2025.06.18 08:40:12.989361 [ 66730 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_162_162_0 from disk default 2025.06.18 08:40:12.989390 [ 66733 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_236_236_0 from disk default 2025.06.18 08:40:12.989411 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_265_265_0 from disk default 2025.06.18 08:40:12.989429 [ 66687 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_161_161_0 from disk default 2025.06.18 08:40:12.989518 [ 66737 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_264_264_0 from disk default 2025.06.18 08:40:12.989854 [ 66735 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_238_238_0 from disk default 2025.06.18 08:40:12.989322 [ 66038 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading 13 outdated data parts asynchronously 2025.06.18 08:40:12.990332 [ 66685 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_160_160_0 from disk default 2025.06.18 08:40:12.990448 [ 66042 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading 6 outdated data parts asynchronously 2025.06.18 08:40:12.990656 [ 66686 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_263_263_0 from disk default 2025.06.18 08:40:12.990663 [ 66721 ] {} AsyncLoader: Finish load job 'startup table system.text_log' with status OK 2025.06.18 08:40:12.999074 [ 66739 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_235_235_0 from disk default 2025.06.18 08:40:12.999108 [ 66726 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_145_145_0 from disk default 2025.06.18 08:40:12.999123 [ 66703 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_262_262_0 from disk default 2025.06.18 08:40:12.999129 [ 66714 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_261_261_0 from disk default 2025.06.18 08:40:12.999143 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_234_234_0 from disk default 2025.06.18 08:40:12.999165 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_158_158_0 from disk default 2025.06.18 08:40:12.999169 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_233_233_0 from disk default 2025.06.18 08:40:12.999173 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_260_260_0 from disk default 2025.06.18 08:40:12.999201 [ 66740 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_159_159_0 from disk default 2025.06.18 08:40:12.999457 [ 66721 ] {} AsyncLoader: Execute load job 'startup table system.processors_profile_log' in ForegroundLoad 2025.06.18 08:40:12.999442 [ 66035 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading 6 outdated data parts asynchronously 2025.06.18 08:40:12.999471 [ 66722 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_144_144_0 from disk default 2025.06.18 08:40:12.991823 [ 66040 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading 60 outdated data parts asynchronously 2025.06.18 08:40:12.999186 [ 66741 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_137_157_4 from disk default 2025.06.18 08:40:13.000106 [ 66050 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading 72 outdated data parts asynchronously 2025.06.18 08:40:12.999041 [ 66045 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading 184 outdated data parts asynchronously 2025.06.18 08:40:13.002591 [ 66711 ] {} AsyncLoader: Finish load job 'startup table system.backup_log' with status OK 2025.06.18 08:40:13.002957 [ 66711 ] {} AsyncLoader: Execute load job 'startup table system.s3queue_log' in ForegroundLoad 2025.06.18 08:40:13.003497 [ 66694 ] {} AsyncLoader: Finish load job 'startup table system.filesystem_cache_log' with status OK 2025.06.18 08:40:13.003619 [ 66694 ] {} AsyncLoader: Execute load job 'startup table system.asynchronous_insert_log' in ForegroundLoad 2025.06.18 08:40:13.004097 [ 66720 ] {} AsyncLoader: Finish load job 'startup table system.query_thread_log' with status OK 2025.06.18 08:40:13.004241 [ 66720 ] {} AsyncLoader: Execute load job 'startup table system.blob_storage_log' in ForegroundLoad 2025.06.18 08:40:13.004536 [ 66689 ] {} AsyncLoader: Finish load job 'startup table system.query_log' with status OK 2025.06.18 08:40:13.004632 [ 66689 ] {} AsyncLoader: Execute load job 'startup table system.asynchronous_metric_log' in ForegroundLoad 2025.06.18 08:40:13.004731 [ 66716 ] {} AsyncLoader: Finish load job 'startup table system.zookeeper_log' with status OK 2025.06.18 08:40:13.004806 [ 66716 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.005103 [ 66723 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.005253 [ 66712 ] {} AsyncLoader: Finish load job 'startup table system.opentelemetry_span_log' with status OK 2025.06.18 08:40:13.005331 [ 66712 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.005422 [ 66710 ] {} AsyncLoader: Finish load job 'startup table system.metric_log' with status OK 2025.06.18 08:40:13.006047 [ 66710 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.006171 [ 66693 ] {} AsyncLoader: Finish load job 'startup table system.session_log' with status OK 2025.06.18 08:40:13.006274 [ 66693 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.006411 [ 66719 ] {} AsyncLoader: Finish load job 'startup table system.query_views_log' with status OK 2025.06.18 08:40:13.006487 [ 66719 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.010646 [ 66731 ] {} AsyncLoader: Finish load job 'startup table system.part_log' with status OK 2025.06.18 08:40:13.010719 [ 66731 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.010843 [ 66691 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.010971 [ 66734 ] {} AsyncLoader: Finish load job 'startup table system.crash_log' with status OK 2025.06.18 08:40:13.012223 [ 66734 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.010270 [ 66053 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading 6 outdated data parts asynchronously 2025.06.18 08:40:13.011146 [ 66056 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading 9 outdated data parts asynchronously 2025.06.18 08:40:13.013179 [ 66711 ] {} AsyncLoader: Finish load job 'startup table system.s3queue_log' with status OK 2025.06.18 08:40:13.013690 [ 66711 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.014053 [ 66728 ] {} AsyncLoader: Finish load job 'startup table system.trace_log' with status OK 2025.06.18 08:40:13.014253 [ 66728 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.014373 [ 65992 ] {} AsyncLoader: Wait load job 'startup table system.processors_profile_log' in ForegroundLoad 2025.06.18 08:40:13.015357 [ 66721 ] {} AsyncLoader: Finish load job 'startup table system.processors_profile_log' with status OK 2025.06.18 08:40:13.015481 [ 66721 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.016977 [ 66720 ] {} AsyncLoader: Finish load job 'startup table system.blob_storage_log' with status OK 2025.06.18 08:40:13.017253 [ 66059 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading 90 outdated data parts asynchronously 2025.06.18 08:40:13.018185 [ 66720 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.018313 [ 66717 ] {} AsyncLoader: Finish load job 'startup table system.error_log' with status OK 2025.06.18 08:40:13.018321 [ 66719 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Outdated part 202506_33_33_0 from disk default 2025.06.18 08:40:13.019013 [ 66731 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Outdated part 202506_106_106_0 from disk default 2025.06.18 08:40:13.019492 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_239_239_0 from disk default 2025.06.18 08:40:13.019336 [ 66717 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.019997 [ 66694 ] {} AsyncLoader: Finish load job 'startup table system.asynchronous_insert_log' with status OK 2025.06.18 08:40:13.020672 [ 66694 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.018397 [ 66746 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Outdated part 202506_34_34_0 from disk default 2025.06.18 08:40:13.026725 [ 66689 ] {} AsyncLoader: Finish load job 'startup table system.asynchronous_metric_log' with status OK 2025.06.18 08:40:13.026871 [ 66689 ] {} AsyncLoader: Spawn loader worker #2 in ForegroundLoad 2025.06.18 08:40:13.041316 [ 66689 ] {} AsyncLoader: Execute load job 'startup Ordinary database system' in ForegroundLoad 2025.06.18 08:40:13.041435 [ 66689 ] {} AsyncLoader: Finish load job 'startup Ordinary database system' with status OK 2025.06.18 08:40:13.041520 [ 66689 ] {} AsyncLoader: Spawn loader worker #3 in ForegroundLoad 2025.06.18 08:40:13.041748 [ 66689 ] {} AsyncLoader: Execute load job 'startup Atomic database system' in ForegroundLoad 2025.06.18 08:40:13.042189 [ 66712 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.042203 [ 65992 ] {} AsyncLoader: Wait load job 'startup Atomic database system' in ForegroundLoad 2025.06.18 08:40:13.044910 [ 66723 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.047379 [ 66689 ] {} AsyncLoader: Finish load job 'startup Atomic database system' with status OK 2025.06.18 08:40:13.047515 [ 66689 ] {} AsyncLoader: Stop worker in ForegroundLoad 2025.06.18 08:40:13.047597 [ 66689 ] {} AsyncLoader: Change current priority: 0 -> none 2025.06.18 08:40:13.058515 [ 65992 ] {} SystemLog: Creating system.query_log from query_log 2025.06.18 08:40:13.081896 [ 66731 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_106_106_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.081909 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_239_239_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.081910 [ 66726 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_145_145_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.081934 [ 66733 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_236_236_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.081950 [ 66746 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_34_34_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.081989 [ 66714 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_261_261_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.082091 [ 66722 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_144_144_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.082212 [ 66686 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_263_263_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.082474 [ 66686 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_263_263_0 on disk default 2025.06.18 08:40:13.082478 [ 66731 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Outdated part 202506_106_106_0 on disk default 2025.06.18 08:40:13.082472 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_239_239_0 on disk default 2025.06.18 08:40:13.082711 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_239_239_0 2025.06.18 08:40:13.082473 [ 66714 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_261_261_0 on disk default 2025.06.18 08:40:13.082472 [ 66726 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_145_145_0 on disk default 2025.06.18 08:40:13.082713 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_263_263_0 2025.06.18 08:40:13.082942 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_261_261_0 2025.06.18 08:40:13.083032 [ 66719 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_33_33_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.082497 [ 66722 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_144_144_0 on disk default 2025.06.18 08:40:13.082980 [ 66737 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_264_264_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.083092 [ 66719 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Outdated part 202506_33_33_0 on disk default 2025.06.18 08:40:13.083177 [ 66737 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_264_264_0 on disk default 2025.06.18 08:40:13.083198 [ 66703 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_262_262_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.083251 [ 66703 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_262_262_0 on disk default 2025.06.18 08:40:13.083298 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_264_264_0 2025.06.18 08:40:13.083308 [ 66696 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_259_259_0 from disk default 2025.06.18 08:40:13.083326 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_33_33_0 2025.06.18 08:40:13.083333 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_262_262_0 2025.06.18 08:40:13.082471 [ 66733 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_236_236_0 on disk default 2025.06.18 08:40:13.083467 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.part_log (630dea68-bd65-4118-a62e-459157383449), part: 202506_106_106_0 2025.06.18 08:40:13.083590 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_144_144_0 2025.06.18 08:40:13.083695 [ 66746 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Outdated part 202506_34_34_0 on disk default 2025.06.18 08:40:13.083732 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_145_145_0 2025.06.18 08:40:13.082235 [ 66684 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_239_239_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.083844 [ 66684 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_239_239_0 on disk default 2025.06.18 08:40:13.083858 [ 66725 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_240_240_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.083920 [ 66725 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_240_240_0 on disk default 2025.06.18 08:40:13.083969 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_237_237_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.084065 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_237_237_0 on disk default 2025.06.18 08:40:13.084124 [ 66736 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_241_241_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.084185 [ 66736 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_241_241_0 on disk default 2025.06.18 08:40:13.084267 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_34_34_0 2025.06.18 08:40:13.084567 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_240_240_0 2025.06.18 08:40:13.084601 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_239_239_0 2025.06.18 08:40:13.084603 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_236_236_0 2025.06.18 08:40:13.084611 [ 66736 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_241_241_0 2025.06.18 08:40:13.084873 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_237_237_0 2025.06.18 08:40:13.085151 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_265_265_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.085200 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_265_265_0 on disk default 2025.06.18 08:40:13.085278 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_265_265_0 2025.06.18 08:40:13.086612 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_233_233_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.086708 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_233_233_0 on disk default 2025.06.18 08:40:13.086825 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_233_233_0 2025.06.18 08:40:13.087272 [ 66685 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_160_160_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.087347 [ 66685 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_160_160_0 on disk default 2025.06.18 08:40:13.087362 [ 66741 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_137_157_4 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.087424 [ 66741 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_137_157_4 on disk default 2025.06.18 08:40:13.087481 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_160_160_0 2025.06.18 08:40:13.087499 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_137_157_4 2025.06.18 08:40:13.087762 [ 66739 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_235_235_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.087769 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_260_260_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.087837 [ 66739 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_235_235_0 on disk default 2025.06.18 08:40:13.087860 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_260_260_0 on disk default 2025.06.18 08:40:13.087963 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_235_235_0 2025.06.18 08:40:13.087985 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_260_260_0 2025.06.18 08:40:13.088056 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_234_234_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.088125 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_234_234_0 on disk default 2025.06.18 08:40:13.088191 [ 66688 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_163_163_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.088202 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_234_234_0 2025.06.18 08:40:13.088287 [ 66688 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_163_163_0 on disk default 2025.06.18 08:40:13.088401 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_163_163_0 2025.06.18 08:40:13.089205 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_282_282_0 from disk default 2025.06.18 08:40:13.089331 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_484_484_0 from disk default 2025.06.18 08:40:13.089340 [ 66738 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_167_167_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.089604 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_158_158_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.089667 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_158_158_0 on disk default 2025.06.18 08:40:13.089732 [ 66738 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_167_167_0 on disk default 2025.06.18 08:40:13.089741 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_158_158_0 2025.06.18 08:40:13.089862 [ 66738 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_167_167_0 2025.06.18 08:40:13.089835 [ 66750 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_158_158_0 from disk default 2025.06.18 08:40:13.089877 [ 66748 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Outdated part 202506_32_32_0 from disk default 2025.06.18 08:40:13.089925 [ 66734 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_281_281_0 from disk default 2025.06.18 08:40:13.089965 [ 66728 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Outdated part 202506_31_31_0 from disk default 2025.06.18 08:40:13.090139 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_483_483_0 from disk default 2025.06.18 08:40:13.090174 [ 66696 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_259_259_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.090209 [ 66740 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_159_159_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.090229 [ 66696 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_259_259_0 on disk default 2025.06.18 08:40:13.090261 [ 66740 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_159_159_0 on disk default 2025.06.18 08:40:13.090296 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_259_259_0 2025.06.18 08:40:13.090340 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_159_159_0 2025.06.18 08:40:13.090444 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_258_258_0 from disk default 2025.06.18 08:40:13.090460 [ 66740 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Outdated part 20250618_6_6_0 from disk default 2025.06.18 08:40:13.090526 [ 66710 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Outdated part 20250618_5_5_0 from disk default 2025.06.18 08:40:13.090609 [ 66712 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_232_232_0 from disk default 2025.06.18 08:40:13.090618 [ 66690 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_166_166_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.090633 [ 66689 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_238_238_0 from disk default 2025.06.18 08:40:13.090735 [ 66690 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_166_166_0 on disk default 2025.06.18 08:40:13.090758 [ 66721 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_221_221_0 from disk default 2025.06.18 08:40:13.090754 [ 66723 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loading Outdated part 202506_137_162_5 from disk default 2025.06.18 08:40:13.090916 [ 66731 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Outdated part 202506_105_105_0 from disk default 2025.06.18 08:40:13.091606 [ 66741 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Outdated part 202506_30_30_0 from disk default 2025.06.18 08:40:13.091710 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_282_282_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.091737 [ 66687 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_161_161_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.091758 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_282_282_0 on disk default 2025.06.18 08:40:13.091834 [ 66687 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_161_161_0 on disk default 2025.06.18 08:40:13.092063 [ 66688 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_257_257_0 from disk default 2025.06.18 08:40:13.092076 [ 66739 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Outdated part 20250618_4_4_0 from disk default 2025.06.18 08:40:13.092615 [ 66690 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_166_166_0 2025.06.18 08:40:13.092972 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_256_256_0 from disk default 2025.06.18 08:40:13.093009 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_255_255_0 from disk default 2025.06.18 08:40:13.093472 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_161_161_0 2025.06.18 08:40:13.093885 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_282_282_0 2025.06.18 08:40:13.094222 [ 66703 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_236_236_0 from disk default 2025.06.18 08:40:13.094522 [ 66683 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_235_235_0 from disk default 2025.06.18 08:40:13.094596 [ 66727 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Outdated part 202506_104_104_0 from disk default 2025.06.18 08:40:13.097005 [ 66746 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_482_482_0 from disk default 2025.06.18 08:40:13.097804 [ 66734 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_281_281_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.097869 [ 66734 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_281_281_0 on disk default 2025.06.18 08:40:13.097950 [ 66725 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Outdated part 20250618_3_3_0 from disk default 2025.06.18 08:40:13.094127 [ 66747 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_237_237_0 from disk default 2025.06.18 08:40:13.098232 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_281_281_0 2025.06.18 08:40:13.098982 [ 66689 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_238_238_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.099031 [ 66689 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_238_238_0 on disk default 2025.06.18 08:40:13.099094 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_238_238_0 2025.06.18 08:40:13.099199 [ 66684 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_220_220_0 from disk default 2025.06.18 08:40:13.099597 [ 66696 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_157_157_0 from disk default 2025.06.18 08:40:13.099626 [ 66738 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_254_254_0 from disk default 2025.06.18 08:40:13.099697 [ 66710 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_5_5_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.099742 [ 66710 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Outdated part 20250618_5_5_0 on disk default 2025.06.18 08:40:13.100083 [ 66733 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_253_253_0 from disk default 2025.06.18 08:40:13.100251 [ 66720 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_280_280_0 from disk default 2025.06.18 08:40:13.102790 [ 66683 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_235_235_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.102834 [ 66683 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_235_235_0 on disk default 2025.06.18 08:40:13.124165 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b), part: 20250618_5_5_0 2025.06.18 08:40:13.124564 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_235_235_0 2025.06.18 08:40:13.124626 [ 66736 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_252_252_0 from disk default 2025.06.18 08:40:13.125212 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_484_484_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.125259 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_484_484_0 on disk default 2025.06.18 08:40:13.126013 [ 66703 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_236_236_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.126017 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_484_484_0 2025.06.18 08:40:13.126074 [ 66703 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_236_236_0 on disk default 2025.06.18 08:40:13.126141 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_236_236_0 2025.06.18 08:40:13.126242 [ 66740 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_6_6_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.126289 [ 66740 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Outdated part 20250618_6_6_0 on disk default 2025.06.18 08:40:13.126687 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_234_234_0 from disk default 2025.06.18 08:40:13.127140 [ 66703 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loading Outdated part 202506_1_29_6 from disk default 2025.06.18 08:40:13.127278 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b), part: 20250618_6_6_0 2025.06.18 08:40:13.127280 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_233_233_0 from disk default 2025.06.18 08:40:13.128607 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_231_231_0 from disk default 2025.06.18 08:40:13.129102 [ 66735 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_238_238_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.129153 [ 66735 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_238_238_0 on disk default 2025.06.18 08:40:13.130314 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_238_238_0 2025.06.18 08:40:13.131679 [ 66735 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_251_251_0 from disk default 2025.06.18 08:40:13.134050 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_234_234_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.134101 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_234_234_0 on disk default 2025.06.18 08:40:13.134158 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_234_234_0 2025.06.18 08:40:13.134828 [ 66715 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_156_156_0 from disk default 2025.06.18 08:40:13.135041 [ 66729 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_164_164_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.135105 [ 66729 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_164_164_0 on disk default 2025.06.18 08:40:13.135188 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_164_164_0 2025.06.18 08:40:13.135705 [ 66731 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_105_105_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.135756 [ 66731 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Outdated part 202506_105_105_0 on disk default 2025.06.18 08:40:13.136015 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.part_log (630dea68-bd65-4118-a62e-459157383449), part: 202506_105_105_0 2025.06.18 08:40:13.135859 [ 66747 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_237_237_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.136651 [ 66729 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_250_250_0 from disk default 2025.06.18 08:40:13.136929 [ 66720 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_280_280_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.136980 [ 66720 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_280_280_0 on disk default 2025.06.18 08:40:13.136891 [ 66750 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_158_158_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.136907 [ 66747 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_237_237_0 on disk default 2025.06.18 08:40:13.137201 [ 66720 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_280_280_0 2025.06.18 08:40:13.137409 [ 66685 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_232_232_0 from disk default 2025.06.18 08:40:13.137659 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_233_233_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.137782 [ 66720 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_219_219_0 from disk default 2025.06.18 08:40:13.137619 [ 66750 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_158_158_0 on disk default 2025.06.18 08:40:13.137964 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_258_258_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.138410 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_258_258_0 on disk default 2025.06.18 08:40:13.137721 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_233_233_0 on disk default 2025.06.18 08:40:13.138784 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_258_258_0 2025.06.18 08:40:13.138992 [ 66722 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_279_279_0 from disk default 2025.06.18 08:40:13.138651 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_237_237_0 2025.06.18 08:40:13.139988 [ 66746 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_482_482_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.140040 [ 66746 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_482_482_0 on disk default 2025.06.18 08:40:13.140208 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_255_255_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.140704 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_482_482_0 2025.06.18 08:40:13.140725 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_231_231_0 from disk default 2025.06.18 08:40:13.140848 [ 66728 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_31_31_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.140901 [ 66728 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Outdated part 202506_31_31_0 on disk default 2025.06.18 08:40:13.140968 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_31_31_0 2025.06.18 08:40:13.141853 [ 66738 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_254_254_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.141046 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_233_233_0 2025.06.18 08:40:13.142077 [ 66690 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_218_218_0 from disk default 2025.06.18 08:40:13.142230 [ 66738 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_254_254_0 on disk default 2025.06.18 08:40:13.142240 [ 66733 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_253_253_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.142296 [ 66733 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_253_253_0 on disk default 2025.06.18 08:40:13.142320 [ 66738 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_254_254_0 2025.06.18 08:40:13.141928 [ 66750 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_158_158_0 2025.06.18 08:40:13.142395 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_253_253_0 2025.06.18 08:40:13.141975 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_255_255_0 on disk default 2025.06.18 08:40:13.143151 [ 66716 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_230_230_0 from disk default 2025.06.18 08:40:13.144100 [ 66741 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_30_30_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.144140 [ 66729 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_250_250_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.144152 [ 66741 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Outdated part 202506_30_30_0 on disk default 2025.06.18 08:40:13.144212 [ 66729 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_250_250_0 on disk default 2025.06.18 08:40:13.144257 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_30_30_0 2025.06.18 08:40:13.144285 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_250_250_0 2025.06.18 08:40:13.144549 [ 66689 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Outdated part 20250618_2_2_0 from disk default 2025.06.18 08:40:13.145081 [ 66715 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_156_156_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.145128 [ 66715 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_156_156_0 on disk default 2025.06.18 08:40:13.144470 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_229_229_0 from disk default 2025.06.18 08:40:13.145415 [ 66736 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_252_252_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.145466 [ 66736 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_252_252_0 on disk default 2025.06.18 08:40:13.145315 [ 66738 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_217_217_0 from disk default 2025.06.18 08:40:13.145705 [ 66729 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_249_249_0 from disk default 2025.06.18 08:40:13.146060 [ 66693 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loading Outdated part 20250618_1_1_0 from disk default 2025.06.18 08:40:13.146218 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_156_156_0 2025.06.18 08:40:13.146253 [ 66736 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_252_252_0 2025.06.18 08:40:13.146301 [ 66696 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_157_157_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.146350 [ 66696 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_157_157_0 on disk default 2025.06.18 08:40:13.145946 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_255_255_0 2025.06.18 08:40:13.146623 [ 66722 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_279_279_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.146681 [ 66722 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_279_279_0 on disk default 2025.06.18 08:40:13.146758 [ 66750 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_228_228_0 from disk default 2025.06.18 08:40:13.147262 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_256_256_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.147306 [ 66732 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Outdated part 202506_103_103_0 from disk default 2025.06.18 08:40:13.147314 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_256_256_0 on disk default 2025.06.18 08:40:13.147415 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_231_231_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.147467 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_231_231_0 on disk default 2025.06.18 08:40:13.147483 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_157_157_0 2025.06.18 08:40:13.147508 [ 66685 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_232_232_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.147514 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_279_279_0 2025.06.18 08:40:13.147578 [ 66685 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_232_232_0 on disk default 2025.06.18 08:40:13.148027 [ 66737 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Outdated part 202506_102_102_0 from disk default 2025.06.18 08:40:13.148061 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_231_231_0 2025.06.18 08:40:13.148130 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_256_256_0 2025.06.18 08:40:13.148169 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_232_232_0 2025.06.18 08:40:13.148823 [ 66718 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_155_155_0 from disk default 2025.06.18 08:40:13.149320 [ 66739 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_4_4_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.149376 [ 66739 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Outdated part 20250618_4_4_0 on disk default 2025.06.18 08:40:13.149452 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b), part: 20250618_4_4_0 2025.06.18 08:40:13.149471 [ 66735 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_251_251_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.149521 [ 66735 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_251_251_0 on disk default 2025.06.18 08:40:13.149596 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_251_251_0 2025.06.18 08:40:13.149593 [ 66748 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_32_32_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.149696 [ 66748 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Outdated part 202506_32_32_0 on disk default 2025.06.18 08:40:13.149762 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_32_32_0 2025.06.18 08:40:13.149866 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_230_230_0 from disk default 2025.06.18 08:40:13.155050 [ 66716 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_230_230_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.155108 [ 66716 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_230_230_0 on disk default 2025.06.18 08:40:13.158124 [ 66727 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_104_104_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.157373 [ 66730 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_162_162_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.158178 [ 66727 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Outdated part 202506_104_104_0 on disk default 2025.06.18 08:40:13.158309 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_230_230_0 2025.06.18 08:40:13.158361 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_278_278_0 from disk default 2025.06.18 08:40:13.158385 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.part_log (630dea68-bd65-4118-a62e-459157383449), part: 202506_104_104_0 2025.06.18 08:40:13.158767 [ 66725 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_3_3_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.158822 [ 66725 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Outdated part 20250618_3_3_0 on disk default 2025.06.18 08:40:13.158889 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b), part: 20250618_3_3_0 2025.06.18 08:40:13.160881 [ 66703 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): loadDataPart: inserting 202506_1_29_6 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.160936 [ 66703 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Finished loading Outdated part 202506_1_29_6 on disk default 2025.06.18 08:40:13.160452 [ 66730 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_162_162_0 on disk default 2025.06.18 08:40:13.160956 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_248_248_0 from disk default 2025.06.18 08:40:13.161011 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_1_29_6 2025.06.18 08:40:13.161666 [ 66042 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Loaded 6 outdated data parts asynchronously 2025.06.18 08:40:13.161678 [ 66686 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_481_481_0 from disk default 2025.06.18 08:40:13.161853 [ 66687 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_227_227_0 from disk default 2025.06.18 08:40:13.161919 [ 66688 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_257_257_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.161974 [ 66688 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_257_257_0 on disk default 2025.06.18 08:40:13.162054 [ 66728 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_229_229_0 from disk default 2025.06.18 08:40:13.162482 [ 66689 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_2_2_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.162576 [ 66689 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Outdated part 20250618_2_2_0 on disk default 2025.06.18 08:40:13.162740 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_231_231_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.162798 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_231_231_0 on disk default 2025.06.18 08:40:13.162940 [ 66734 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_228_228_0 from disk default 2025.06.18 08:40:13.162953 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_162_162_0 2025.06.18 08:40:13.162945 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_257_257_0 2025.06.18 08:40:13.163152 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b), part: 20250618_2_2_0 2025.06.18 08:40:13.163569 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_231_231_0 2025.06.18 08:40:13.163569 [ 66714 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_227_227_0 from disk default 2025.06.18 08:40:13.163693 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_277_277_0 from disk default 2025.06.18 08:40:13.164310 [ 66724 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_165_165_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.164365 [ 66724 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_165_165_0 on disk default 2025.06.18 08:40:13.164436 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_165_165_0 2025.06.18 08:40:13.164379 [ 65992 ] {} SystemLog: Creating system.query_thread_log from query_thread_log 2025.06.18 08:40:13.164532 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_276_276_0 from disk default 2025.06.18 08:40:13.164557 [ 66719 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_154_154_0 from disk default 2025.06.18 08:40:13.164807 [ 66693 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): loadDataPart: inserting 20250618_1_1_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.164871 [ 66693 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Finished loading Outdated part 20250618_1_1_0 on disk default 2025.06.18 08:40:13.164952 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_226_226_0 from disk default 2025.06.18 08:40:13.165361 [ 66687 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_227_227_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.165414 [ 66687 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_227_227_0 on disk default 2025.06.18 08:40:13.165479 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_227_227_0 2025.06.18 08:40:13.165585 [ 66729 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_249_249_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.165634 [ 66729 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_249_249_0 on disk default 2025.06.18 08:40:13.165720 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_249_249_0 2025.06.18 08:40:13.165985 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b), part: 20250618_1_1_0 2025.06.18 08:40:13.166114 [ 66053 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Loaded 6 outdated data parts asynchronously 2025.06.18 08:40:13.166839 [ 66718 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_155_155_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.166891 [ 66718 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_155_155_0 on disk default 2025.06.18 08:40:13.166954 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_155_155_0 2025.06.18 08:40:13.166992 [ 66712 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_232_232_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.167048 [ 66712 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_232_232_0 on disk default 2025.06.18 08:40:13.167091 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_225_225_0 from disk default 2025.06.18 08:40:13.167120 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_232_232_0 2025.06.18 08:40:13.168843 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_276_276_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.168891 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_276_276_0 on disk default 2025.06.18 08:40:13.168979 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_483_483_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.168992 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_278_278_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.169032 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_483_483_0 on disk default 2025.06.18 08:40:13.169044 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_278_278_0 on disk default 2025.06.18 08:40:13.169370 [ 66736 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_216_216_0 from disk default 2025.06.18 08:40:13.169634 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_229_229_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.169654 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_480_480_0 from disk default 2025.06.18 08:40:13.169681 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_276_276_0 2025.06.18 08:40:13.169796 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_479_479_0 from disk default 2025.06.18 08:40:13.169831 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_483_483_0 2025.06.18 08:40:13.170085 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_278_278_0 2025.06.18 08:40:13.170319 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_277_277_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.169687 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_229_229_0 on disk default 2025.06.18 08:40:13.170376 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_277_277_0 on disk default 2025.06.18 08:40:13.170875 [ 66732 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_103_103_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.170933 [ 66732 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Outdated part 202506_103_103_0 on disk default 2025.06.18 08:40:13.171080 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.part_log (630dea68-bd65-4118-a62e-459157383449), part: 202506_103_103_0 2025.06.18 08:40:13.171082 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_277_277_0 2025.06.18 08:40:13.171136 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_229_229_0 2025.06.18 08:40:13.171270 [ 66685 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_153_153_0 from disk default 2025.06.18 08:40:13.171341 [ 66737 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_102_102_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.171387 [ 66737 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Outdated part 202506_102_102_0 on disk default 2025.06.18 08:40:13.171723 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_247_247_0 from disk default 2025.06.18 08:40:13.171802 [ 66735 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loading Outdated part 202506_1_101_20 from disk default 2025.06.18 08:40:13.172366 [ 66719 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_154_154_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.172410 [ 66719 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_154_154_0 on disk default 2025.06.18 08:40:13.172753 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.part_log (630dea68-bd65-4118-a62e-459157383449), part: 202506_102_102_0 2025.06.18 08:40:13.172955 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_275_275_0 from disk default 2025.06.18 08:40:13.172955 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_248_248_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.173064 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_248_248_0 on disk default 2025.06.18 08:40:13.173134 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_248_248_0 2025.06.18 08:40:13.174034 [ 66748 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_274_274_0 from disk default 2025.06.18 08:40:13.174082 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_273_273_0 from disk default 2025.06.18 08:40:13.178433 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_272_272_0 from disk default 2025.06.18 08:40:13.178606 [ 66746 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_148_152_1 from disk default 2025.06.18 08:40:13.178983 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_154_154_0 2025.06.18 08:40:13.179256 [ 66731 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_226_226_0 from disk default 2025.06.18 08:40:13.178810 [ 66747 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_246_246_0 from disk default 2025.06.18 08:40:13.180106 [ 66733 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_1_147_59 from disk default 2025.06.18 08:40:13.180136 [ 66687 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_271_271_0 from disk default 2025.06.18 08:40:13.180171 [ 66750 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_228_228_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.180227 [ 66750 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_228_228_0 on disk default 2025.06.18 08:40:13.180290 [ 66750 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_228_228_0 2025.06.18 08:40:13.180406 [ 66691 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_270_270_0 from disk default 2025.06.18 08:40:13.180475 [ 66740 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_143_143_0 from disk default 2025.06.18 08:40:13.181050 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_478_478_0 from disk default 2025.06.18 08:40:13.181845 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_272_272_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.181897 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_272_272_0 on disk default 2025.06.18 08:40:13.181971 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_272_272_0 2025.06.18 08:40:13.182185 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_273_273_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.182239 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_273_273_0 on disk default 2025.06.18 08:40:13.182310 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_273_273_0 2025.06.18 08:40:13.182472 [ 66686 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_481_481_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.182507 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_275_275_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.182524 [ 66686 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_481_481_0 on disk default 2025.06.18 08:40:13.182584 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_275_275_0 on disk default 2025.06.18 08:40:13.182663 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_481_481_0 2025.06.18 08:40:13.182680 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_275_275_0 2025.06.18 08:40:13.182787 [ 66731 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_226_226_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.182849 [ 66731 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_226_226_0 on disk default 2025.06.18 08:40:13.182921 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_226_226_0 2025.06.18 08:40:13.183225 [ 66691 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_270_270_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.183293 [ 66691 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_270_270_0 on disk default 2025.06.18 08:40:13.183369 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_270_270_0 2025.06.18 08:40:13.183503 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_269_269_0 from disk default 2025.06.18 08:40:13.183724 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_245_245_0 from disk default 2025.06.18 08:40:13.184185 [ 66739 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_215_215_0 from disk default 2025.06.18 08:40:13.184223 [ 66749 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_268_268_0 from disk default 2025.06.18 08:40:13.184210 [ 66748 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_274_274_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.184303 [ 66688 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_142_142_0 from disk default 2025.06.18 08:40:13.184325 [ 66748 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_274_274_0 on disk default 2025.06.18 08:40:13.184330 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loading Outdated part 202506_1_152_60 from disk default 2025.06.18 08:40:13.184400 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_274_274_0 2025.06.18 08:40:13.184408 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_224_224_0 from disk default 2025.06.18 08:40:13.184589 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_477_477_0 from disk default 2025.06.18 08:40:13.185127 [ 66734 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_228_228_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.185180 [ 66734 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_228_228_0 on disk default 2025.06.18 08:40:13.185247 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_228_228_0 2025.06.18 08:40:13.185722 [ 66734 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_244_244_0 from disk default 2025.06.18 08:40:13.186071 [ 66749 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_268_268_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.186129 [ 66749 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_268_268_0 on disk default 2025.06.18 08:40:13.186229 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_268_268_0 2025.06.18 08:40:13.186420 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_225_225_0 from disk default 2025.06.18 08:40:13.187618 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_480_480_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.187672 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_480_480_0 on disk default 2025.06.18 08:40:13.187735 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_480_480_0 2025.06.18 08:40:13.187862 [ 66724 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_214_214_0 from disk default 2025.06.18 08:40:13.188367 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_479_479_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.188450 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_479_479_0 on disk default 2025.06.18 08:40:13.188491 [ 66735 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): loadDataPart: inserting 202506_1_101_20 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.188553 [ 66735 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Finished loading Outdated part 202506_1_101_20 on disk default 2025.06.18 08:40:13.189052 [ 66685 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_153_153_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.189102 [ 66685 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_153_153_0 on disk default 2025.06.18 08:40:13.189154 [ 66687 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_271_271_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.189208 [ 66687 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_271_271_0 on disk default 2025.06.18 08:40:13.189375 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_479_479_0 2025.06.18 08:40:13.189397 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.part_log (630dea68-bd65-4118-a62e-459157383449), part: 202506_1_101_20 2025.06.18 08:40:13.189424 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_153_153_0 2025.06.18 08:40:13.189448 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_271_271_0 2025.06.18 08:40:13.189507 [ 66035 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Loaded 6 outdated data parts asynchronously 2025.06.18 08:40:13.189526 [ 66725 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_267_267_0 from disk default 2025.06.18 08:40:13.189614 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_224_224_0 from disk default 2025.06.18 08:40:13.189656 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_269_269_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.189704 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_269_269_0 on disk default 2025.06.18 08:40:13.190240 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_478_478_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.190297 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_478_478_0 on disk default 2025.06.18 08:40:13.190503 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_243_243_0 from disk default 2025.06.18 08:40:13.190568 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_269_269_0 2025.06.18 08:40:13.190575 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_478_478_0 2025.06.18 08:40:13.191102 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_242_242_0 from disk default 2025.06.18 08:40:13.191195 [ 66688 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_142_142_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.191243 [ 66688 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_142_142_0 on disk default 2025.06.18 08:40:13.191523 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_225_225_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.191585 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_225_225_0 on disk default 2025.06.18 08:40:13.191039 [ 66035 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 200 ms. 2025.06.18 08:40:13.192134 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_142_142_0 2025.06.18 08:40:13.192143 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_225_225_0 2025.06.18 08:40:13.192503 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_477_477_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.192562 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_477_477_0 on disk default 2025.06.18 08:40:13.192597 [ 66746 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_148_152_1 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.192624 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_477_477_0 2025.06.18 08:40:13.192651 [ 66746 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_148_152_1 on disk default 2025.06.18 08:40:13.192671 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_1_152_60 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.192722 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_1_152_60 on disk default 2025.06.18 08:40:13.193943 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_148_152_1 2025.06.18 08:40:13.193966 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_1_152_60 2025.06.18 08:40:13.194153 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_247_247_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.194202 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_247_247_0 on disk default 2025.06.18 08:40:13.194260 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_247_247_0 2025.06.18 08:40:13.200881 [ 66737 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_141_141_0 from disk default 2025.06.18 08:40:13.201115 [ 66729 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_476_476_0 from disk default 2025.06.18 08:40:13.202015 [ 66750 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_213_213_0 from disk default 2025.06.18 08:40:13.202476 [ 66733 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): loadDataPart: inserting 202506_1_147_59 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.202528 [ 66733 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Finished loading Outdated part 202506_1_147_59 on disk default 2025.06.18 08:40:13.203385 [ 66725 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_267_267_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.203432 [ 66725 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_267_267_0 on disk default 2025.06.18 08:40:13.203696 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_1_147_59 2025.06.18 08:40:13.203878 [ 66056 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Loaded 9 outdated data parts asynchronously 2025.06.18 08:40:13.204355 [ 66712 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_223_223_0 from disk default 2025.06.18 08:40:13.205258 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_267_267_0 2025.06.18 08:40:13.205313 [ 66716 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_223_223_0 from disk default 2025.06.18 08:40:13.205587 [ 66731 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_140_140_0 from disk default 2025.06.18 08:40:13.205600 [ 66733 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_241_241_0 from disk default 2025.06.18 08:40:13.205697 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_222_222_0 from disk default 2025.06.18 08:40:13.206106 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_266_266_0 from disk default 2025.06.18 08:40:13.206637 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_222_222_0 from disk default 2025.06.18 08:40:13.207239 [ 66734 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_244_244_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.207289 [ 66734 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_244_244_0 on disk default 2025.06.18 08:40:13.207357 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_244_244_0 2025.06.18 08:40:13.207722 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_221_221_0 from disk default 2025.06.18 08:40:13.209430 [ 66728 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_229_229_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.209484 [ 66728 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_229_229_0 on disk default 2025.06.18 08:40:13.209558 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_229_229_0 2025.06.18 08:40:13.209564 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_230_230_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.209626 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_230_230_0 on disk default 2025.06.18 08:40:13.209702 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_230_230_0 2025.06.18 08:40:13.210075 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_224_224_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.210090 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_475_475_0 from disk default 2025.06.18 08:40:13.210131 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_224_224_0 on disk default 2025.06.18 08:40:13.210971 [ 66737 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_141_141_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.211020 [ 66737 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_141_141_0 on disk default 2025.06.18 08:40:13.211209 [ 66710 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_221_221_0 from disk default 2025.06.18 08:40:13.211358 [ 66714 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_227_227_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.211411 [ 66714 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_227_227_0 on disk default 2025.06.18 08:40:13.212161 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_224_224_0 2025.06.18 08:40:13.212185 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_141_141_0 2025.06.18 08:40:13.212290 [ 66691 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_139_139_0 from disk default 2025.06.18 08:40:13.212376 [ 66723 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): loadDataPart: inserting 202506_137_162_5 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.212425 [ 66723 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Finished loading Outdated part 202506_137_162_5 on disk default 2025.06.18 08:40:13.212995 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_265_265_0 from disk default 2025.06.18 08:40:13.213553 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae), part: 202506_137_162_5 2025.06.18 08:40:13.213576 [ 66747 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_246_246_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.213584 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_227_227_0 2025.06.18 08:40:13.213638 [ 66747 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_246_246_0 on disk default 2025.06.18 08:40:13.213703 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_246_246_0 2025.06.18 08:40:13.213919 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_245_245_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.213977 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_245_245_0 on disk default 2025.06.18 08:40:13.214038 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_245_245_0 2025.06.18 08:40:13.214192 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_474_474_0 from disk default 2025.06.18 08:40:13.214264 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_222_222_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.214315 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_222_222_0 on disk default 2025.06.18 08:40:13.214532 [ 66714 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_220_220_0 from disk default 2025.06.18 08:40:13.214795 [ 66747 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_220_220_0 from disk default 2025.06.18 08:40:13.214950 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_222_222_0 2025.06.18 08:40:13.214734 [ 66032 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Loaded 12 outdated data parts asynchronously 2025.06.18 08:40:13.215314 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_266_266_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.215348 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_264_264_0 from disk default 2025.06.18 08:40:13.215372 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_266_266_0 on disk default 2025.06.18 08:40:13.215747 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_243_243_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.215798 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_243_243_0 on disk default 2025.06.18 08:40:13.216437 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_221_221_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.216494 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_221_221_0 on disk default 2025.06.18 08:40:13.216536 [ 66032 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 226 ms. 2025.06.18 08:40:13.217125 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_474_479_1 from disk default 2025.06.18 08:40:13.217659 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_266_266_0 2025.06.18 08:40:13.217681 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_243_243_0 2025.06.18 08:40:13.217348 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_242_242_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.217802 [ 66722 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_242_242_0 on disk default 2025.06.18 08:40:13.217836 [ 66733 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_241_241_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.217887 [ 66733 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_241_241_0 on disk default 2025.06.18 08:40:13.218633 [ 66686 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_219_219_0 from disk default 2025.06.18 08:40:13.219105 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_221_221_0 2025.06.18 08:40:13.219129 [ 66730 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_240_240_0 from disk default 2025.06.18 08:40:13.219216 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_242_242_0 2025.06.18 08:40:13.219250 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_241_241_0 2025.06.18 08:40:13.219419 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_219_219_0 from disk default 2025.06.18 08:40:13.219645 [ 66731 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_140_140_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.219696 [ 66731 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_140_140_0 on disk default 2025.06.18 08:40:13.219760 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_140_140_0 2025.06.18 08:40:13.219932 [ 66731 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_212_212_0 from disk default 2025.06.18 08:40:13.220784 [ 66746 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_1_138_35 from disk default 2025.06.18 08:40:13.220805 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_263_263_0 from disk default 2025.06.18 08:40:13.221218 [ 66691 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_139_139_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.221268 [ 66691 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_139_139_0 on disk default 2025.06.18 08:40:13.222379 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_226_226_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.222394 [ 66716 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_223_223_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.222440 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_226_226_0 on disk default 2025.06.18 08:40:13.222447 [ 66716 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_223_223_0 on disk default 2025.06.18 08:40:13.222468 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_265_265_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.222518 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_226_226_0 2025.06.18 08:40:13.222519 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_223_223_0 2025.06.18 08:40:13.222522 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_265_265_0 on disk default 2025.06.18 08:40:13.222685 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_265_265_0 2025.06.18 08:40:13.222989 [ 66714 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_220_220_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.223044 [ 66740 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_143_143_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.223049 [ 66714 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_220_220_0 on disk default 2025.06.18 08:40:13.223127 [ 66740 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_143_143_0 on disk default 2025.06.18 08:40:13.223142 [ 66682 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_1_140_36 from disk default 2025.06.18 08:40:13.223151 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_220_220_0 2025.06.18 08:40:13.223739 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_219_219_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.223790 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_219_219_0 on disk default 2025.06.18 08:40:13.224198 [ 65992 ] {} SystemLog: Creating system.part_log from part_log 2025.06.18 08:40:13.224947 [ 66729 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_476_476_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.224995 [ 66729 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_476_476_0 on disk default 2025.06.18 08:40:13.225456 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_143_143_0 2025.06.18 08:40:13.225477 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_139_139_0 2025.06.18 08:40:13.225488 [ 66734 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_211_211_0 from disk default 2025.06.18 08:40:13.225530 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_219_219_0 2025.06.18 08:40:13.225983 [ 66749 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_1_141_37 from disk default 2025.06.18 08:40:13.226665 [ 66737 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_218_218_0 from disk default 2025.06.18 08:40:13.226822 [ 66689 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_210_210_0 from disk default 2025.06.18 08:40:13.226885 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_476_476_0 2025.06.18 08:40:13.226923 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_475_475_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.226972 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_475_475_0 on disk default 2025.06.18 08:40:13.227265 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_263_263_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.227317 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_263_263_0 on disk default 2025.06.18 08:40:13.227758 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_473_473_0 from disk default 2025.06.18 08:40:13.227792 [ 66696 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_217_217_0 from disk default 2025.06.18 08:40:13.228764 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_264_264_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.228813 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_264_264_0 on disk default 2025.06.18 08:40:13.229000 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_475_475_0 2025.06.18 08:40:13.229057 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_264_264_0 2025.06.18 08:40:13.229118 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_263_263_0 2025.06.18 08:40:13.229438 [ 66729 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_209_209_0 from disk default 2025.06.18 08:40:13.229559 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_1_142_38 from disk default 2025.06.18 08:40:13.229590 [ 66726 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_472_472_0 from disk default 2025.06.18 08:40:13.230036 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_474_479_1 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.230082 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_474_479_1 on disk default 2025.06.18 08:40:13.230137 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_474_479_1 2025.06.18 08:40:13.232410 [ 66712 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_223_223_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.232466 [ 66712 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_223_223_0 on disk default 2025.06.18 08:40:13.232533 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_223_223_0 2025.06.18 08:40:13.238494 [ 66688 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_471_471_0 from disk default 2025.06.18 08:40:13.238531 [ 66719 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_218_218_0 from disk default 2025.06.18 08:40:13.239002 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_470_470_0 from disk default 2025.06.18 08:40:13.239370 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_225_225_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.239424 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_225_225_0 on disk default 2025.06.18 08:40:13.239492 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_225_225_0 2025.06.18 08:40:13.239674 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_216_216_0 from disk default 2025.06.18 08:40:13.239976 [ 66730 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_240_240_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.240029 [ 66730 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_240_240_0 on disk default 2025.06.18 08:40:13.241108 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_240_240_0 2025.06.18 08:40:13.241409 [ 66730 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_217_217_0 from disk default 2025.06.18 08:40:13.241958 [ 66737 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_218_218_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.242012 [ 66737 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_218_218_0 on disk default 2025.06.18 08:40:13.242074 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_218_218_0 2025.06.18 08:40:13.242865 [ 66722 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_469_469_0 from disk default 2025.06.18 08:40:13.244481 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_224_224_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.244534 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_224_224_0 on disk default 2025.06.18 08:40:13.244607 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_224_224_0 2025.06.18 08:40:13.245316 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_239_239_0 from disk default 2025.06.18 08:40:13.245481 [ 66696 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_217_217_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.245579 [ 66696 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_217_217_0 on disk default 2025.06.18 08:40:13.246983 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_474_474_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.247041 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_474_474_0 on disk default 2025.06.18 08:40:13.247110 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_474_474_0 2025.06.18 08:40:13.247501 [ 66733 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_208_208_0 from disk default 2025.06.18 08:40:13.248082 [ 66746 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_138_35 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.248131 [ 66746 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_1_138_35 on disk default 2025.06.18 08:40:13.248190 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_138_35 2025.06.18 08:40:13.248776 [ 66749 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_141_37 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.248823 [ 66749 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_1_141_37 on disk default 2025.06.18 08:40:13.248857 [ 66725 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_216_216_0 from disk default 2025.06.18 08:40:13.248933 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_216_216_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.248984 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_216_216_0 on disk default 2025.06.18 08:40:13.249174 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_217_217_0 2025.06.18 08:40:13.249458 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_141_37 2025.06.18 08:40:13.249582 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_216_216_0 2025.06.18 08:40:13.249965 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_215_215_0 from disk default 2025.06.18 08:40:13.250515 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_473_473_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.250580 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_473_473_0 on disk default 2025.06.18 08:40:13.250644 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_473_473_0 2025.06.18 08:40:13.251268 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_468_468_0 from disk default 2025.06.18 08:40:13.251537 [ 66682 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_140_36 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.251604 [ 66682 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_1_140_36 on disk default 2025.06.18 08:40:13.252725 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_140_36 2025.06.18 08:40:13.252895 [ 66710 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_221_221_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.252904 [ 66688 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_471_471_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.252958 [ 66710 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_221_221_0 on disk default 2025.06.18 08:40:13.252986 [ 66688 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_471_471_0 on disk default 2025.06.18 08:40:13.253030 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_221_221_0 2025.06.18 08:40:13.253057 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_471_471_0 2025.06.18 08:40:13.253412 [ 66691 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_262_262_0 from disk default 2025.06.18 08:40:13.253480 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_142_38 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.253533 [ 66685 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_1_142_38 on disk default 2025.06.18 08:40:13.254037 [ 66715 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_261_261_0 from disk default 2025.06.18 08:40:13.254143 [ 66714 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_214_214_0 from disk default 2025.06.18 08:40:13.254926 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_142_38 2025.06.18 08:40:13.255053 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_222_222_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.255107 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_222_222_0 on disk default 2025.06.18 08:40:13.255168 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_222_222_0 2025.06.18 08:40:13.255566 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_238_238_0 from disk default 2025.06.18 08:40:13.257597 [ 66735 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_207_207_0 from disk default 2025.06.18 08:40:13.257807 [ 66728 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_237_237_0 from disk default 2025.06.18 08:40:13.258272 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_467_467_0 from disk default 2025.06.18 08:40:13.259148 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_470_470_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.259199 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_470_470_0 on disk default 2025.06.18 08:40:13.259259 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_470_470_0 2025.06.18 08:40:13.259322 [ 66691 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_262_262_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.259372 [ 66691 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_262_262_0 on disk default 2025.06.18 08:40:13.259389 [ 66726 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_472_472_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.259434 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_262_262_0 2025.06.18 08:40:13.259439 [ 66726 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_472_472_0 on disk default 2025.06.18 08:40:13.266744 [ 66732 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_1_143_39 from disk default 2025.06.18 08:40:13.268520 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_472_472_0 2025.06.18 08:40:13.268997 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_260_260_0 from disk default 2025.06.18 08:40:13.270942 [ 66712 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_259_259_0 from disk default 2025.06.18 08:40:13.271300 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_215_215_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.271349 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_215_215_0 on disk default 2025.06.18 08:40:13.272669 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_215_215_0 2025.06.18 08:40:13.272693 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_260_260_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.272752 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_260_260_0 on disk default 2025.06.18 08:40:13.272813 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_260_260_0 2025.06.18 08:40:13.273042 [ 66714 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_214_214_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.273089 [ 66714 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_214_214_0 on disk default 2025.06.18 08:40:13.273148 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_214_214_0 2025.06.18 08:40:13.273347 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_215_215_0 from disk default 2025.06.18 08:40:13.273629 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_239_239_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.273690 [ 66694 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_239_239_0 on disk default 2025.06.18 08:40:13.273755 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_239_239_0 2025.06.18 08:40:13.274131 [ 66715 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_261_261_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.274185 [ 66715 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_261_261_0 on disk default 2025.06.18 08:40:13.274583 [ 66718 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loading Outdated part 202506_1_144_40 from disk default 2025.06.18 08:40:13.274904 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_261_261_0 2025.06.18 08:40:13.275026 [ 66712 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_259_259_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.275078 [ 66712 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_259_259_0 on disk default 2025.06.18 08:40:13.275098 [ 66722 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_469_469_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.275145 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_259_259_0 2025.06.18 08:40:13.275151 [ 66722 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_469_469_0 on disk default 2025.06.18 08:40:13.275271 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_469_469_0 2025.06.18 08:40:13.275505 [ 66737 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_213_213_0 from disk default 2025.06.18 08:40:13.275944 [ 66686 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_219_219_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.276000 [ 66686 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_219_219_0 on disk default 2025.06.18 08:40:13.276111 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_219_219_0 2025.06.18 08:40:13.276288 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_238_238_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.276317 [ 66747 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_220_220_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.276293 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_236_236_0 from disk default 2025.06.18 08:40:13.276353 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_238_238_0 on disk default 2025.06.18 08:40:13.276378 [ 66747 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_220_220_0 on disk default 2025.06.18 08:40:13.276426 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_238_238_0 2025.06.18 08:40:13.276442 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_220_220_0 2025.06.18 08:40:13.276508 [ 66719 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_218_218_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.276580 [ 66719 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_218_218_0 on disk default 2025.06.18 08:40:13.276652 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_218_218_0 2025.06.18 08:40:13.277081 [ 66723 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_235_235_0 from disk default 2025.06.18 08:40:13.278400 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_212_212_0 from disk default 2025.06.18 08:40:13.278471 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_206_206_0 from disk default 2025.06.18 08:40:13.278339 [ 65992 ] {} SystemLog: Creating system.trace_log from trace_log 2025.06.18 08:40:13.279455 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_468_468_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.279507 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_468_468_0 on disk default 2025.06.18 08:40:13.279581 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_468_468_0 2025.06.18 08:40:13.279994 [ 66737 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_213_213_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.280047 [ 66737 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_213_213_0 on disk default 2025.06.18 08:40:13.285420 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_213_213_0 2025.06.18 08:40:13.285475 [ 66741 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_234_234_0 from disk default 2025.06.18 08:40:13.285498 [ 66696 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_466_466_0 from disk default 2025.06.18 08:40:13.285587 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_465_465_0 from disk default 2025.06.18 08:40:13.286641 [ 66685 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_258_258_0 from disk default 2025.06.18 08:40:13.287179 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_257_257_0 from disk default 2025.06.18 08:40:13.287376 [ 66688 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_205_205_0 from disk default 2025.06.18 08:40:13.287723 [ 66732 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_143_39 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.287778 [ 66732 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_1_143_39 on disk default 2025.06.18 08:40:13.287839 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_143_39 2025.06.18 08:40:13.288046 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_233_233_0 from disk default 2025.06.18 08:40:13.288214 [ 66728 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_237_237_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.288278 [ 66728 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_237_237_0 on disk default 2025.06.18 08:40:13.288341 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_237_237_0 2025.06.18 08:40:13.289206 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_467_467_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.289258 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_467_467_0 on disk default 2025.06.18 08:40:13.289345 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_467_467_0 2025.06.18 08:40:13.289430 [ 66728 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_204_204_0 from disk default 2025.06.18 08:40:13.289509 [ 66748 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_214_214_0 from disk default 2025.06.18 08:40:13.291027 [ 66718 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): loadDataPart: inserting 202506_1_144_40 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.291090 [ 66718 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Finished loading Outdated part 202506_1_144_40 on disk default 2025.06.18 08:40:13.291170 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_144_40 2025.06.18 08:40:13.291172 [ 66723 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_235_235_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.291259 [ 66723 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_235_235_0 on disk default 2025.06.18 08:40:13.291333 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_235_235_0 2025.06.18 08:40:13.291417 [ 66691 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_213_213_0 from disk default 2025.06.18 08:40:13.291714 [ 66038 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Loaded 13 outdated data parts asynchronously 2025.06.18 08:40:13.291734 [ 66685 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_258_258_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.291810 [ 66685 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_258_258_0 on disk default 2025.06.18 08:40:13.291820 [ 66741 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_234_234_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.291834 [ 66726 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_232_232_0 from disk default 2025.06.18 08:40:13.291879 [ 66741 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_234_234_0 on disk default 2025.06.18 08:40:13.291881 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_258_258_0 2025.06.18 08:40:13.291959 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_234_234_0 2025.06.18 08:40:13.292047 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_212_212_0 from disk default 2025.06.18 08:40:13.292586 [ 66725 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_216_216_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.292641 [ 66725 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_216_216_0 on disk default 2025.06.18 08:40:13.295019 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_236_236_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.295026 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_464_464_0 from disk default 2025.06.18 08:40:13.295090 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_236_236_0 on disk default 2025.06.18 08:40:13.295295 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_216_216_0 2025.06.18 08:40:13.295460 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_231_231_0 from disk default 2025.06.18 08:40:13.295516 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_236_236_0 2025.06.18 08:40:13.295551 [ 66038 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 306 ms. 2025.06.18 08:40:13.295672 [ 66696 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_466_466_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.296347 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_212_212_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.298213 [ 66696 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_466_466_0 on disk default 2025.06.18 08:40:13.298234 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_212_212_0 on disk default 2025.06.18 08:40:13.298328 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_466_466_0 2025.06.18 08:40:13.297577 [ 65992 ] {} SystemLog: Creating system.crash_log from crash_log 2025.06.18 08:40:13.298337 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_212_212_0 2025.06.18 08:40:13.296889 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_257_257_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.298571 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_211_211_0 from disk default 2025.06.18 08:40:13.298610 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_211_211_0 from disk default 2025.06.18 08:40:13.298626 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_257_257_0 on disk default 2025.06.18 08:40:13.298789 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_230_230_0 from disk default 2025.06.18 08:40:13.299119 [ 66730 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_217_217_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.299125 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_257_257_0 2025.06.18 08:40:13.299188 [ 66730 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_217_217_0 on disk default 2025.06.18 08:40:13.299261 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_217_217_0 2025.06.18 08:40:13.299617 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_463_463_0 from disk default 2025.06.18 08:40:13.300225 [ 66730 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_210_210_0 from disk default 2025.06.18 08:40:13.301636 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_233_233_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.301690 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_233_233_0 on disk default 2025.06.18 08:40:13.301754 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_233_233_0 2025.06.18 08:40:13.301852 [ 66726 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_232_232_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.301923 [ 66726 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_232_232_0 on disk default 2025.06.18 08:40:13.302003 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_232_232_0 2025.06.18 08:40:13.302247 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_229_229_0 from disk default 2025.06.18 08:40:13.302361 [ 66687 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_256_256_0 from disk default 2025.06.18 08:40:13.303155 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_231_231_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.303213 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_231_231_0 on disk default 2025.06.18 08:40:13.303321 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_231_231_0 2025.06.18 08:40:13.303489 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_228_228_0 from disk default 2025.06.18 08:40:13.304055 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_465_465_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.304111 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_465_465_0 on disk default 2025.06.18 08:40:13.304177 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_465_465_0 2025.06.18 08:40:13.304374 [ 66737 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_227_227_0 from disk default 2025.06.18 08:40:13.306608 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_464_464_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.306662 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_464_464_0 on disk default 2025.06.18 08:40:13.307037 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_464_464_0 2025.06.18 08:40:13.307251 [ 66694 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_209_209_0 from disk default 2025.06.18 08:40:13.308485 [ 66687 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_256_256_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.308567 [ 66687 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_256_256_0 on disk default 2025.06.18 08:40:13.308607 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_211_211_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.308635 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_256_256_0 2025.06.18 08:40:13.308662 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_211_211_0 on disk default 2025.06.18 08:40:13.308733 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_211_211_0 2025.06.18 08:40:13.309746 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_230_230_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.309800 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_230_230_0 on disk default 2025.06.18 08:40:13.309895 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_230_230_0 2025.06.18 08:40:13.310179 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_255_255_0 from disk default 2025.06.18 08:40:13.310201 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_254_254_0 from disk default 2025.06.18 08:40:13.310337 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_208_208_0 from disk default 2025.06.18 08:40:13.311485 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_229_229_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.311555 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_229_229_0 on disk default 2025.06.18 08:40:13.312067 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_229_229_0 2025.06.18 08:40:13.312250 [ 66718 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_210_210_0 from disk default 2025.06.18 08:40:13.313453 [ 66691 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_213_213_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.313511 [ 66691 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_213_213_0 on disk default 2025.06.18 08:40:13.313798 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_213_213_0 2025.06.18 08:40:13.313930 [ 66748 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_214_214_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.313964 [ 66691 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_207_207_0 from disk default 2025.06.18 08:40:13.313980 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_228_228_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.313985 [ 66748 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_214_214_0 on disk default 2025.06.18 08:40:13.314052 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_228_228_0 on disk default 2025.06.18 08:40:13.314096 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_214_214_0 2025.06.18 08:40:13.314133 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_228_228_0 2025.06.18 08:40:13.314259 [ 66748 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_206_206_0 from disk default 2025.06.18 08:40:13.314439 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_226_226_0 from disk default 2025.06.18 08:40:13.319511 [ 66737 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_227_227_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.319580 [ 66737 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_227_227_0 on disk default 2025.06.18 08:40:13.319643 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_227_227_0 2025.06.18 08:40:13.319908 [ 66737 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_203_203_0 from disk default 2025.06.18 08:40:13.320073 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_463_463_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.320129 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_463_463_0 on disk default 2025.06.18 08:40:13.320191 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_463_463_0 2025.06.18 08:40:13.320344 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_205_205_0 from disk default 2025.06.18 08:40:13.322482 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_254_254_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.322536 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_254_254_0 on disk default 2025.06.18 08:40:13.322568 [ 66718 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_210_210_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.322621 [ 66718 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_210_210_0 on disk default 2025.06.18 08:40:13.324488 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_254_254_0 2025.06.18 08:40:13.324954 [ 66696 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_462_462_0 from disk default 2025.06.18 08:40:13.325935 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_210_210_0 2025.06.18 08:40:13.326607 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_255_255_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.326661 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_255_255_0 on disk default 2025.06.18 08:40:13.326726 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_255_255_0 2025.06.18 08:40:13.326803 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_212_212_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.326864 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_212_212_0 on disk default 2025.06.18 08:40:13.326931 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_212_212_0 2025.06.18 08:40:13.327238 [ 65992 ] {} SystemLog: Creating system.text_log from text_log 2025.06.18 08:40:13.327239 [ 66746 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_461_461_0 from disk default 2025.06.18 08:40:13.327417 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_209_209_0 from disk default 2025.06.18 08:40:13.327564 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_204_204_0 from disk default 2025.06.18 08:40:13.332637 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_209_209_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.332715 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_209_209_0 on disk default 2025.06.18 08:40:13.332811 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_209_209_0 2025.06.18 08:40:13.333082 [ 66747 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_202_202_0 from disk default 2025.06.18 08:40:13.333518 [ 66696 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_462_462_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.333589 [ 66696 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_462_462_0 on disk default 2025.06.18 08:40:13.333605 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_226_226_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.333662 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_226_226_0 on disk default 2025.06.18 08:40:13.334267 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_462_462_0 2025.06.18 08:40:13.334282 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_226_226_0 2025.06.18 08:40:13.334455 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_203_203_0 from disk default 2025.06.18 08:40:13.334628 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_225_225_0 from disk default 2025.06.18 08:40:13.336465 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_211_211_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.336538 [ 66715 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_211_211_0 on disk default 2025.06.18 08:40:13.337925 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_211_211_0 2025.06.18 08:40:13.339012 [ 66710 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_201_201_0 from disk default 2025.06.18 08:40:13.340370 [ 66746 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_461_461_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.340432 [ 66746 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_461_461_0 on disk default 2025.06.18 08:40:13.340491 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_461_461_0 2025.06.18 08:40:13.340790 [ 66746 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_253_253_0 from disk default 2025.06.18 08:40:13.342377 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_215_215_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.342460 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_215_215_0 on disk default 2025.06.18 08:40:13.342532 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_215_215_0 2025.06.18 08:40:13.342980 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_208_208_0 from disk default 2025.06.18 08:40:13.343340 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_225_225_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.343393 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_225_225_0 on disk default 2025.06.18 08:40:13.343536 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_225_225_0 2025.06.18 08:40:13.344636 [ 66746 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_253_253_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.344686 [ 66746 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_253_253_0 on disk default 2025.06.18 08:40:13.344741 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_253_253_0 2025.06.18 08:40:13.344924 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_460_460_0 from disk default 2025.06.18 08:40:13.345099 [ 66746 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_207_207_0 from disk default 2025.06.18 08:40:13.346503 [ 66748 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_206_206_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.346573 [ 66748 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_206_206_0 on disk default 2025.06.18 08:40:13.346679 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_206_206_0 2025.06.18 08:40:13.346877 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_252_252_0 from disk default 2025.06.18 08:40:13.350400 [ 66730 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_210_210_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.350440 [ 66746 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_207_207_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.350458 [ 66730 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_210_210_0 on disk default 2025.06.18 08:40:13.350508 [ 66746 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_207_207_0 on disk default 2025.06.18 08:40:13.350565 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_210_210_0 2025.06.18 08:40:13.350586 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_207_207_0 2025.06.18 08:40:13.350685 [ 66691 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_207_207_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.350743 [ 66691 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_207_207_0 on disk default 2025.06.18 08:40:13.350807 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_207_207_0 2025.06.18 08:40:13.352317 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_459_459_0 from disk default 2025.06.18 08:40:13.353630 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_208_208_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.353685 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_208_208_0 on disk default 2025.06.18 08:40:13.353971 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_208_208_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.354024 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_208_208_0 on disk default 2025.06.18 08:40:13.354168 [ 66741 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_199_199_0 from disk default 2025.06.18 08:40:13.354171 [ 66714 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_200_200_0 from disk default 2025.06.18 08:40:13.354843 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_252_252_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.354897 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_252_252_0 on disk default 2025.06.18 08:40:13.354961 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_252_252_0 2025.06.18 08:40:13.355161 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_202_202_0 from disk default 2025.06.18 08:40:13.356407 [ 65992 ] {} SystemLog: Creating system.metric_log from metric_log 2025.06.18 08:40:13.356420 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_208_208_0 2025.06.18 08:40:13.356671 [ 66732 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_206_206_0 from disk default 2025.06.18 08:40:13.356975 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_208_208_0 2025.06.18 08:40:13.357123 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_458_458_0 from disk default 2025.06.18 08:40:13.358187 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_205_205_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.358244 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_205_205_0 on disk default 2025.06.18 08:40:13.358865 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_204_204_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.358919 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_204_204_0 on disk default 2025.06.18 08:40:13.359327 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_205_205_0 2025.06.18 08:40:13.359342 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_204_204_0 2025.06.18 08:40:13.359649 [ 66694 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_209_209_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.359709 [ 66694 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_209_209_0 on disk default 2025.06.18 08:40:13.359769 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_209_209_0 2025.06.18 08:40:13.360016 [ 66718 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_198_198_0 from disk default 2025.06.18 08:40:13.360234 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_201_201_0 from disk default 2025.06.18 08:40:13.360531 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_251_251_0 from disk default 2025.06.18 08:40:13.362904 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_460_460_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.362962 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_460_460_0 on disk default 2025.06.18 08:40:13.363262 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_460_460_0 2025.06.18 08:40:13.363284 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_459_459_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.363285 [ 66732 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_206_206_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.363363 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_459_459_0 on disk default 2025.06.18 08:40:13.363371 [ 66732 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_206_206_0 on disk default 2025.06.18 08:40:13.363429 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_224_224_0 from disk default 2025.06.18 08:40:13.363446 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_206_206_0 2025.06.18 08:40:13.363433 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_459_459_0 2025.06.18 08:40:13.363764 [ 66723 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_197_197_0 from disk default 2025.06.18 08:40:13.363853 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_223_223_0 from disk default 2025.06.18 08:40:13.363997 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_251_251_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.364071 [ 66694 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_251_251_0 on disk default 2025.06.18 08:40:13.364167 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_251_251_0 2025.06.18 08:40:13.364375 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_205_205_0 from disk default 2025.06.18 08:40:13.367123 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_203_203_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.367183 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_203_203_0 on disk default 2025.06.18 08:40:13.367717 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_205_205_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.367778 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_205_205_0 on disk default 2025.06.18 08:40:13.367981 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_205_205_0 2025.06.18 08:40:13.368224 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_457_457_0 from disk default 2025.06.18 08:40:13.368721 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_203_203_0 2025.06.18 08:40:13.368876 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_200_200_0 from disk default 2025.06.18 08:40:13.371176 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_224_224_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.371245 [ 66725 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_224_224_0 on disk default 2025.06.18 08:40:13.371327 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_224_224_0 2025.06.18 08:40:13.371527 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_250_250_0 from disk default 2025.06.18 08:40:13.374063 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_458_458_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.374134 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_458_458_0 on disk default 2025.06.18 08:40:13.374208 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_458_458_0 2025.06.18 08:40:13.374337 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_204_204_0 from disk default 2025.06.18 08:40:13.375528 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_250_250_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.375573 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_202_202_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.375602 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_250_250_0 on disk default 2025.06.18 08:40:13.375634 [ 66717 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_202_202_0 on disk default 2025.06.18 08:40:13.375673 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_250_250_0 2025.06.18 08:40:13.375704 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_202_202_0 2025.06.18 08:40:13.375849 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_199_199_0 from disk default 2025.06.18 08:40:13.375912 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_222_222_0 from disk default 2025.06.18 08:40:13.386669 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_204_204_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.386737 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_204_204_0 on disk default 2025.06.18 08:40:13.386796 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_204_204_0 2025.06.18 08:40:13.386942 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_203_203_0 from disk default 2025.06.18 08:40:13.391362 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_223_223_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.391414 [ 66732 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_223_223_0 on disk default 2025.06.18 08:40:13.392013 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_223_223_0 2025.06.18 08:40:13.392384 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_222_222_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.392449 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_222_222_0 on disk default 2025.06.18 08:40:13.392458 [ 66691 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_196_196_0 from disk default 2025.06.18 08:40:13.393101 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_222_222_0 2025.06.18 08:40:13.393495 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_249_249_0 from disk default 2025.06.18 08:40:13.394818 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_203_203_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.394881 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_203_203_0 on disk default 2025.06.18 08:40:13.394944 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_203_203_0 2025.06.18 08:40:13.395129 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_202_202_0 from disk default 2025.06.18 08:40:13.397093 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_457_457_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.397150 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_457_457_0 on disk default 2025.06.18 08:40:13.398038 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_457_457_0 2025.06.18 08:40:13.398205 [ 66703 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_248_248_0 from disk default 2025.06.18 08:40:13.400386 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_202_202_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.400451 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_202_202_0 on disk default 2025.06.18 08:40:13.400527 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_202_202_0 2025.06.18 08:40:13.401002 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_456_456_0 from disk default 2025.06.18 08:40:13.401509 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_249_249_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.401575 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_249_249_0 on disk default 2025.06.18 08:40:13.401640 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_249_249_0 2025.06.18 08:40:13.401981 [ 66712 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_195_195_0 from disk default 2025.06.18 08:40:13.402724 [ 66703 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_248_248_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.402779 [ 66703 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_248_248_0 on disk default 2025.06.18 08:40:13.402790 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_201_201_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.402848 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_201_201_0 on disk default 2025.06.18 08:40:13.403391 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_248_248_0 2025.06.18 08:40:13.403409 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_201_201_0 2025.06.18 08:40:13.404499 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_200_200_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.404539 [ 66726 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_247_247_0 from disk default 2025.06.18 08:40:13.404572 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_200_200_0 on disk default 2025.06.18 08:40:13.404608 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_198_198_0 from disk default 2025.06.18 08:40:13.404716 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_200_200_0 2025.06.18 08:40:13.404847 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_197_197_0 from disk default 2025.06.18 08:40:13.408992 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_199_199_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.409061 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_199_199_0 on disk default 2025.06.18 08:40:13.409143 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_199_199_0 2025.06.18 08:40:13.409205 [ 66726 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_247_247_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.409262 [ 66726 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_247_247_0 on disk default 2025.06.18 08:40:13.409318 [ 66683 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_201_201_0 from disk default 2025.06.18 08:40:13.409332 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_247_247_0 2025.06.18 08:40:13.409569 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_455_455_0 from disk default 2025.06.18 08:40:13.415349 [ 66683 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_201_201_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.415411 [ 66683 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_201_201_0 on disk default 2025.06.18 08:40:13.415479 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_201_201_0 2025.06.18 08:40:13.415656 [ 66683 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_221_221_0 from disk default 2025.06.18 08:40:13.416914 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_455_455_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.416968 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_455_455_0 on disk default 2025.06.18 08:40:13.417036 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_455_455_0 2025.06.18 08:40:13.417226 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_200_200_0 from disk default 2025.06.18 08:40:13.428816 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_200_200_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.428884 [ 66715 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_200_200_0 on disk default 2025.06.18 08:40:13.429162 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_200_200_0 2025.06.18 08:40:13.429355 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_198_198_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.429421 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_198_198_0 on disk default 2025.06.18 08:40:13.429492 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_198_198_0 2025.06.18 08:40:13.429603 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_454_454_0 from disk default 2025.06.18 08:40:13.429942 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_199_199_0 from disk default 2025.06.18 08:40:13.432551 [ 66683 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_221_221_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.432641 [ 66683 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_221_221_0 on disk default 2025.06.18 08:40:13.434256 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_221_221_0 2025.06.18 08:40:13.434469 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_453_453_0 from disk default 2025.06.18 08:40:13.437002 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_456_456_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.437080 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_456_456_0 on disk default 2025.06.18 08:40:13.437171 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_456_456_0 2025.06.18 08:40:13.437463 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_196_196_0 from disk default 2025.06.18 08:40:13.442816 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_454_454_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.442857 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_199_199_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.442893 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_454_454_0 on disk default 2025.06.18 08:40:13.442926 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_199_199_0 on disk default 2025.06.18 08:40:13.442981 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_454_454_0 2025.06.18 08:40:13.443013 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_199_199_0 2025.06.18 08:40:13.443182 [ 66732 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_195_195_0 from disk default 2025.06.18 08:40:13.443948 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_194_194_0 from disk default 2025.06.18 08:40:13.445597 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_197_197_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.445667 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_197_197_0 on disk default 2025.06.18 08:40:13.445747 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_197_197_0 2025.06.18 08:40:13.445967 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_246_246_0 from disk default 2025.06.18 08:40:13.448560 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_453_453_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.448634 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_453_453_0 on disk default 2025.06.18 08:40:13.448748 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_453_453_0 2025.06.18 08:40:13.448969 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_198_198_0 from disk default 2025.06.18 08:40:13.460886 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_246_246_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.460936 [ 66686 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_246_246_0 on disk default 2025.06.18 08:40:13.460997 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_246_246_0 2025.06.18 08:40:13.461167 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_245_245_0 from disk default 2025.06.18 08:40:13.463998 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_245_245_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.464062 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_245_245_0 on disk default 2025.06.18 08:40:13.464288 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_245_245_0 2025.06.18 08:40:13.464534 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_193_193_0 from disk default 2025.06.18 08:40:13.465877 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_198_198_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.465943 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_198_198_0 on disk default 2025.06.18 08:40:13.466024 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_198_198_0 2025.06.18 08:40:13.466221 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_197_197_0 from disk default 2025.06.18 08:40:13.474574 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_194_194_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.474650 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_194_194_0 on disk default 2025.06.18 08:40:13.474745 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_194_194_0 2025.06.18 08:40:13.475055 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_220_220_0 from disk default 2025.06.18 08:40:13.476698 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_196_196_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.476755 [ 66682 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_196_196_0 on disk default 2025.06.18 08:40:13.476858 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_196_196_0 2025.06.18 08:40:13.477562 [ 66732 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_195_195_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.477612 [ 66732 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_195_195_0 on disk default 2025.06.18 08:40:13.482048 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_195_195_0 2025.06.18 08:40:13.483076 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_452_452_0 from disk default 2025.06.18 08:40:13.484271 [ 66716 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_194_194_0 from disk default 2025.06.18 08:40:13.486483 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_193_193_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.486558 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_193_193_0 on disk default 2025.06.18 08:40:13.486630 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_193_193_0 2025.06.18 08:40:13.486641 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_197_197_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.486690 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_197_197_0 on disk default 2025.06.18 08:40:13.486800 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_244_244_0 from disk default 2025.06.18 08:40:13.486992 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_197_197_0 2025.06.18 08:40:13.487201 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_196_196_0 from disk default 2025.06.18 08:40:13.511671 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_220_220_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.511739 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_220_220_0 on disk default 2025.06.18 08:40:13.511805 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_220_220_0 2025.06.18 08:40:13.512004 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_219_219_0 from disk default 2025.06.18 08:40:13.513027 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_196_196_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.513063 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_244_244_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.513082 [ 66726 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_196_196_0 on disk default 2025.06.18 08:40:13.513120 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_244_244_0 on disk default 2025.06.18 08:40:13.513172 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_196_196_0 2025.06.18 08:40:13.513194 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_244_244_0 2025.06.18 08:40:13.513448 [ 66715 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_193_193_0 from disk default 2025.06.18 08:40:13.513451 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_192_192_0 from disk default 2025.06.18 08:40:13.513774 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_452_452_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.513856 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_452_452_0 on disk default 2025.06.18 08:40:13.513937 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_452_452_0 2025.06.18 08:40:13.514142 [ 66748 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_218_218_0 from disk default 2025.06.18 08:40:13.522041 [ 66748 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_218_218_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.522104 [ 66748 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_218_218_0 on disk default 2025.06.18 08:40:13.522177 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_218_218_0 2025.06.18 08:40:13.522366 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_451_451_0 from disk default 2025.06.18 08:40:13.527376 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_451_451_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.527429 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_451_451_0 on disk default 2025.06.18 08:40:13.527486 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_451_451_0 2025.06.18 08:40:13.527671 [ 66748 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_217_217_0 from disk default 2025.06.18 08:40:13.532904 [ 66748 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_217_217_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.532962 [ 66748 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_217_217_0 on disk default 2025.06.18 08:40:13.533426 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_217_217_0 2025.06.18 08:40:13.533636 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_243_243_0 from disk default 2025.06.18 08:40:13.535785 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_243_243_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.535838 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_243_243_0 on disk default 2025.06.18 08:40:13.535898 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_243_243_0 2025.06.18 08:40:13.536113 [ 66719 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_195_195_0 from disk default 2025.06.18 08:40:13.539733 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_219_219_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.539787 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_219_219_0 on disk default 2025.06.18 08:40:13.539853 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_219_219_0 2025.06.18 08:40:13.540026 [ 66696 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_216_216_0 from disk default 2025.06.18 08:40:13.541421 [ 66719 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_195_195_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.541486 [ 66719 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_195_195_0 on disk default 2025.06.18 08:40:13.542001 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_195_195_0 2025.06.18 08:40:13.542570 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_450_450_0 from disk default 2025.06.18 08:40:13.548198 [ 66696 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_216_216_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.548291 [ 66696 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_216_216_0 on disk default 2025.06.18 08:40:13.548383 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_216_216_0 2025.06.18 08:40:13.548581 [ 66696 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_194_194_0 from disk default 2025.06.18 08:40:13.550777 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_450_450_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.550837 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_450_450_0 on disk default 2025.06.18 08:40:13.551250 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_450_450_0 2025.06.18 08:40:13.551455 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_192_192_0 from disk default 2025.06.18 08:40:13.558282 [ 66696 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_194_194_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.558336 [ 66696 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_194_194_0 on disk default 2025.06.18 08:40:13.558399 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_194_194_0 2025.06.18 08:40:13.558651 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_191_191_0 from disk default 2025.06.18 08:40:13.566966 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_191_191_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.567036 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_191_191_0 on disk default 2025.06.18 08:40:13.567118 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_191_191_0 2025.06.18 08:40:13.567316 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_449_449_0 from disk default 2025.06.18 08:40:13.568930 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_192_192_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.569017 [ 66683 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_192_192_0 on disk default 2025.06.18 08:40:13.569113 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_192_192_0 2025.06.18 08:40:13.569285 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_242_242_0 from disk default 2025.06.18 08:40:13.574856 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_242_242_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.574912 [ 66683 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_242_242_0 on disk default 2025.06.18 08:40:13.574983 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_242_242_0 2025.06.18 08:40:13.575173 [ 66732 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_193_193_0 from disk default 2025.06.18 08:40:13.576113 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_449_449_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.576177 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_449_449_0 on disk default 2025.06.18 08:40:13.576845 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_449_449_0 2025.06.18 08:40:13.577116 [ 66694 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_191_191_0 from disk default 2025.06.18 08:40:13.578573 [ 66732 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_193_193_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.578636 [ 66732 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_193_193_0 on disk default 2025.06.18 08:40:13.578716 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_193_193_0 2025.06.18 08:40:13.579186 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_448_448_0 from disk default 2025.06.18 08:40:13.615163 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_448_448_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.615233 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_448_448_0 on disk default 2025.06.18 08:40:13.615307 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_448_448_0 2025.06.18 08:40:13.615573 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_215_215_0 from disk default 2025.06.18 08:40:13.622177 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_215_215_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.622234 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_215_215_0 on disk default 2025.06.18 08:40:13.622302 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_215_215_0 2025.06.18 08:40:13.622467 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_447_447_0 from disk default 2025.06.18 08:40:13.633495 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_447_447_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.633569 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_447_447_0 on disk default 2025.06.18 08:40:13.633641 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_447_447_0 2025.06.18 08:40:13.633859 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_214_214_0 from disk default 2025.06.18 08:40:13.657975 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_214_214_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.658052 [ 66687 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_214_214_0 on disk default 2025.06.18 08:40:13.659163 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_214_214_0 2025.06.18 08:40:13.659458 [ 66685 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_213_213_0 from disk default 2025.06.18 08:40:13.665501 [ 66685 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_213_213_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.665587 [ 66685 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_213_213_0 on disk default 2025.06.18 08:40:13.665668 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_213_213_0 2025.06.18 08:40:13.665879 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_190_0 from disk default 2025.06.18 08:40:13.687888 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_190_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.687956 [ 66685 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_190_0 on disk default 2025.06.18 08:40:13.688738 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_190_0 2025.06.18 08:40:13.692419 [ 66746 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_195_1 from disk default 2025.06.18 08:40:13.794980 [ 66746 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_195_1 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.797465 [ 66746 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_195_1 on disk default 2025.06.18 08:40:13.798521 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_195_1 2025.06.18 08:40:13.807386 [ 66748 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_190_190_0 from disk default 2025.06.18 08:40:13.815416 [ 66739 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_215_215_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.815879 [ 66739 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_215_215_0 on disk default 2025.06.18 08:40:13.816055 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_215_215_0 2025.06.18 08:40:13.817368 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_446_446_0 from disk default 2025.06.18 08:40:13.827993 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_446_446_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.830583 [ 66727 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_446_446_0 on disk default 2025.06.18 08:40:13.830743 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_446_446_0 2025.06.18 08:40:13.831246 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_445_445_0 from disk default 2025.06.18 08:40:13.839736 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_445_445_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.840065 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_445_445_0 on disk default 2025.06.18 08:40:13.840159 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_445_445_0 2025.06.18 08:40:13.839136 [ 66684 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_220_220_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.840384 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_444_444_0 from disk default 2025.06.18 08:40:13.840423 [ 66684 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_220_220_0 on disk default 2025.06.18 08:40:13.846730 [ 66721 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_221_221_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.847899 [ 66721 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_221_221_0 on disk default 2025.06.18 08:40:13.848075 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_221_221_0 2025.06.18 08:40:13.849152 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_220_220_0 2025.06.18 08:40:13.850527 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_444_444_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.850869 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_192_192_0 from disk default 2025.06.18 08:40:13.850905 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_444_444_0 on disk default 2025.06.18 08:40:13.851011 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_444_444_0 2025.06.18 08:40:13.851692 [ 66693 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_241_241_0 from disk default 2025.06.18 08:40:13.852933 [ 66684 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_191_191_0 from disk default 2025.06.18 08:40:13.857048 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_192_192_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.857199 [ 66686 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_192_192_0 on disk default 2025.06.18 08:40:13.857294 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_192_192_0 2025.06.18 08:40:13.857310 [ 66693 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_241_241_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.859382 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_200_2 from disk default 2025.06.18 08:40:13.859449 [ 66693 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_241_241_0 on disk default 2025.06.18 08:40:13.859562 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_241_241_0 2025.06.18 08:40:13.859977 [ 66684 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_191_191_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.860029 [ 66684 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_191_191_0 on disk default 2025.06.18 08:40:13.860093 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_191_191_0 2025.06.18 08:40:13.861275 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_443_0 from disk default 2025.06.18 08:40:13.862658 [ 66683 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_189_189_0 from disk default 2025.06.18 08:40:13.864390 [ 66734 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_211_211_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.864518 [ 66734 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_211_211_0 on disk default 2025.06.18 08:40:13.864622 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_211_211_0 2025.06.18 08:40:13.865689 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_205_3 from disk default 2025.06.18 08:40:13.870964 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_443_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.871526 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_443_0 on disk default 2025.06.18 08:40:13.871779 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_443_0 2025.06.18 08:40:13.872170 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_240_240_0 from disk default 2025.06.18 08:40:13.872955 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_200_2 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.873018 [ 66749 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_200_2 on disk default 2025.06.18 08:40:13.873382 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_200_2 2025.06.18 08:40:13.873596 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_190_190_0 from disk default 2025.06.18 08:40:13.877574 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_190_190_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.877899 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_190_190_0 on disk default 2025.06.18 08:40:13.877931 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_240_240_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.878012 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_190_190_0 2025.06.18 08:40:13.878222 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_240_240_0 on disk default 2025.06.18 08:40:13.878345 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_240_240_0 2025.06.18 08:40:13.878556 [ 66738 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_217_217_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.879281 [ 66726 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_212_212_0 from disk default 2025.06.18 08:40:13.879350 [ 66738 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_217_217_0 on disk default 2025.06.18 08:40:13.879358 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_211_211_0 from disk default 2025.06.18 08:40:13.879522 [ 66738 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_217_217_0 2025.06.18 08:40:13.880586 [ 66687 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_188_188_0 from disk default 2025.06.18 08:40:13.885320 [ 66690 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_218_218_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.885486 [ 66690 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_218_218_0 on disk default 2025.06.18 08:40:13.885665 [ 66690 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_218_218_0 2025.06.18 08:40:13.886193 [ 66730 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_239_239_0 from disk default 2025.06.18 08:40:13.889677 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_211_211_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.889741 [ 66724 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_214_214_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.889880 [ 66724 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_214_214_0 on disk default 2025.06.18 08:40:13.889909 [ 66729 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_209_209_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.890696 [ 66729 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_209_209_0 on disk default 2025.06.18 08:40:13.891680 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_205_3 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.891747 [ 66703 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_205_3 on disk default 2025.06.18 08:40:13.891825 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_205_3 2025.06.18 08:40:13.891979 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_448_1 from disk default 2025.06.18 08:40:13.891260 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_209_209_0 2025.06.18 08:40:13.891233 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_214_214_0 2025.06.18 08:40:13.894562 [ 66746 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_210_4 from disk default 2025.06.18 08:40:13.894648 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_211_211_0 on disk default 2025.06.18 08:40:13.894782 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_211_211_0 2025.06.18 08:40:13.894801 [ 66730 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_239_239_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.894915 [ 66730 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_239_239_0 on disk default 2025.06.18 08:40:13.895005 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_239_239_0 2025.06.18 08:40:13.895020 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_453_2 from disk default 2025.06.18 08:40:13.895247 [ 66730 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_458_3 from disk default 2025.06.18 08:40:13.895718 [ 66726 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_212_212_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.895786 [ 66719 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_215_5 from disk default 2025.06.18 08:40:13.896759 [ 66726 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_212_212_0 on disk default 2025.06.18 08:40:13.896884 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_212_212_0 2025.06.18 08:40:13.897089 [ 66726 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_220_6 from disk default 2025.06.18 08:40:13.903148 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_453_2 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.903206 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_453_2 on disk default 2025.06.18 08:40:13.903268 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_453_2 2025.06.18 08:40:13.903730 [ 66689 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_210_210_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.903754 [ 66739 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_238_238_0 from disk default 2025.06.18 08:40:13.903875 [ 66689 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_210_210_0 on disk default 2025.06.18 08:40:13.903994 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_210_210_0 2025.06.18 08:40:13.906182 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_225_7 from disk default 2025.06.18 08:40:13.906659 [ 66739 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_238_238_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.906715 [ 66739 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_238_238_0 on disk default 2025.06.18 08:40:13.906781 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_238_238_0 2025.06.18 08:40:13.906959 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_463_4 from disk default 2025.06.18 08:40:13.909105 [ 66731 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_212_212_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.909971 [ 66731 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_212_212_0 on disk default 2025.06.18 08:40:13.911559 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_448_1 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.911657 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_448_1 on disk default 2025.06.18 08:40:13.911076 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_212_212_0 2025.06.18 08:40:13.911978 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_448_1 2025.06.18 08:40:13.912011 [ 66736 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_216_216_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.912162 [ 66736 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_216_216_0 on disk default 2025.06.18 08:40:13.912250 [ 66736 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_216_216_0 2025.06.18 08:40:13.912262 [ 66693 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_230_8 from disk default 2025.06.18 08:40:13.913198 [ 66684 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_468_5 from disk default 2025.06.18 08:40:13.913284 [ 66734 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_189_189_0 from disk default 2025.06.18 08:40:13.914068 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_463_4 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.914127 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_463_4 on disk default 2025.06.18 08:40:13.915418 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_463_4 2025.06.18 08:40:13.915595 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_443_473_6 from disk default 2025.06.18 08:40:13.914876 [ 66735 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_207_207_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.917140 [ 66735 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_207_207_0 on disk default 2025.06.18 08:40:13.917513 [ 66746 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_210_4 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.918276 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_207_207_0 2025.06.18 08:40:13.918648 [ 66746 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_210_4 on disk default 2025.06.18 08:40:13.918750 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_210_4 2025.06.18 08:40:13.919084 [ 66735 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_237_237_0 from disk default 2025.06.18 08:40:13.919212 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_236_236_0 from disk default 2025.06.18 08:40:13.919411 [ 66726 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_220_6 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.919473 [ 66726 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_220_6 on disk default 2025.06.18 08:40:13.919491 [ 66719 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_215_5 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.919509 [ 66730 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_458_3 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.919550 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_220_6 2025.06.18 08:40:13.919561 [ 66734 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_189_189_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.919560 [ 66719 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_215_5 on disk default 2025.06.18 08:40:13.919602 [ 66730 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_458_3 on disk default 2025.06.18 08:40:13.919626 [ 66734 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_189_189_0 on disk default 2025.06.18 08:40:13.919669 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_215_5 2025.06.18 08:40:13.919732 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_458_3 2025.06.18 08:40:13.919773 [ 66726 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_187_187_0 from disk default 2025.06.18 08:40:13.920016 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_189_189_0 2025.06.18 08:40:13.920817 [ 66734 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_210_210_0 from disk default 2025.06.18 08:40:13.921132 [ 66738 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_235_9 from disk default 2025.06.18 08:40:13.926184 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_442_442_0 from disk default 2025.06.18 08:40:13.926738 [ 66735 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_237_237_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.926814 [ 66735 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_237_237_0 on disk default 2025.06.18 08:40:13.926930 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_237_237_0 2025.06.18 08:40:13.927155 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_188_188_0 from disk default 2025.06.18 08:40:13.929947 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_236_236_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.930455 [ 66732 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_236_236_0 on disk default 2025.06.18 08:40:13.930580 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_236_236_0 2025.06.18 08:40:13.930794 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_473_6 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.930825 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_235_235_0 from disk default 2025.06.18 08:40:13.930871 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_473_6 on disk default 2025.06.18 08:40:13.930890 [ 66684 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_443_468_5 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.930941 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_473_6 2025.06.18 08:40:13.930952 [ 66684 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_443_468_5 on disk default 2025.06.18 08:40:13.932163 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_443_468_5 2025.06.18 08:40:13.932988 [ 66729 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_441_441_0 from disk default 2025.06.18 08:40:13.935009 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_235_235_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.935075 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_235_235_0 on disk default 2025.06.18 08:40:13.935130 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_225_7 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.935157 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_235_235_0 2025.06.18 08:40:13.935206 [ 66711 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_225_7 on disk default 2025.06.18 08:40:13.935276 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_225_7 2025.06.18 08:40:13.935804 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_440_440_0 from disk default 2025.06.18 08:40:13.935835 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_209_209_0 from disk default 2025.06.18 08:40:13.936869 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_238_10 from disk default 2025.06.18 08:40:13.937690 [ 66693 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_230_8 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.937747 [ 66693 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_230_8 on disk default 2025.06.18 08:40:13.937975 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_230_8 2025.06.18 08:40:13.938139 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_187_187_0 from disk default 2025.06.18 08:40:13.938783 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_188_188_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.938844 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_188_188_0 on disk default 2025.06.18 08:40:13.938911 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_188_188_0 2025.06.18 08:40:13.939662 [ 66689 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_439_439_0 from disk default 2025.06.18 08:40:13.940702 [ 66729 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_441_441_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.940755 [ 66729 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_441_441_0 on disk default 2025.06.18 08:40:13.941930 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_441_441_0 2025.06.18 08:40:13.942182 [ 66703 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_234_234_0 from disk default 2025.06.18 08:40:13.942578 [ 66734 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_210_210_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.942633 [ 66734 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_210_210_0 on disk default 2025.06.18 08:40:13.942697 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_210_210_0 2025.06.18 08:40:13.942782 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_442_442_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.942835 [ 66685 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_442_442_0 on disk default 2025.06.18 08:40:13.943139 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_442_442_0 2025.06.18 08:40:13.943613 [ 66731 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_186_186_0 from disk default 2025.06.18 08:40:13.943703 [ 66736 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_239_11 from disk default 2025.06.18 08:40:13.944004 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_187_187_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.944080 [ 66693 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_187_187_0 on disk default 2025.06.18 08:40:13.944697 [ 66738 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_235_9 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.944756 [ 66738 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_235_9 on disk default 2025.06.18 08:40:13.944827 [ 66738 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_235_9 2025.06.18 08:40:13.944996 [ 66738 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_438_438_0 from disk default 2025.06.18 08:40:13.945310 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_187_187_0 2025.06.18 08:40:13.945745 [ 66746 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_233_233_0 from disk default 2025.06.18 08:40:13.948788 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_440_440_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.948848 [ 66739 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_440_440_0 on disk default 2025.06.18 08:40:13.948918 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_440_440_0 2025.06.18 08:40:13.949651 [ 66739 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_185_185_0 from disk default 2025.06.18 08:40:13.950107 [ 66703 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_234_234_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.950169 [ 66703 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_234_234_0 on disk default 2025.06.18 08:40:13.950247 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_234_234_0 2025.06.18 08:40:13.950440 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_437_437_0 from disk default 2025.06.18 08:40:13.954401 [ 66746 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_233_233_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.954460 [ 66746 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_233_233_0 on disk default 2025.06.18 08:40:13.955383 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_233_233_0 2025.06.18 08:40:13.955580 [ 66746 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_186_186_0 from disk default 2025.06.18 08:40:13.957477 [ 66738 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_438_438_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.957510 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_209_209_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.957535 [ 66738 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_438_438_0 on disk default 2025.06.18 08:40:13.957582 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_209_209_0 on disk default 2025.06.18 08:40:13.957618 [ 66738 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_438_438_0 2025.06.18 08:40:13.957656 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_209_209_0 2025.06.18 08:40:13.957746 [ 66738 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_184_184_0 from disk default 2025.06.18 08:40:13.958313 [ 66690 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_436_436_0 from disk default 2025.06.18 08:40:13.959984 [ 66689 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_439_439_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.960044 [ 66689 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_439_439_0 on disk default 2025.06.18 08:40:13.960105 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_439_439_0 2025.06.18 08:40:13.961492 [ 66746 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_186_186_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.961513 [ 66735 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_185_185_0 from disk default 2025.06.18 08:40:13.961606 [ 66746 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_186_186_0 on disk default 2025.06.18 08:40:13.961618 [ 66747 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_202_202_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.961704 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_186_186_0 2025.06.18 08:40:13.961741 [ 66747 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_202_202_0 on disk default 2025.06.18 08:40:13.961875 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_202_202_0 2025.06.18 08:40:13.962110 [ 66684 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_190_240_12 from disk default 2025.06.18 08:40:13.962187 [ 66732 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_183_183_0 from disk default 2025.06.18 08:40:13.966898 [ 66735 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_185_185_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.966948 [ 66735 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_185_185_0 on disk default 2025.06.18 08:40:13.967008 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_185_185_0 2025.06.18 08:40:13.967351 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_232_232_0 from disk default 2025.06.18 08:40:13.968450 [ 66690 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_436_436_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.968510 [ 66690 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_436_436_0 on disk default 2025.06.18 08:40:13.968566 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_238_10 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.968595 [ 66690 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_436_436_0 2025.06.18 08:40:13.968627 [ 66696 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_238_10 on disk default 2025.06.18 08:40:13.968770 [ 66690 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_182_182_0 from disk default 2025.06.18 08:40:13.969789 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_238_10 2025.06.18 08:40:13.970166 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_231_231_0 from disk default 2025.06.18 08:40:13.971854 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_232_232_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.971910 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_232_232_0 on disk default 2025.06.18 08:40:13.971971 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_232_232_0 2025.06.18 08:40:13.972589 [ 66686 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_181_181_0 from disk default 2025.06.18 08:40:13.980535 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_231_231_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.980604 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_231_231_0 on disk default 2025.06.18 08:40:13.980626 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_437_437_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.980668 [ 66736 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_239_11 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.980686 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_437_437_0 on disk default 2025.06.18 08:40:13.980731 [ 66736 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_239_11 on disk default 2025.06.18 08:40:13.981308 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_231_231_0 2025.06.18 08:40:13.981332 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_437_437_0 2025.06.18 08:40:13.981492 [ 66750 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_213_213_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.981552 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_189_189_0 from disk default 2025.06.18 08:40:13.981636 [ 66750 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_213_213_0 on disk default 2025.06.18 08:40:13.982064 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_184_184_0 from disk default 2025.06.18 08:40:13.981712 [ 66750 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_213_213_0 2025.06.18 08:40:13.983062 [ 66734 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_188_188_0 from disk default 2025.06.18 08:40:13.984734 [ 66736 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_239_11 2025.06.18 08:40:13.985740 [ 66685 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_183_183_0 from disk default 2025.06.18 08:40:13.985745 [ 66720 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_219_219_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.986706 [ 66720 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_219_219_0 on disk default 2025.06.18 08:40:13.986791 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_184_184_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.986849 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_184_184_0 on disk default 2025.06.18 08:40:13.986956 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_184_184_0 2025.06.18 08:40:13.987147 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_230_230_0 from disk default 2025.06.18 08:40:13.986786 [ 66720 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_219_219_0 2025.06.18 08:40:13.987564 [ 66693 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_229_229_0 from disk default 2025.06.18 08:40:13.988800 [ 66688 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_205_205_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.989229 [ 66688 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_205_205_0 on disk default 2025.06.18 08:40:13.989328 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_205_205_0 2025.06.18 08:40:13.989569 [ 66685 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_183_183_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.989608 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_182_182_0 from disk default 2025.06.18 08:40:13.989638 [ 66685 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_183_183_0 on disk default 2025.06.18 08:40:13.989976 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_183_183_0 2025.06.18 08:40:13.990084 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_230_230_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.990153 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_230_230_0 on disk default 2025.06.18 08:40:13.990169 [ 66685 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_208_208_0 from disk default 2025.06.18 08:40:13.990229 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_230_230_0 2025.06.18 08:40:13.990432 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_181_181_0 from disk default 2025.06.18 08:40:13.991013 [ 66693 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_229_229_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.991067 [ 66693 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_229_229_0 on disk default 2025.06.18 08:40:13.991128 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_229_229_0 2025.06.18 08:40:13.991259 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_207_207_0 from disk default 2025.06.18 08:40:13.991657 [ 66715 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_193_193_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.991815 [ 66715 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_193_193_0 on disk default 2025.06.18 08:40:13.991930 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_193_193_0 2025.06.18 08:40:13.992622 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_206_206_0 from disk default 2025.06.18 08:40:13.993632 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_182_182_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.993706 [ 66749 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_182_182_0 on disk default 2025.06.18 08:40:13.993736 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_181_181_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.993761 [ 66728 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_204_204_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.993865 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_181_181_0 on disk default 2025.06.18 08:40:13.993892 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_182_182_0 2025.06.18 08:40:13.993983 [ 66728 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_204_204_0 on disk default 2025.06.18 08:40:13.994050 [ 66741 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_199_199_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.993997 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_181_181_0 2025.06.18 08:40:13.994182 [ 66741 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_199_199_0 on disk default 2025.06.18 08:40:13.994210 [ 66689 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_180_180_0 from disk default 2025.06.18 08:40:13.994251 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_204_204_0 2025.06.18 08:40:13.994270 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_199_199_0 2025.06.18 08:40:13.995480 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_189_189_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.995551 [ 66740 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_189_189_0 on disk default 2025.06.18 08:40:13.995615 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_189_189_0 2025.06.18 08:40:13.995642 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_180_180_0 from disk default 2025.06.18 08:40:13.996854 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_207_207_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.997216 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_206_206_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.997331 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_206_206_0 on disk default 2025.06.18 08:40:13.997460 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_207_207_0 on disk default 2025.06.18 08:40:13.997481 [ 66685 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_208_208_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.997574 [ 66685 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_208_208_0 on disk default 2025.06.18 08:40:13.997653 [ 66735 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_187_187_0 from disk default 2025.06.18 08:40:13.997724 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_206_206_0 2025.06.18 08:40:13.997737 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_207_207_0 2025.06.18 08:40:13.997766 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_208_208_0 2025.06.18 08:40:13.998324 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_206_206_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:13.998382 [ 66711 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_206_206_0 on disk default 2025.06.18 08:40:13.998445 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_206_206_0 2025.06.18 08:40:13.999806 [ 66696 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_228_228_0 from disk default 2025.06.18 08:40:14.000081 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_227_227_0 from disk default 2025.06.18 08:40:14.000837 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_180_180_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.000903 [ 66730 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_180_180_0 on disk default 2025.06.18 08:40:14.001094 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_180_180_0 2025.06.18 08:40:14.001973 [ 66721 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_205_205_0 from disk default 2025.06.18 08:40:14.002468 [ 66747 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_226_226_0 from disk default 2025.06.18 08:40:14.002578 [ 66724 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_225_225_0 from disk default 2025.06.18 08:40:14.004225 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_179_36 from disk default 2025.06.18 08:40:14.004291 [ 66729 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_186_186_0 from disk default 2025.06.18 08:40:14.004810 [ 66696 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_228_228_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.004887 [ 66696 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_228_228_0 on disk default 2025.06.18 08:40:14.005656 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_228_228_0 2025.06.18 08:40:14.005895 [ 66736 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_179_179_0 from disk default 2025.06.18 08:40:14.006774 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_227_227_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.006839 [ 66727 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_227_227_0 on disk default 2025.06.18 08:40:14.008381 [ 66724 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_225_225_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.008439 [ 66724 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_225_225_0 on disk default 2025.06.18 08:40:14.008684 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_225_225_0 2025.06.18 08:40:14.008698 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_227_227_0 2025.06.18 08:40:14.008871 [ 66724 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_185_185_0 from disk default 2025.06.18 08:40:14.009327 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_179_36 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.009377 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_179_36 on disk default 2025.06.18 08:40:14.009437 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_179_36 2025.06.18 08:40:14.009608 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_224_224_0 from disk default 2025.06.18 08:40:14.008949 [ 66727 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_204_204_0 from disk default 2025.06.18 08:40:14.012643 [ 66747 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_226_226_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.012697 [ 66747 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_226_226_0 on disk default 2025.06.18 08:40:14.012758 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_226_226_0 2025.06.18 08:40:14.012929 [ 66703 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_184_37 from disk default 2025.06.18 08:40:14.014358 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_224_224_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.014418 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_224_224_0 on disk default 2025.06.18 08:40:14.016001 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_224_224_0 2025.06.18 08:40:14.016316 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_189_38 from disk default 2025.06.18 08:40:14.019087 [ 66721 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_205_205_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.019169 [ 66721 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_205_205_0 on disk default 2025.06.18 08:40:14.020030 [ 65992 ] {} SystemLog: Creating system.error_log from error_log 2025.06.18 08:40:14.020175 [ 66703 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_184_37 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.020245 [ 66703 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_184_37 on disk default 2025.06.18 08:40:14.023944 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_205_205_0 2025.06.18 08:40:14.023978 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_184_37 2025.06.18 08:40:14.024504 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_435_435_0 from disk default 2025.06.18 08:40:14.024682 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_434_434_0 from disk default 2025.06.18 08:40:14.026136 [ 66684 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_190_240_12 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.026213 [ 66684 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_190_240_12 on disk default 2025.06.18 08:40:14.027644 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_240_12 2025.06.18 08:40:14.029021 [ 66735 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_187_187_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.029077 [ 66735 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_187_187_0 on disk default 2025.06.18 08:40:14.029147 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_187_187_0 2025.06.18 08:40:14.030829 [ 66715 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_203_203_0 from disk default 2025.06.18 08:40:14.031763 [ 66727 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_204_204_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.031782 [ 66729 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_186_186_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.031819 [ 66727 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_204_204_0 on disk default 2025.06.18 08:40:14.031843 [ 66729 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_186_186_0 on disk default 2025.06.18 08:40:14.031886 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_204_204_0 2025.06.18 08:40:14.031914 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_186_186_0 2025.06.18 08:40:14.032126 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_433_433_0 from disk default 2025.06.18 08:40:14.032205 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_223_223_0 from disk default 2025.06.18 08:40:14.032442 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_178_178_0 from disk default 2025.06.18 08:40:14.032994 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_189_38 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.033048 [ 66717 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_189_38 on disk default 2025.06.18 08:40:14.033109 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_189_38 2025.06.18 08:40:14.031459 [ 66718 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_198_198_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.033789 [ 66718 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_198_198_0 on disk default 2025.06.18 08:40:14.033847 [ 66685 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_177_177_0 from disk default 2025.06.18 08:40:14.034654 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_435_435_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.034688 [ 66734 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_188_188_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.034710 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_435_435_0 on disk default 2025.06.18 08:40:14.034738 [ 66734 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_188_188_0 on disk default 2025.06.18 08:40:14.037101 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_188_188_0 2025.06.18 08:40:14.037118 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_435_435_0 2025.06.18 08:40:14.037859 [ 66741 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loading Outdated part 202506_1_184_73 from disk default 2025.06.18 08:40:14.038055 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_432_432_0 from disk default 2025.06.18 08:40:14.038446 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_198_198_0 2025.06.18 08:40:14.038908 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_202_202_0 from disk default 2025.06.18 08:40:14.040144 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_434_434_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.040167 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_223_223_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.040200 [ 66703 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_434_434_0 on disk default 2025.06.18 08:40:14.040224 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_223_223_0 on disk default 2025.06.18 08:40:14.040267 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_434_434_0 2025.06.18 08:40:14.040291 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_223_223_0 2025.06.18 08:40:14.040655 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_222_222_0 from disk default 2025.06.18 08:40:14.040898 [ 66714 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_200_200_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.041007 [ 66714 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_200_200_0 on disk default 2025.06.18 08:40:14.041117 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_200_200_0 2025.06.18 08:40:14.041335 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_176_176_0 from disk default 2025.06.18 08:40:14.041740 [ 66703 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_175_175_0 from disk default 2025.06.18 08:40:14.042612 [ 66733 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_208_208_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.042741 [ 66733 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_208_208_0 on disk default 2025.06.18 08:40:14.042853 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_208_208_0 2025.06.18 08:40:14.043075 [ 66682 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_194_39 from disk default 2025.06.18 08:40:14.043465 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_433_433_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.043521 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_433_433_0 on disk default 2025.06.18 08:40:14.044592 [ 66724 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_185_185_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.044648 [ 66724 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_185_185_0 on disk default 2025.06.18 08:40:14.045749 [ 66715 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_203_203_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.045811 [ 66715 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_203_203_0 on disk default 2025.06.18 08:40:14.046128 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_433_433_0 2025.06.18 08:40:14.046148 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_185_185_0 2025.06.18 08:40:14.046160 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_203_203_0 2025.06.18 08:40:14.046294 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_199_40 from disk default 2025.06.18 08:40:14.046372 [ 66724 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_204_41 from disk default 2025.06.18 08:40:14.046462 [ 66715 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_201_40 from disk default 2025.06.18 08:40:14.046635 [ 66691 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_196_196_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.047454 [ 66691 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_196_196_0 on disk default 2025.06.18 08:40:14.047527 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_196_196_0 2025.06.18 08:40:14.049225 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_432_437_1 from disk default 2025.06.18 08:40:14.049903 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_222_222_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.049971 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_222_222_0 on disk default 2025.06.18 08:40:14.050040 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_222_222_0 2025.06.18 08:40:14.050210 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_221_221_0 from disk default 2025.06.18 08:40:14.051745 [ 66682 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_194_39 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.051800 [ 66682 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_194_39 on disk default 2025.06.18 08:40:14.052574 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_194_39 2025.06.18 08:40:14.052805 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_220_220_0 from disk default 2025.06.18 08:40:14.053421 [ 66724 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_204_41 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.053476 [ 66724 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_204_41 on disk default 2025.06.18 08:40:14.053536 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_204_41 2025.06.18 08:40:14.053783 [ 66724 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_206_41 from disk default 2025.06.18 08:40:14.055023 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_199_40 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.055080 [ 66740 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_199_40 on disk default 2025.06.18 08:40:14.055143 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_199_40 2025.06.18 08:40:14.055311 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_211_42 from disk default 2025.06.18 08:40:14.055682 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_202_202_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.055749 [ 66693 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_202_202_0 on disk default 2025.06.18 08:40:14.056353 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_202_202_0 2025.06.18 08:40:14.056502 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_432_442_2 from disk default 2025.06.18 08:40:14.058296 [ 66737 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_203_203_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.058429 [ 66737 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_203_203_0 on disk default 2025.06.18 08:40:14.058521 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_203_203_0 2025.06.18 08:40:14.058558 [ 66723 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_197_197_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.058692 [ 66723 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_197_197_0 on disk default 2025.06.18 08:40:14.058820 [ 66684 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_431_431_0 from disk default 2025.06.18 08:40:14.059108 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_220_220_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.059190 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_220_220_0 on disk default 2025.06.18 08:40:14.059332 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_432_432_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.059406 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_432_432_0 on disk default 2025.06.18 08:40:14.059468 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_220_220_0 2025.06.18 08:40:14.059490 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_432_432_0 2025.06.18 08:40:14.059508 [ 66715 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_201_40 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.058762 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_197_197_0 2025.06.18 08:40:14.059588 [ 66715 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_201_40 on disk default 2025.06.18 08:40:14.059670 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_201_40 2025.06.18 08:40:14.060567 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_221_221_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.060627 [ 66729 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_221_221_0 on disk default 2025.06.18 08:40:14.060699 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_221_221_0 2025.06.18 08:40:14.061057 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_430_430_0 from disk default 2025.06.18 08:40:14.061082 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_219_219_0 from disk default 2025.06.18 08:40:14.061401 [ 66729 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_174_174_0 from disk default 2025.06.18 08:40:14.061536 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_216_43 from disk default 2025.06.18 08:40:14.061550 [ 66734 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_429_429_0 from disk default 2025.06.18 08:40:14.062271 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_432_437_1 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.062335 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_432_437_1 on disk default 2025.06.18 08:40:14.062564 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_432_437_1 2025.06.18 08:40:14.062751 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_209_42 from disk default 2025.06.18 08:40:14.062448 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Found 6 old parts to remove. Parts: [202506_1_201_40, 202506_202_202_0, 202506_203_203_0, 202506_204_204_0, 202506_205_205_0, 202506_206_206_0] 2025.06.18 08:40:14.063149 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 6 parts from filesystem (serially): Parts: [202506_1_201_40, 202506_202_202_0, 202506_203_203_0, 202506_204_204_0, 202506_205_205_0, 202506_206_206_0] 2025.06.18 08:40:14.063734 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_219_219_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.063805 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_219_219_0 on disk default 2025.06.18 08:40:14.063883 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_219_219_0 2025.06.18 08:40:14.064042 [ 66719 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_214_43 from disk default 2025.06.18 08:40:14.065456 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_209_42 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.065518 [ 66711 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_209_42 on disk default 2025.06.18 08:40:14.065603 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_209_42 2025.06.18 08:40:14.065787 [ 66724 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_206_41 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.065868 [ 66724 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_206_41 on disk default 2025.06.18 08:40:14.065966 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_206_41 2025.06.18 08:40:14.066438 [ 66734 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_429_429_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.066509 [ 66734 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_429_429_0 on disk default 2025.06.18 08:40:14.066607 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_429_429_0 2025.06.18 08:40:14.066987 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_1_201_40 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.066980 [ 66710 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_201_201_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.067127 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_202_202_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.067175 [ 66710 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_201_201_0 on disk default 2025.06.18 08:40:14.067174 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_203_203_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.067262 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_204_204_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.067276 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_201_201_0 2025.06.18 08:40:14.067314 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_205_205_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.067368 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_206_206_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.067464 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_216_43 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.067530 [ 66718 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_216_43 on disk default 2025.06.18 08:40:14.067638 [ 66660 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 6 parts from memory: Parts: [202506_1_201_40, 202506_202_202_0, 202506_203_203_0, 202506_204_204_0, 202506_205_205_0, 202506_206_206_0] 2025.06.18 08:40:14.067685 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_216_43 2025.06.18 08:40:14.067650 [ 66733 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_218_218_0 from disk default 2025.06.18 08:40:14.067741 [ 66720 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_219_44 from disk default 2025.06.18 08:40:14.067919 [ 66747 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_428_428_0 from disk default 2025.06.18 08:40:14.067966 [ 66719 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_214_43 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.068000 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_427_427_0 from disk default 2025.06.18 08:40:14.068048 [ 66719 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_214_43 on disk default 2025.06.18 08:40:14.068154 [ 66688 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_221_44 from disk default 2025.06.18 08:40:14.068766 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_214_43 2025.06.18 08:40:14.068928 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_226_45 from disk default 2025.06.18 08:40:14.070935 [ 66733 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_218_218_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.070991 [ 66733 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_218_218_0 on disk default 2025.06.18 08:40:14.071563 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_218_218_0 2025.06.18 08:40:14.072391 [ 66720 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_219_44 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.072463 [ 66720 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_219_44 on disk default 2025.06.18 08:40:14.072564 [ 66720 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_219_44 2025.06.18 08:40:14.074049 [ 66727 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_231_46 from disk default 2025.06.18 08:40:14.074139 [ 66720 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_173_173_0 from disk default 2025.06.18 08:40:14.078287 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_427_427_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.078358 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_427_427_0 on disk default 2025.06.18 08:40:14.078444 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_427_427_0 2025.06.18 08:40:14.078453 [ 66747 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_428_428_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.078523 [ 66747 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_428_428_0 on disk default 2025.06.18 08:40:14.078669 [ 66746 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_172_172_0 from disk default 2025.06.18 08:40:14.079154 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_428_428_0 2025.06.18 08:40:14.079322 [ 66747 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_236_47 from disk default 2025.06.18 08:40:14.080399 [ 66688 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_221_44 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.080459 [ 66688 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_221_44 on disk default 2025.06.18 08:40:14.080521 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_221_44 2025.06.18 08:40:14.080667 [ 66688 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_217_217_0 from disk default 2025.06.18 08:40:14.081060 [ 66727 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_231_46 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.081116 [ 66727 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_231_46 on disk default 2025.06.18 08:40:14.081147 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_226_45 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.081227 [ 66719 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_226_45 on disk default 2025.06.18 08:40:14.081057 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_192_192_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.081343 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_231_46 2025.06.18 08:40:14.081366 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_226_45 2025.06.18 08:40:14.081506 [ 66727 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_171_34 from disk default 2025.06.18 08:40:14.081441 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_192_192_0 on disk default 2025.06.18 08:40:14.082250 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_192_192_0 2025.06.18 08:40:14.082678 [ 66737 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_426_426_0 from disk default 2025.06.18 08:40:14.083474 [ 66688 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_217_217_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.083537 [ 66688 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_217_217_0 on disk default 2025.06.18 08:40:14.083629 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_432_442_2 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.083678 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_217_217_0 2025.06.18 08:40:14.083686 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_432_442_2 on disk default 2025.06.18 08:40:14.083815 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_432_442_2 2025.06.18 08:40:14.083871 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_425_425_0 from disk default 2025.06.18 08:40:14.084010 [ 66730 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_176_35 from disk default 2025.06.18 08:40:14.084852 [ 66741 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): loadDataPart: inserting 202506_1_184_73 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.084926 [ 66741 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Finished loading Outdated part 202506_1_184_73 on disk default 2025.06.18 08:40:14.085025 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_1_184_73 2025.06.18 08:40:14.085202 [ 66750 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_241_48 from disk default 2025.06.18 08:40:14.085712 [ 66714 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_246_49 from disk default 2025.06.18 08:40:14.085770 [ 66031 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Loaded 70 outdated data parts asynchronously 2025.06.18 08:40:14.086717 [ 66031 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 1097 ms. 2025.06.18 08:40:14.089827 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Found 5 old parts to remove. Parts: [20250618_1_1_0, 20250618_2_2_0, 20250618_3_3_0, 20250618_4_4_0, 20250618_5_5_0] 2025.06.18 08:40:14.089949 [ 66737 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_426_426_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.089949 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Removing 5 parts from filesystem (serially): Parts: [20250618_1_1_0, 20250618_2_2_0, 20250618_3_3_0, 20250618_4_4_0, 20250618_5_5_0] 2025.06.18 08:40:14.090175 [ 66737 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_426_426_0 on disk default 2025.06.18 08:40:14.090250 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_426_426_0 2025.06.18 08:40:14.090404 [ 66737 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_181_36 from disk default 2025.06.18 08:40:14.093620 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_211_42 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.093675 [ 66740 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_211_42 on disk default 2025.06.18 08:40:14.093737 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_211_42 2025.06.18 08:40:14.093886 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_224_45 from disk default 2025.06.18 08:40:14.097483 [ 66750 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_241_48 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.097550 [ 66750 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_241_48 on disk default 2025.06.18 08:40:14.098018 [ 66750 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_241_48 2025.06.18 08:40:14.098725 [ 66724 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_251_50 from disk default 2025.06.18 08:40:14.100646 [ 66684 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_431_431_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.100703 [ 66684 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_431_431_0 on disk default 2025.06.18 08:40:14.100013 [ 65992 ] {} SystemLog: Creating system.filesystem_cache_log from filesystem_cache_log 2025.06.18 08:40:14.100974 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_431_431_0 2025.06.18 08:40:14.101198 [ 66684 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_216_216_0 from disk default 2025.06.18 08:40:14.102858 [ 66714 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_246_49 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.102933 [ 66714 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_246_49 on disk default 2025.06.18 08:40:14.103064 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_246_49 2025.06.18 08:40:14.103257 [ 66718 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_229_46 from disk default 2025.06.18 08:40:14.104368 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_430_430_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.104428 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_430_430_0 on disk default 2025.06.18 08:40:14.104489 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_430_430_0 2025.06.18 08:40:14.104689 [ 66749 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_256_51 from disk default 2025.06.18 08:40:14.104394 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): removePartsFinally: removing 20250618_1_1_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.105199 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): removePartsFinally: removing 20250618_2_2_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.105234 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): removePartsFinally: removing 20250618_3_3_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.105260 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): removePartsFinally: removing 20250618_4_4_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.105283 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): removePartsFinally: removing 20250618_5_5_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.105315 [ 66664 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Removing 5 parts from memory: Parts: [20250618_1_1_0, 20250618_2_2_0, 20250618_3_3_0, 20250618_4_4_0, 20250618_5_5_0] 2025.06.18 08:40:14.106869 [ 66747 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_236_47 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.106957 [ 66747 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_236_47 on disk default 2025.06.18 08:40:14.107089 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_236_47 2025.06.18 08:40:14.107268 [ 66684 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_216_216_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.107346 [ 66684 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_216_216_0 on disk default 2025.06.18 08:40:14.107366 [ 66691 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_186_37 from disk default 2025.06.18 08:40:14.107435 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_216_216_0 2025.06.18 08:40:14.107680 [ 66718 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_229_46 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.107737 [ 66718 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_229_46 on disk default 2025.06.18 08:40:14.107798 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_229_46 2025.06.18 08:40:14.107968 [ 66684 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_215_215_0 from disk default 2025.06.18 08:40:14.108266 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_424_424_0 from disk default 2025.06.18 08:40:14.114105 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_425_425_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.114168 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_425_425_0 on disk default 2025.06.18 08:40:14.114245 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_425_425_0 2025.06.18 08:40:14.114475 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_423_423_0 from disk default 2025.06.18 08:40:14.120962 [ 66724 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_251_50 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.121018 [ 66724 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_251_50 on disk default 2025.06.18 08:40:14.121078 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_251_50 2025.06.18 08:40:14.121267 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_214_214_0 from disk default 2025.06.18 08:40:14.123128 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_224_45 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.123194 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_224_45 on disk default 2025.06.18 08:40:14.123564 [ 66749 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_256_51 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.123640 [ 66749 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_256_51 on disk default 2025.06.18 08:40:14.124806 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_256_51 2025.06.18 08:40:14.124926 [ 66684 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_215_215_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.125003 [ 66684 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_215_215_0 on disk default 2025.06.18 08:40:14.125018 [ 66749 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loading Outdated part 202506_1_260_52 from disk default 2025.06.18 08:40:14.125096 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_215_215_0 2025.06.18 08:40:14.125246 [ 66684 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_191_38 from disk default 2025.06.18 08:40:14.125707 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Found 5 old parts to remove. Parts: [202506_1_147_59, 202506_148_152_1, 202506_153_153_0, 202506_154_154_0, 202506_155_155_0] 2025.06.18 08:40:14.125882 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Removing 5 parts from filesystem (serially): Parts: [202506_1_147_59, 202506_148_152_1, 202506_153_153_0, 202506_154_154_0, 202506_155_155_0] 2025.06.18 08:40:14.126421 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_424_424_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.127460 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_424_424_0 on disk default 2025.06.18 08:40:14.127529 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_424_424_0 2025.06.18 08:40:14.127777 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_213_213_0 from disk default 2025.06.18 08:40:14.127789 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_224_45 2025.06.18 08:40:14.127956 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loading Outdated part 202506_1_234_47 from disk default 2025.06.18 08:40:14.131197 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_214_214_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.131261 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_214_214_0 on disk default 2025.06.18 08:40:14.131599 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_213_213_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.131657 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_213_213_0 on disk default 2025.06.18 08:40:14.132159 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_213_213_0 2025.06.18 08:40:14.132176 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_214_214_0 2025.06.18 08:40:14.133044 [ 66688 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_196_39 from disk default 2025.06.18 08:40:14.133154 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_422_422_0 from disk default 2025.06.18 08:40:14.134319 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_423_423_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.134378 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_423_423_0 on disk default 2025.06.18 08:40:14.134810 [ 66749 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): loadDataPart: inserting 202506_1_260_52 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.134869 [ 66749 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Finished loading Outdated part 202506_1_260_52 on disk default 2025.06.18 08:40:14.135512 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_423_423_0 2025.06.18 08:40:14.135739 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_260_52 2025.06.18 08:40:14.135802 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_212_212_0 from disk default 2025.06.18 08:40:14.136751 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): loadDataPart: inserting 202506_1_234_47 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.136833 [ 66710 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Finished loading Outdated part 202506_1_234_47 on disk default 2025.06.18 08:40:14.136919 [ 66036 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Loaded 77 outdated data parts asynchronously 2025.06.18 08:40:14.137084 [ 66036 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 1148 ms. 2025.06.18 08:40:14.137352 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_211_42 from disk default 2025.06.18 08:40:14.136962 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e), part: 202506_1_234_47 2025.06.18 08:40:14.137613 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_1_147_59 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.138519 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_148_152_1 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.138576 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_153_153_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.138627 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_154_154_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.138673 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_155_155_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.138726 [ 66659 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Removing 5 parts from memory: Parts: [202506_1_147_59, 202506_148_152_1, 202506_153_153_0, 202506_154_154_0, 202506_155_155_0] 2025.06.18 08:40:14.139320 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_212_212_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.139835 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_212_212_0 on disk default 2025.06.18 08:40:14.139945 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_212_212_0 2025.06.18 08:40:14.139971 [ 66712 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_195_195_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.140050 [ 65992 ] {} SystemLog: Not creating system.filesystem_read_prefetches_log since corresponding section 'filesystem_read_prefetches_log' is missing from config 2025.06.18 08:40:14.140101 [ 66712 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_195_195_0 on disk default 2025.06.18 08:40:14.140123 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_216_43 from disk default 2025.06.18 08:40:14.140200 [ 65992 ] {} SystemLog: Creating system.s3queue_log from s3queue_log 2025.06.18 08:40:14.140273 [ 66050 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Loaded 72 outdated data parts asynchronously 2025.06.18 08:40:14.140384 [ 66050 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 1148 ms. 2025.06.18 08:40:14.141015 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_211_42 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.141088 [ 66750 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_201_40 from disk default 2025.06.18 08:40:14.141093 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_211_42 on disk default 2025.06.18 08:40:14.141365 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_195_195_0 2025.06.18 08:40:14.141718 [ 66734 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_206_41 from disk default 2025.06.18 08:40:14.141743 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_211_42 2025.06.18 08:40:14.141946 [ 66714 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_221_44 from disk default 2025.06.18 08:40:14.146559 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_216_43 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.146653 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_216_43 on disk default 2025.06.18 08:40:14.146681 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_422_422_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.146764 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_422_422_0 on disk default 2025.06.18 08:40:14.146829 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_216_43 2025.06.18 08:40:14.146901 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_422_422_0 2025.06.18 08:40:14.147046 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_226_45 from disk default 2025.06.18 08:40:14.147336 [ 66747 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_211_42 from disk default 2025.06.18 08:40:14.148015 [ 66714 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_221_44 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.148077 [ 66714 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_221_44 on disk default 2025.06.18 08:40:14.148723 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_221_44 2025.06.18 08:40:14.149294 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_421_421_0 from disk default 2025.06.18 08:40:14.155745 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_226_45 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.155798 [ 66717 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_226_45 on disk default 2025.06.18 08:40:14.158000 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_226_45 2025.06.18 08:40:14.158658 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_420_420_0 from disk default 2025.06.18 08:40:14.158817 [ 65992 ] {} SystemLog: Not creating system.azure_queue_log since corresponding section 'azure_queue_log' is missing from config 2025.06.18 08:40:14.158983 [ 65992 ] {} SystemLog: Creating system.asynchronous_metric_log from asynchronous_metric_log 2025.06.18 08:40:14.162663 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_421_421_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.162741 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_421_421_0 on disk default 2025.06.18 08:40:14.162824 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_421_421_0 2025.06.18 08:40:14.162985 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_419_419_0 from disk default 2025.06.18 08:40:14.167612 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_420_420_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.167681 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_420_420_0 on disk default 2025.06.18 08:40:14.168467 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_420_420_0 2025.06.18 08:40:14.168709 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_418_418_0 from disk default 2025.06.18 08:40:14.175078 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_419_419_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.175145 [ 66733 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_419_419_0 on disk default 2025.06.18 08:40:14.175212 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_419_419_0 2025.06.18 08:40:14.175373 [ 66733 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loading Outdated part 202506_1_216_43 from disk default 2025.06.18 08:40:14.186275 [ 66716 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_194_194_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.186390 [ 66716 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_194_194_0 on disk default 2025.06.18 08:40:14.188313 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_194_194_0 2025.06.18 08:40:14.189420 [ 66728 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_231_46 from disk default 2025.06.18 08:40:14.192015 [ 65992 ] {} SystemLog: Creating system.opentelemetry_span_log from opentelemetry_span_log 2025.06.18 08:40:14.192172 [ 66694 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_191_191_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.192296 [ 66694 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_191_191_0 on disk default 2025.06.18 08:40:14.192699 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_418_418_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.192764 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_418_418_0 on disk default 2025.06.18 08:40:14.192832 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_418_418_0 2025.06.18 08:40:14.193158 [ 66725 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_236_47 from disk default 2025.06.18 08:40:14.192369 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_191_191_0 2025.06.18 08:40:14.193591 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_417_417_0 from disk default 2025.06.18 08:40:14.194932 [ 66728 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_231_46 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.195018 [ 66728 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_231_46 on disk default 2025.06.18 08:40:14.195097 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_231_46 2025.06.18 08:40:14.195344 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_241_48 from disk default 2025.06.18 08:40:14.199610 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Found 7 old parts to remove. Parts: [202506_1_138_35, 202506_1_140_36, 202506_139_139_0, 202506_140_140_0, 202506_141_141_0, 202506_142_142_0, 202506_143_143_0] 2025.06.18 08:40:14.199718 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Removing 7 parts from filesystem (serially): Parts: [202506_1_138_35, 202506_1_140_36, 202506_139_139_0, 202506_140_140_0, 202506_141_141_0, 202506_142_142_0, 202506_143_143_0] 2025.06.18 08:40:14.202672 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_241_48 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.202748 [ 66721 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_241_48 on disk default 2025.06.18 08:40:14.202839 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_241_48 2025.06.18 08:40:14.203030 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_246_49 from disk default 2025.06.18 08:40:14.203386 [ 66725 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_236_47 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.203467 [ 66725 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_236_47 on disk default 2025.06.18 08:40:14.203555 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_236_47 2025.06.18 08:40:14.203723 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_251_50 from disk default 2025.06.18 08:40:14.203752 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_417_417_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.203814 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_417_417_0 on disk default 2025.06.18 08:40:14.206108 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_417_417_0 2025.06.18 08:40:14.206623 [ 66749 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_256_51 from disk default 2025.06.18 08:40:14.207598 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_1_138_35 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207645 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_1_140_36 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207672 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_139_139_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207698 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_140_140_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207720 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_141_141_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207742 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_142_142_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207773 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_143_143_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.207807 [ 66664 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Removing 7 parts from memory: Parts: [202506_1_138_35, 202506_1_140_36, 202506_139_139_0, 202506_140_140_0, 202506_141_141_0, 202506_142_142_0, 202506_143_143_0] 2025.06.18 08:40:14.211133 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_251_50 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.211192 [ 66682 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_251_50 on disk default 2025.06.18 08:40:14.211270 [ 66749 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_256_51 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.211324 [ 66749 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_256_51 on disk default 2025.06.18 08:40:14.211383 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_256_51 2025.06.18 08:40:14.211564 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_261_52 from disk default 2025.06.18 08:40:14.211622 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_251_50 2025.06.18 08:40:14.212166 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_416_416_0 from disk default 2025.06.18 08:40:14.213246 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_246_49 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.213311 [ 66719 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_246_49 on disk default 2025.06.18 08:40:14.213393 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_246_49 2025.06.18 08:40:14.213606 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_266_53 from disk default 2025.06.18 08:40:14.218267 [ 65992 ] {} SystemLog: Creating system.query_views_log from query_views_log 2025.06.18 08:40:14.220274 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_261_52 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.220329 [ 66740 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_261_52 on disk default 2025.06.18 08:40:14.222658 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_261_52 2025.06.18 08:40:14.222905 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_415_415_0 from disk default 2025.06.18 08:40:14.229628 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_266_53 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.229898 [ 66711 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_266_53 on disk default 2025.06.18 08:40:14.230047 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_266_53 2025.06.18 08:40:14.233255 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_271_54 from disk default 2025.06.18 08:40:14.234392 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_416_416_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.234454 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_416_416_0 on disk default 2025.06.18 08:40:14.235120 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_416_416_0 2025.06.18 08:40:14.235847 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_415_415_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.235909 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_415_415_0 on disk default 2025.06.18 08:40:14.235978 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_415_415_0 2025.06.18 08:40:14.236284 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_272_55 from disk default 2025.06.18 08:40:14.236919 [ 66714 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_273_56 from disk default 2025.06.18 08:40:14.238608 [ 66748 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_190_190_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.238719 [ 66748 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_190_190_0 on disk default 2025.06.18 08:40:14.239284 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_271_54 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.239363 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_271_54 on disk default 2025.06.18 08:40:14.239486 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_271_54 2025.06.18 08:40:14.239510 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_190_190_0 2025.06.18 08:40:14.239705 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_274_57 from disk default 2025.06.18 08:40:14.239770 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_414_414_0 from disk default 2025.06.18 08:40:14.242192 [ 66714 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_273_56 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.242251 [ 66714 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_273_56 on disk default 2025.06.18 08:40:14.242316 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_273_56 2025.06.18 08:40:14.242481 [ 66724 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_275_58 from disk default 2025.06.18 08:40:14.243383 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_274_57 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.243444 [ 66741 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_274_57 on disk default 2025.06.18 08:40:14.244299 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_272_55 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.244367 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_272_55 on disk default 2025.06.18 08:40:14.244680 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_274_57 2025.06.18 08:40:14.244685 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_272_55 2025.06.18 08:40:14.245074 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_276_59 from disk default 2025.06.18 08:40:14.245163 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_413_413_0 from disk default 2025.06.18 08:40:14.248852 [ 66724 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_275_58 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.248915 [ 66724 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_275_58 on disk default 2025.06.18 08:40:14.248981 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_275_58 2025.06.18 08:40:14.249095 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loading Outdated part 202506_1_277_60 from disk default 2025.06.18 08:40:14.249118 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_414_414_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.249179 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_414_414_0 on disk default 2025.06.18 08:40:14.249770 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_276_59 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.249848 [ 66718 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_276_59 on disk default 2025.06.18 08:40:14.251828 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_414_414_0 2025.06.18 08:40:14.251854 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_276_59 2025.06.18 08:40:14.252460 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_412_412_0 from disk default 2025.06.18 08:40:14.252982 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_411_411_0 from disk default 2025.06.18 08:40:14.259891 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): loadDataPart: inserting 202506_1_277_60 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.259956 [ 66716 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Finished loading Outdated part 202506_1_277_60 on disk default 2025.06.18 08:40:14.260582 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1), part: 202506_1_277_60 2025.06.18 08:40:14.261176 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_412_412_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.261232 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_412_412_0 on disk default 2025.06.18 08:40:14.261291 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_412_412_0 2025.06.18 08:40:14.261298 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_410_410_0 from disk default 2025.06.18 08:40:14.261433 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_409_409_0 from disk default 2025.06.18 08:40:14.262169 [ 66059 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Loaded 90 outdated data parts asynchronously 2025.06.18 08:40:14.262305 [ 66059 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 1245 ms. 2025.06.18 08:40:14.263016 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_413_413_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.263076 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_413_413_0 on disk default 2025.06.18 08:40:14.263136 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_413_413_0 2025.06.18 08:40:14.263172 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_411_411_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.263268 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_411_411_0 on disk default 2025.06.18 08:40:14.263313 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_408_408_0 from disk default 2025.06.18 08:40:14.263375 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_411_411_0 2025.06.18 08:40:14.263535 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_407_407_0 from disk default 2025.06.18 08:40:14.276967 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_410_410_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.277024 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_410_410_0 on disk default 2025.06.18 08:40:14.277126 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_410_410_0 2025.06.18 08:40:14.277293 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_406_406_0 from disk default 2025.06.18 08:40:14.282873 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_408_408_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.282942 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_408_408_0 on disk default 2025.06.18 08:40:14.283021 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_408_408_0 2025.06.18 08:40:14.282508 [ 65992 ] {} SystemLog: Creating system.zookeeper_log from zookeeper_log 2025.06.18 08:40:14.283185 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_405_405_0 from disk default 2025.06.18 08:40:14.287660 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_409_409_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.287722 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_409_409_0 on disk default 2025.06.18 08:40:14.287742 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_406_406_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.287821 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_406_406_0 on disk default 2025.06.18 08:40:14.287828 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_409_409_0 2025.06.18 08:40:14.287892 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_406_406_0 2025.06.18 08:40:14.288063 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_403_403_0 from disk default 2025.06.18 08:40:14.288073 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_404_404_0 from disk default 2025.06.18 08:40:14.288926 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_407_407_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.288979 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_407_407_0 on disk default 2025.06.18 08:40:14.288997 [ 66683 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_189_189_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.289049 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_407_407_0 2025.06.18 08:40:14.289081 [ 66683 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_189_189_0 on disk default 2025.06.18 08:40:14.289196 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_189_189_0 2025.06.18 08:40:14.289250 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_402_402_0 from disk default 2025.06.18 08:40:14.289380 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_401_401_0 from disk default 2025.06.18 08:40:14.292788 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_403_403_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.292846 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_403_403_0 on disk default 2025.06.18 08:40:14.292917 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_403_403_0 2025.06.18 08:40:14.293083 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_400_400_0 from disk default 2025.06.18 08:40:14.300953 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_401_401_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.301011 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_401_401_0 on disk default 2025.06.18 08:40:14.301409 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_404_404_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.301467 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_404_404_0 on disk default 2025.06.18 08:40:14.301838 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_402_402_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.301867 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_401_401_0 2025.06.18 08:40:14.301880 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_404_404_0 2025.06.18 08:40:14.301924 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_402_402_0 on disk default 2025.06.18 08:40:14.302047 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_402_402_0 2025.06.18 08:40:14.302089 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_399_399_0 from disk default 2025.06.18 08:40:14.302135 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_398_398_0 from disk default 2025.06.18 08:40:14.302381 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_397_397_0 from disk default 2025.06.18 08:40:14.304266 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_405_405_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.304327 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_405_405_0 on disk default 2025.06.18 08:40:14.304390 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_405_405_0 2025.06.18 08:40:14.304561 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_396_396_0 from disk default 2025.06.18 08:40:14.318894 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_399_399_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.318952 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_399_399_0 on disk default 2025.06.18 08:40:14.319019 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_399_399_0 2025.06.18 08:40:14.319177 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_395_395_0 from disk default 2025.06.18 08:40:14.326972 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_398_398_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.327030 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_398_398_0 on disk default 2025.06.18 08:40:14.327124 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_400_400_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.327181 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_400_400_0 on disk default 2025.06.18 08:40:14.338157 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_398_398_0 2025.06.18 08:40:14.338245 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_400_400_0 2025.06.18 08:40:14.338429 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_394_394_0 from disk default 2025.06.18 08:40:14.338435 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_393_393_0 from disk default 2025.06.18 08:40:14.340824 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_397_397_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.340889 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_397_397_0 on disk default 2025.06.18 08:40:14.340955 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_397_397_0 2025.06.18 08:40:14.341126 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_392_392_0 from disk default 2025.06.18 08:40:14.348727 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_394_394_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.348806 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_394_394_0 on disk default 2025.06.18 08:40:14.348896 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_394_394_0 2025.06.18 08:40:14.349081 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_391_391_0 from disk default 2025.06.18 08:40:14.351200 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_396_396_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.351293 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_396_396_0 on disk default 2025.06.18 08:40:14.351316 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_392_392_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.351376 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_392_392_0 on disk default 2025.06.18 08:40:14.351479 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_392_392_0 2025.06.18 08:40:14.352368 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_390_390_0 from disk default 2025.06.18 08:40:14.353447 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_396_396_0 2025.06.18 08:40:14.353635 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_389_389_0 from disk default 2025.06.18 08:40:14.353994 [ 66687 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_188_188_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.354102 [ 66687 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_188_188_0 on disk default 2025.06.18 08:40:14.355230 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_188_188_0 2025.06.18 08:40:14.355599 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_388_388_0 from disk default 2025.06.18 08:40:14.362957 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_393_393_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.363024 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_393_393_0 on disk default 2025.06.18 08:40:14.363136 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_393_393_0 2025.06.18 08:40:14.363268 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_387_387_0 from disk default 2025.06.18 08:40:14.363738 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_391_391_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.363799 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_391_391_0 on disk default 2025.06.18 08:40:14.364473 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_391_391_0 2025.06.18 08:40:14.364624 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_386_386_0 from disk default 2025.06.18 08:40:14.365451 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_395_395_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.365511 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_395_395_0 on disk default 2025.06.18 08:40:14.366991 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_395_395_0 2025.06.18 08:40:14.367127 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_385_385_0 from disk default 2025.06.18 08:40:14.371388 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_389_389_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.371445 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_389_389_0 on disk default 2025.06.18 08:40:14.371509 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_389_389_0 2025.06.18 08:40:14.371678 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_384_384_0 from disk default 2025.06.18 08:40:14.371934 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_388_388_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.371997 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_388_388_0 on disk default 2025.06.18 08:40:14.372062 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_388_388_0 2025.06.18 08:40:14.372218 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_383_383_0 from disk default 2025.06.18 08:40:14.372525 [ 65992 ] {} SystemLog: Creating system.session_log from session_log 2025.06.18 08:40:14.373089 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_390_390_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.373164 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_390_390_0 on disk default 2025.06.18 08:40:14.374699 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_390_390_0 2025.06.18 08:40:14.374871 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_382_382_0 from disk default 2025.06.18 08:40:14.376092 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_387_387_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.376164 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_387_387_0 on disk default 2025.06.18 08:40:14.376241 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_387_387_0 2025.06.18 08:40:14.376401 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_381_381_0 from disk default 2025.06.18 08:40:14.378237 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_386_386_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.378298 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_386_386_0 on disk default 2025.06.18 08:40:14.380741 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_386_386_0 2025.06.18 08:40:14.380929 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_380_380_0 from disk default 2025.06.18 08:40:14.381573 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_383_383_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.381644 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_383_383_0 on disk default 2025.06.18 08:40:14.381657 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_384_384_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.381716 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_383_383_0 2025.06.18 08:40:14.381722 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_384_384_0 on disk default 2025.06.18 08:40:14.381831 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_384_384_0 2025.06.18 08:40:14.381892 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_379_379_0 from disk default 2025.06.18 08:40:14.382905 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_378_378_0 from disk default 2025.06.18 08:40:14.386651 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_385_385_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.386744 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_382_382_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.386802 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_382_382_0 on disk default 2025.06.18 08:40:14.386892 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_382_382_0 2025.06.18 08:40:14.387054 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_385_385_0 on disk default 2025.06.18 08:40:14.387100 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_377_377_0 from disk default 2025.06.18 08:40:14.387123 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_385_385_0 2025.06.18 08:40:14.387500 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_376_376_0 from disk default 2025.06.18 08:40:14.389406 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Found 4 old parts to remove. Parts: [202506_1_101_20, 202506_102_102_0, 202506_103_103_0, 202506_104_104_0] 2025.06.18 08:40:14.389447 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_381_381_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.389522 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_381_381_0 on disk default 2025.06.18 08:40:14.389633 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Removing 4 parts from filesystem (serially): Parts: [202506_1_101_20, 202506_102_102_0, 202506_103_103_0, 202506_104_104_0] 2025.06.18 08:40:14.389651 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_381_381_0 2025.06.18 08:40:14.389889 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_379_379_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.389952 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_375_375_0 from disk default 2025.06.18 08:40:14.389992 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_380_380_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.389966 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_379_379_0 on disk default 2025.06.18 08:40:14.390064 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_380_380_0 on disk default 2025.06.18 08:40:14.390114 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_379_379_0 2025.06.18 08:40:14.390180 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_380_380_0 2025.06.18 08:40:14.390309 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_374_374_0 from disk default 2025.06.18 08:40:14.390319 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_373_373_0 from disk default 2025.06.18 08:40:14.392497 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): removePartsFinally: removing 202506_1_101_20 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.392563 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): removePartsFinally: removing 202506_102_102_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.392592 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): removePartsFinally: removing 202506_103_103_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.392617 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): removePartsFinally: removing 202506_104_104_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.392648 [ 66660 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Removing 4 parts from memory: Parts: [202506_1_101_20, 202506_102_102_0, 202506_103_103_0, 202506_104_104_0] 2025.06.18 08:40:14.394114 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_376_376_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.394240 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_376_376_0 on disk default 2025.06.18 08:40:14.394309 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_376_376_0 2025.06.18 08:40:14.394472 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_372_372_0 from disk default 2025.06.18 08:40:14.401051 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_375_375_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.401109 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_375_375_0 on disk default 2025.06.18 08:40:14.401172 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_375_375_0 2025.06.18 08:40:14.401347 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_371_371_0 from disk default 2025.06.18 08:40:14.403284 [ 65992 ] {} SystemLog: Creating system.transactions_info_log from transactions_info_log 2025.06.18 08:40:14.403615 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_372_372_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.403684 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_372_372_0 on disk default 2025.06.18 08:40:14.403747 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_372_372_0 2025.06.18 08:40:14.403889 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_370_370_0 from disk default 2025.06.18 08:40:14.405500 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_374_374_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.405576 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_374_374_0 on disk default 2025.06.18 08:40:14.406985 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_374_374_0 2025.06.18 08:40:14.407166 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_369_369_0 from disk default 2025.06.18 08:40:14.407434 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_378_378_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.407497 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_378_378_0 on disk default 2025.06.18 08:40:14.407586 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_378_378_0 2025.06.18 08:40:14.407892 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_368_22 from disk default 2025.06.18 08:40:14.411499 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_377_377_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.411575 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_377_377_0 on disk default 2025.06.18 08:40:14.412142 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_377_377_0 2025.06.18 08:40:14.412324 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_374_23 from disk default 2025.06.18 08:40:14.414052 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_371_371_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.414108 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_371_371_0 on disk default 2025.06.18 08:40:14.414174 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_371_371_0 2025.06.18 08:40:14.414337 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_376_24 from disk default 2025.06.18 08:40:14.418345 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_370_370_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.418415 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_370_370_0 on disk default 2025.06.18 08:40:14.418484 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_370_370_0 2025.06.18 08:40:14.418668 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_377_25 from disk default 2025.06.18 08:40:14.419599 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_373_373_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.419655 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_373_373_0 on disk default 2025.06.18 08:40:14.419745 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_373_373_0 2025.06.18 08:40:14.419913 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_378_26 from disk default 2025.06.18 08:40:14.422908 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_368_22 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.422971 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_368_22 on disk default 2025.06.18 08:40:14.423044 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_368_22 2025.06.18 08:40:14.423194 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_379_27 from disk default 2025.06.18 08:40:14.435749 [ 65992 ] {} SystemLog: Creating system.processors_profile_log from processors_profile_log 2025.06.18 08:40:14.437144 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_374_23 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.437204 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_374_23 on disk default 2025.06.18 08:40:14.438297 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_376_24 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.438371 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_376_24 on disk default 2025.06.18 08:40:14.439802 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_374_23 2025.06.18 08:40:14.439817 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_376_24 2025.06.18 08:40:14.439973 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_380_28 from disk default 2025.06.18 08:40:14.440165 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_381_29 from disk default 2025.06.18 08:40:14.441099 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_377_25 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.441170 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_377_25 on disk default 2025.06.18 08:40:14.441242 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_377_25 2025.06.18 08:40:14.441253 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_369_369_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.441307 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_369_369_0 on disk default 2025.06.18 08:40:14.441372 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_369_369_0 2025.06.18 08:40:14.441402 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_382_30 from disk default 2025.06.18 08:40:14.441922 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_383_31 from disk default 2025.06.18 08:40:14.448114 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_378_26 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.448184 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_378_26 on disk default 2025.06.18 08:40:14.448633 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_378_26 2025.06.18 08:40:14.448816 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_384_32 from disk default 2025.06.18 08:40:14.454052 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_381_29 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.454126 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_381_29 on disk default 2025.06.18 08:40:14.454146 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_379_27 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.454202 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_381_29 2025.06.18 08:40:14.454211 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_379_27 on disk default 2025.06.18 08:40:14.454373 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_385_33 from disk default 2025.06.18 08:40:14.454586 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_379_27 2025.06.18 08:40:14.454815 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_386_34 from disk default 2025.06.18 08:40:14.456359 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_382_30 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.456419 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_382_30 on disk default 2025.06.18 08:40:14.456482 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_382_30 2025.06.18 08:40:14.456648 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_387_35 from disk default 2025.06.18 08:40:14.460727 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_383_31 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.460790 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_383_31 on disk default 2025.06.18 08:40:14.460854 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_383_31 2025.06.18 08:40:14.461019 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_388_36 from disk default 2025.06.18 08:40:14.462073 [ 66663 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Found 3 old parts to remove. Parts: [202506_1_184_73, 202506_185_185_0, 202506_186_186_0] 2025.06.18 08:40:14.462854 [ 66663 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Removing 3 parts from filesystem (serially): Parts: [202506_1_184_73, 202506_185_185_0, 202506_186_186_0] 2025.06.18 08:40:14.465045 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_380_28 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.465106 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_380_28 on disk default 2025.06.18 08:40:14.465174 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_380_28 2025.06.18 08:40:14.465329 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_389_37 from disk default 2025.06.18 08:40:14.477231 [ 66663 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): removePartsFinally: removing 202506_1_184_73 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.477278 [ 66663 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): removePartsFinally: removing 202506_185_185_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.477306 [ 66663 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): removePartsFinally: removing 202506_186_186_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.477338 [ 66663 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Removing 3 parts from memory: Parts: [202506_1_184_73, 202506_185_185_0, 202506_186_186_0] 2025.06.18 08:40:14.480491 [ 66731 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_186_186_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.480606 [ 66731 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_186_186_0 on disk default 2025.06.18 08:40:14.483819 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_186_186_0 2025.06.18 08:40:14.484026 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_390_38 from disk default 2025.06.18 08:40:14.494901 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_385_33 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.494963 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_385_33 on disk default 2025.06.18 08:40:14.495034 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_385_33 2025.06.18 08:40:14.495201 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_391_39 from disk default 2025.06.18 08:40:14.497699 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_386_34 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.497756 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_386_34 on disk default 2025.06.18 08:40:14.497845 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_386_34 2025.06.18 08:40:14.498576 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_392_40 from disk default 2025.06.18 08:40:14.498834 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Found 3 old parts to remove. Parts: [202506_137_157_4, 202506_158_158_0, 202506_159_159_0] 2025.06.18 08:40:14.498962 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Removing 3 parts from filesystem (serially): Parts: [202506_137_157_4, 202506_158_158_0, 202506_159_159_0] 2025.06.18 08:40:14.501523 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_384_32 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.501605 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_384_32 on disk default 2025.06.18 08:40:14.501675 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_384_32 2025.06.18 08:40:14.501872 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_393_41 from disk default 2025.06.18 08:40:14.503841 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_387_35 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.503903 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_387_35 on disk default 2025.06.18 08:40:14.504421 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): removePartsFinally: removing 202506_137_157_4 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.504469 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): removePartsFinally: removing 202506_158_158_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.504496 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): removePartsFinally: removing 202506_159_159_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.504536 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Removing 3 parts from memory: Parts: [202506_137_157_4, 202506_158_158_0, 202506_159_159_0] 2025.06.18 08:40:14.504930 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_387_35 2025.06.18 08:40:14.505112 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_394_42 from disk default 2025.06.18 08:40:14.505380 [ 65992 ] {} SystemLog: Creating system.asynchronous_insert_log from asynchronous_insert_log 2025.06.18 08:40:14.506129 [ 66726 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_187_187_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.508374 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_391_39 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.508433 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_391_39 on disk default 2025.06.18 08:40:14.508492 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_391_39 2025.06.18 08:40:14.508675 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_395_43 from disk default 2025.06.18 08:40:14.515430 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Found 7 old parts to remove. Parts: [202506_1_179_36, 202506_1_184_37, 202506_180_180_0, 202506_181_181_0, 202506_182_182_0, 202506_183_183_0, 202506_184_184_0] 2025.06.18 08:40:14.515779 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Removing 7 parts from filesystem (serially): Parts: [202506_1_179_36, 202506_1_184_37, 202506_180_180_0, 202506_181_181_0, 202506_182_182_0, 202506_183_183_0, 202506_184_184_0] 2025.06.18 08:40:14.518978 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_1_179_36 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519024 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_1_184_37 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519059 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_180_180_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519088 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_181_181_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519112 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_182_182_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519136 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_183_183_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519158 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_184_184_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.519916 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_388_36 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.520025 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_388_36 on disk default 2025.06.18 08:40:14.520133 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_388_36 2025.06.18 08:40:14.520309 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_396_44 from disk default 2025.06.18 08:40:14.523002 [ 66665 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Removing 7 parts from memory: Parts: [202506_1_179_36, 202506_1_184_37, 202506_180_180_0, 202506_181_181_0, 202506_182_182_0, 202506_183_183_0, 202506_184_184_0] 2025.06.18 08:40:14.526853 [ 66726 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_187_187_0 on disk default 2025.06.18 08:40:14.530083 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_390_38 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.530148 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_390_38 on disk default 2025.06.18 08:40:14.530219 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_390_38 2025.06.18 08:40:14.530626 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_397_45 from disk default 2025.06.18 08:40:14.530572 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_187_187_0 2025.06.18 08:40:14.530792 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_389_37 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.530899 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_389_37 on disk default 2025.06.18 08:40:14.530974 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_389_37 2025.06.18 08:40:14.531036 [ 66726 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_398_46 from disk default 2025.06.18 08:40:14.531124 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_399_47 from disk default 2025.06.18 08:40:14.535684 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_393_41 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.535760 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_393_41 on disk default 2025.06.18 08:40:14.535837 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_393_41 2025.06.18 08:40:14.536009 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_400_48 from disk default 2025.06.18 08:40:14.536391 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_392_40 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.536453 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_392_40 on disk default 2025.06.18 08:40:14.536522 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_392_40 2025.06.18 08:40:14.536712 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_401_49 from disk default 2025.06.18 08:40:14.538800 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_396_44 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.538874 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_396_44 on disk default 2025.06.18 08:40:14.542413 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_396_44 2025.06.18 08:40:14.542606 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_402_50 from disk default 2025.06.18 08:40:14.547478 [ 65992 ] {} SystemLog: Creating system.backup_log from backup_log 2025.06.18 08:40:14.549564 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_399_47 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.549693 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_399_47 on disk default 2025.06.18 08:40:14.549841 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_399_47 2025.06.18 08:40:14.550050 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_403_51 from disk default 2025.06.18 08:40:14.550296 [ 66736 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_179_179_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.550387 [ 66736 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_179_179_0 on disk default 2025.06.18 08:40:14.550574 [ 66690 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_182_182_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.550693 [ 66690 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_182_182_0 on disk default 2025.06.18 08:40:14.550779 [ 66690 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_182_182_0 2025.06.18 08:40:14.550777 [ 66736 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_179_179_0 2025.06.18 08:40:14.551006 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_404_52 from disk default 2025.06.18 08:40:14.551010 [ 66736 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_405_53 from disk default 2025.06.18 08:40:14.552284 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_401_49 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.552350 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_401_49 on disk default 2025.06.18 08:40:14.552667 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_402_50 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.552731 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_402_50 on disk default 2025.06.18 08:40:14.552982 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_402_50 2025.06.18 08:40:14.553002 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_401_49 2025.06.18 08:40:14.553187 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_406_54 from disk default 2025.06.18 08:40:14.553296 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_407_55 from disk default 2025.06.18 08:40:14.558449 [ 66689 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_180_180_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.558573 [ 66689 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_180_180_0 on disk default 2025.06.18 08:40:14.559659 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_180_180_0 2025.06.18 08:40:14.559824 [ 66731 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_408_56 from disk default 2025.06.18 08:40:14.571555 [ 66736 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_405_53 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.571622 [ 66736 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_405_53 on disk default 2025.06.18 08:40:14.571687 [ 66736 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_405_53 2025.06.18 08:40:14.571842 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_409_57 from disk default 2025.06.18 08:40:14.576533 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_394_42 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.576608 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_394_42 on disk default 2025.06.18 08:40:14.576672 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_394_42 2025.06.18 08:40:14.576868 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_406_54 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.576947 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_406_54 on disk default 2025.06.18 08:40:14.579289 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_404_52 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.579351 [ 66717 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_404_52 on disk default 2025.06.18 08:40:14.586254 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_406_54 2025.06.18 08:40:14.586260 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_410_58 from disk default 2025.06.18 08:40:14.586445 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_411_59 from disk default 2025.06.18 08:40:14.586524 [ 66717 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_404_52 2025.06.18 08:40:14.586752 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_412_60 from disk default 2025.06.18 08:40:14.589351 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_407_55 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.589412 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_407_55 on disk default 2025.06.18 08:40:14.589519 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_407_55 2025.06.18 08:40:14.589536 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_395_43 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.589613 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_395_43 on disk default 2025.06.18 08:40:14.589705 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_395_43 2025.06.18 08:40:14.590311 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_176_176_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.590391 [ 66696 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_176_176_0 on disk default 2025.06.18 08:40:14.593572 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_413_61 from disk default 2025.06.18 08:40:14.594456 [ 66696 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_176_176_0 2025.06.18 08:40:14.605280 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_414_62 from disk default 2025.06.18 08:40:14.605942 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_415_63 from disk default 2025.06.18 08:40:14.609714 [ 66739 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_185_185_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.609803 [ 66739 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_185_185_0 on disk default 2025.06.18 08:40:14.610824 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_403_51 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.610888 [ 66749 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_403_51 on disk default 2025.06.18 08:40:14.610953 [ 66749 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_403_51 2025.06.18 08:40:14.611116 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_416_64 from disk default 2025.06.18 08:40:14.616873 [ 66739 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_185_185_0 2025.06.18 08:40:14.617099 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_417_65 from disk default 2025.06.18 08:40:14.618888 [ 66726 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_398_46 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.618953 [ 66726 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_398_46 on disk default 2025.06.18 08:40:14.619081 [ 66726 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_398_46 2025.06.18 08:40:14.619078 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_409_57 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.619172 [ 66740 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_409_57 on disk default 2025.06.18 08:40:14.619245 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_418_66 from disk default 2025.06.18 08:40:14.621303 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_397_45 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.621363 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_397_45 on disk default 2025.06.18 08:40:14.621577 [ 66740 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_409_57 2025.06.18 08:40:14.621621 [ 66694 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_397_45 2025.06.18 08:40:14.621748 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_419_67 from disk default 2025.06.18 08:40:14.622447 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_420_68 from disk default 2025.06.18 08:40:14.625093 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_400_48 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.625154 [ 66725 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_400_48 on disk default 2025.06.18 08:40:14.625224 [ 66725 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_400_48 2025.06.18 08:40:14.625402 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_421_69 from disk default 2025.06.18 08:40:14.626615 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_412_60 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.626675 [ 66748 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_412_60 on disk default 2025.06.18 08:40:14.626739 [ 66748 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_412_60 2025.06.18 08:40:14.626906 [ 66690 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_422_70 from disk default 2025.06.18 08:40:14.638249 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_411_59 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.638338 [ 66724 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_411_59 on disk default 2025.06.18 08:40:14.638896 [ 66724 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_411_59 2025.06.18 08:40:14.639081 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_423_71 from disk default 2025.06.18 08:40:14.639843 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_414_62 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.639916 [ 66721 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_414_62 on disk default 2025.06.18 08:40:14.639989 [ 66721 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_414_62 2025.06.18 08:40:14.640151 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_424_72 from disk default 2025.06.18 08:40:14.642644 [ 66731 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_408_56 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.642712 [ 66731 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_408_56 on disk default 2025.06.18 08:40:14.642783 [ 66731 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_408_56 2025.06.18 08:40:14.642948 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_425_73 from disk default 2025.06.18 08:40:14.643009 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_410_58 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.643069 [ 66712 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_410_58 on disk default 2025.06.18 08:40:14.643900 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_416_64 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.643989 [ 66682 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_416_64 on disk default 2025.06.18 08:40:14.644009 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_419_67 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.644090 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_419_67 on disk default 2025.06.18 08:40:14.645064 [ 66712 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_410_58 2025.06.18 08:40:14.645109 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_415_63 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.645147 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_419_67 2025.06.18 08:40:14.645181 [ 66716 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_415_63 on disk default 2025.06.18 08:40:14.645224 [ 66689 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_426_74 from disk default 2025.06.18 08:40:14.645270 [ 66716 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_415_63 2025.06.18 08:40:14.645307 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_427_75 from disk default 2025.06.18 08:40:14.646064 [ 66682 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_416_64 2025.06.18 08:40:14.646173 [ 65992 ] {} SystemLog: Creating system.blob_storage_log from blob_storage_log 2025.06.18 08:40:14.647819 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_421_69 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.647885 [ 66683 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_421_69 on disk default 2025.06.18 08:40:14.648733 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_417_65 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.648801 [ 66718 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_417_65 on disk default 2025.06.18 08:40:14.648836 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_420_68 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.648902 [ 66714 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_420_68 on disk default 2025.06.18 08:40:14.648981 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_418_66 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.649063 [ 66719 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_418_66 on disk default 2025.06.18 08:40:14.649189 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_428_76 from disk default 2025.06.18 08:40:14.649198 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_429_77 from disk default 2025.06.18 08:40:14.655992 [ 66732 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_183_183_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.656083 [ 66732 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_183_183_0 on disk default 2025.06.18 08:40:14.656156 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_183_183_0 2025.06.18 08:40:14.656299 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_430_78 from disk default 2025.06.18 08:40:14.658964 [ 66718 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_417_65 2025.06.18 08:40:14.659091 [ 66714 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_420_68 2025.06.18 08:40:14.659504 [ 66719 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_418_66 2025.06.18 08:40:14.659584 [ 66686 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_181_181_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.659663 [ 66686 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_181_181_0 on disk default 2025.06.18 08:40:14.660193 [ 66683 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_421_69 2025.06.18 08:40:14.661526 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_431_79 from disk default 2025.06.18 08:40:14.661671 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loading Outdated part 202506_272_442_80 from disk default 2025.06.18 08:40:14.662946 [ 66686 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_181_181_0 2025.06.18 08:40:14.681412 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_413_61 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.681472 [ 66693 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_413_61 on disk default 2025.06.18 08:40:14.681553 [ 66693 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_413_61 2025.06.18 08:40:14.681762 [ 66690 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_422_70 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.681851 [ 66690 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_422_70 on disk default 2025.06.18 08:40:14.681974 [ 66690 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_422_70 2025.06.18 08:40:14.682939 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Found 4 old parts to remove. Parts: [202506_1_29_6, 202506_30_30_0, 202506_31_31_0, 202506_32_32_0] 2025.06.18 08:40:14.683036 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Removing 4 parts from filesystem (serially): Parts: [202506_1_29_6, 202506_30_30_0, 202506_31_31_0, 202506_32_32_0] 2025.06.18 08:40:14.686875 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_429_77 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.686947 [ 66741 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_429_77 on disk default 2025.06.18 08:40:14.687016 [ 66741 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_429_77 2025.06.18 08:40:14.687316 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): removePartsFinally: removing 202506_1_29_6 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.687368 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): removePartsFinally: removing 202506_30_30_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.687399 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): removePartsFinally: removing 202506_31_31_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.687425 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): removePartsFinally: removing 202506_32_32_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.687459 [ 66660 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Removing 4 parts from memory: Parts: [202506_1_29_6, 202506_30_30_0, 202506_31_31_0, 202506_32_32_0] 2025.06.18 08:40:14.689190 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_431_79 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.689263 [ 66710 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_431_79 on disk default 2025.06.18 08:40:14.689781 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_423_71 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.689871 [ 66728 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_423_71 on disk default 2025.06.18 08:40:14.689896 [ 66710 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_431_79 2025.06.18 08:40:14.689951 [ 66728 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_423_71 2025.06.18 08:40:14.692923 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_442_80 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.692992 [ 66687 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_442_80 on disk default 2025.06.18 08:40:14.693063 [ 66687 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_442_80 2025.06.18 08:40:14.694299 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_425_73 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.694372 [ 66711 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_425_73 on disk default 2025.06.18 08:40:14.694447 [ 66711 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_425_73 2025.06.18 08:40:14.695018 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_424_72 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.695079 [ 66735 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_424_72 on disk default 2025.06.18 08:40:14.695139 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_428_76 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.695248 [ 66715 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_428_76 on disk default 2025.06.18 08:40:14.695403 [ 66735 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_424_72 2025.06.18 08:40:14.695411 [ 66715 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_428_76 2025.06.18 08:40:14.697353 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_430_78 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.697462 [ 66732 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_430_78 on disk default 2025.06.18 08:40:14.697504 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_427_75 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.697601 [ 66723 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_427_75 on disk default 2025.06.18 08:40:14.697600 [ 66732 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_430_78 2025.06.18 08:40:14.697704 [ 66723 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_427_75 2025.06.18 08:40:14.698135 [ 66727 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_171_34 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.698266 [ 66727 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_171_34 on disk default 2025.06.18 08:40:14.698381 [ 66727 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_171_34 2025.06.18 08:40:14.698657 [ 65992 ] {} Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring. 2025.06.18 08:40:14.699886 [ 66689 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): loadDataPart: inserting 202506_272_426_74 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.699953 [ 66689 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Finished loading Outdated part 202506_272_426_74 on disk default 2025.06.18 08:40:14.700033 [ 66689 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_272_426_74 2025.06.18 08:40:14.704241 [ 66685 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_177_177_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.704328 [ 66685 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_177_177_0 on disk default 2025.06.18 08:40:14.704398 [ 66685 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_177_177_0 2025.06.18 08:40:14.705348 [ 66045 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Loaded 184 outdated data parts asynchronously 2025.06.18 08:40:14.705598 [ 66045 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 1714 ms. 2025.06.18 08:40:14.706793 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.706925 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.708089 [ 66729 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_174_174_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.708223 [ 66729 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_174_174_0 on disk default 2025.06.18 08:40:14.708403 [ 66729 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_174_174_0 2025.06.18 08:40:14.708648 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.708715 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.709290 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.709386 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.709754 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.709831 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.710120 [ 66738 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_184_184_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.710227 [ 66738 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_184_184_0 on disk default 2025.06.18 08:40:14.710276 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.710319 [ 66738 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_184_184_0 2025.06.18 08:40:14.710379 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.710585 [ 66730 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_176_35 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.710691 [ 66746 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_172_172_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.710718 [ 66730 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_176_35 on disk default 2025.06.18 08:40:14.710800 [ 66746 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_172_172_0 on disk default 2025.06.18 08:40:14.710816 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.710808 [ 66730 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_176_35 2025.06.18 08:40:14.710897 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.710908 [ 66746 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_172_172_0 2025.06.18 08:40:14.711328 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.711393 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.712386 [ 66737 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_181_36 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.712477 [ 66737 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_181_36 on disk default 2025.06.18 08:40:14.712493 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.712576 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.712582 [ 66737 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_181_36 2025.06.18 08:40:14.714939 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.714999 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.715743 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.715799 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.716558 [ 66703 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_175_175_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.716636 [ 66703 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_175_175_0 on disk default 2025.06.18 08:40:14.716676 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.716731 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.716740 [ 66703 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_175_175_0 2025.06.18 08:40:14.717461 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.717510 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.717557 [ 66691 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_186_37 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.717660 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_178_178_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.717669 [ 66691 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_186_37 on disk default 2025.06.18 08:40:14.717763 [ 66722 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_178_178_0 on disk default 2025.06.18 08:40:14.717835 [ 66691 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_186_37 2025.06.18 08:40:14.717864 [ 66722 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_178_178_0 2025.06.18 08:40:14.718017 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.718076 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.718593 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.718645 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.719079 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.719131 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.719687 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.719756 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.720308 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.720393 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.720894 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.720943 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.721251 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.721303 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.721668 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.721719 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.722010 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.722061 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.722452 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.722534 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.722829 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.722888 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.723232 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.723309 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.723522 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.723580 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.723594 [ 66684 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_191_38 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.723677 [ 66684 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_191_38 on disk default 2025.06.18 08:40:14.723765 [ 66684 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_191_38 2025.06.18 08:40:14.724093 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.724176 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.724453 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.724500 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.725580 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.725630 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.726136 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.726189 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.728389 [ 66733 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_216_43 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.728505 [ 66733 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_216_43 on disk default 2025.06.18 08:40:14.728616 [ 66733 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_216_43 2025.06.18 08:40:14.728627 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.728670 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.729030 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.729066 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.729298 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.729346 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.729531 [ 66720 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_173_173_0 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.729577 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.729635 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.729655 [ 66720 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_173_173_0 on disk default 2025.06.18 08:40:14.729747 [ 66720 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_173_173_0 2025.06.18 08:40:14.729969 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.730010 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.730668 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.730723 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.731232 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.731277 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.731970 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.732010 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.732622 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.732666 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.732833 [ 66734 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_206_41 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.732935 [ 66734 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_206_41 on disk default 2025.06.18 08:40:14.733032 [ 66734 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_206_41 2025.06.18 08:40:14.733085 [ 66747 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_211_42 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.733198 [ 66747 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_211_42 on disk default 2025.06.18 08:40:14.733346 [ 66747 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_211_42 2025.06.18 08:40:14.733729 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.733787 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.734492 [ 66750 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_201_40 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.734585 [ 66750 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_201_40 on disk default 2025.06.18 08:40:14.734658 [ 66750 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_201_40 2025.06.18 08:40:14.734672 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.734713 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.734711 [ 66688 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): loadDataPart: inserting 202506_1_196_39 (state Outdated) into data_parts_indexes 2025.06.18 08:40:14.734815 [ 66688 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Finished loading Outdated part 202506_1_196_39 on disk default 2025.06.18 08:40:14.734915 [ 66688 ] {} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_196_39 2025.06.18 08:40:14.735050 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.735090 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.735334 [ 66040 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Loaded 60 outdated data parts asynchronously 2025.06.18 08:40:14.735425 [ 66040 ] {} MergeTreeData::loadOutdatedDataParts: Execution took 1746 ms. 2025.06.18 08:40:14.735926 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.735974 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.736249 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.736285 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.736460 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.736493 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.736741 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.736776 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.736990 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.737025 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.737168 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.737212 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.737685 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.737720 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.738071 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.738105 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.738342 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.738372 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.739985 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.740025 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.740936 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.740975 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.741271 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.741306 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.741471 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.741505 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.741983 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.742017 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.742320 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.742354 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.742576 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.742618 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.743000 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.743038 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.743241 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.743279 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.744872 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.744914 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.746463 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.746506 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.747125 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.747163 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.748380 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.748418 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.749571 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.749614 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.750116 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.750154 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.750512 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.750557 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.752300 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.752341 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.752895 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.752931 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.753390 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.753430 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.753732 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.753766 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.754158 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.754190 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.755666 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.755704 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.756339 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.756385 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.757050 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.757095 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.757423 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.757461 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.758218 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.758258 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.758549 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.758587 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.759178 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.759215 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.759643 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.759683 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.759869 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.759909 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.760223 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.760257 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.760611 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.760646 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.760958 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.760991 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.761342 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.761376 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.761742 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.761778 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.762070 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.762109 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.762383 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.762414 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.762802 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.762837 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.763111 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.763144 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.763723 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.763757 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.764529 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.764584 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.764829 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.764863 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.765134 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.765168 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.765355 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.765384 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.765895 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.765931 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.766325 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.766370 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.766758 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.766793 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.767238 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.767278 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.850491 [ 65992 ] {} DatabaseCatalog: Found 0 partially dropped tables. Will load them and retry removal. 2025.06.18 08:40:14.850831 [ 65992 ] {} loadMetadata: Removing temporary file /var/lib/clickhouse/metadata/test.sql.tmp 2025.06.18 08:40:14.852864 [ 65992 ] {} Context: Server has databases (for example `test_01516`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' 2025.06.18 08:40:14.859328 [ 65992 ] {} DatabaseAtomic (02911_support_alias_column_in_indices): Metadata processed, database 02911_support_alias_column_in_indices has 1 tables and 0 dictionaries in total. 2025.06.18 08:40:14.859416 [ 65992 ] {} DatabaseAtomic (datasets): Metadata processed, database datasets has 0 tables and 0 dictionaries in total. 2025.06.18 08:40:14.860436 [ 65992 ] {} DatabaseAtomic (db_dict): Metadata processed, database db_dict has 0 tables and 1 dictionaries in total. 2025.06.18 08:40:14.860508 [ 65992 ] {} DatabaseAtomic (default): Metadata processed, database default has 0 tables and 0 dictionaries in total. 2025.06.18 08:40:14.860577 [ 65992 ] {} DatabaseAtomic (empty_db_01036): Metadata processed, database empty_db_01036 has 0 tables and 0 dictionaries in total. 2025.06.18 08:40:14.894474 [ 65992 ] {} DatabaseAtomic (test): Metadata processed, database test has 15 tables and 0 dictionaries in total. 2025.06.18 08:40:14.895962 [ 65992 ] {} DatabaseOrdinary (test_01516): Metadata processed, database test_01516 has 1 tables and 0 dictionaries in total. 2025.06.18 08:40:14.916303 [ 65992 ] {} DatabaseAtomic (test_1): Metadata processed, database test_1 has 82 tables and 6 dictionaries in total. 2025.06.18 08:40:14.921291 [ 65992 ] {} DatabaseAtomic (test_13): Metadata processed, database test_13 has 5 tables and 0 dictionaries in total. 2025.06.18 08:40:14.925316 [ 65992 ] {} DatabaseAtomic (test_15): Metadata processed, database test_15 has 4 tables and 0 dictionaries in total. 2025.06.18 08:40:14.926262 [ 65992 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.06.18 08:40:14.926610 [ 65992 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.06.18 08:40:14.926973 [ 66614 ] {} Poco: Queue size: 0, current threads: 0, threads in pool: 3, current connections: 0 2025.06.18 08:40:14.927245 [ 65999 ] {} KeeperTCPHandlerFactory: Keeper request. Address: [::1]:52564 2025.06.18 08:40:14.927914 [ 65999 ] {} KeeperTCPHandler: Requesting session ID for the new client 2025.06.18 08:40:14.928157 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2025.06.18 08:40:14.928703 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:14.929095 [ 66604 ] {} KeeperStateMachine: Session ID response 120 with timeout 30000 2025.06.18 08:40:14.929319 [ 65999 ] {} KeeperTCPHandler: Received session ID 120 2025.06.18 08:40:14.929520 [ 65992 ] {} ZooKeeperClient: Connected to ZooKeeper at [::1]:9181 with session_id 120 2025.06.18 08:40:14.930351 [ 65992 ] {} ZooKeeperClient: Keeper feature flag FILTERED_LIST: disabled 2025.06.18 08:40:14.930413 [ 65992 ] {} ZooKeeperClient: Keeper feature flag MULTI_READ: enabled 2025.06.18 08:40:14.930450 [ 65992 ] {} ZooKeeperClient: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.06.18 08:40:14.930499 [ 65992 ] {} ZooKeeperClient: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.06.18 08:40:14.930556 [ 65992 ] {} ZooKeeper: Initialized, hosts: localhost:9181 2025.06.18 08:40:14.930815 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 75 2025.06.18 08:40:14.931085 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:14.933087 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 133 2025.06.18 08:40:14.933358 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:14.935198 [ 65992 ] {} DatabaseReplicated (test_1_db): Metadata processed, database test_1_db has 4 tables and 0 dictionaries in total. 2025.06.18 08:40:14.945019 [ 65992 ] {} DatabaseAtomic (test_3): Metadata processed, database test_3 has 27 tables and 1 dictionaries in total. 2025.06.18 08:40:14.946599 [ 65992 ] {} DatabaseAtomic (test_5ri8lnpr): Metadata processed, database test_5ri8lnpr has 2 tables and 0 dictionaries in total. 2025.06.18 08:40:14.950168 [ 65992 ] {} DatabaseAtomic (test_7): Metadata processed, database test_7 has 3 tables and 0 dictionaries in total. 2025.06.18 08:40:14.951110 [ 65992 ] {} DatabaseAtomic (test_i227bf47): Metadata processed, database test_i227bf47 has 1 tables and 1 dictionaries in total. 2025.06.18 08:40:14.953902 [ 65992 ] {} DatabaseAtomic (test_qcf18570): Metadata processed, database test_qcf18570 has 4 tables and 0 dictionaries in total. 2025.06.18 08:40:14.956293 [ 65992 ] {} DatabaseAtomic (test_sgwu2ec2): Metadata processed, database test_sgwu2ec2 has 1 tables and 0 dictionaries in total. 2025.06.18 08:40:14.957480 [ 65992 ] {} DatabaseAtomic (test_v4ezwkrr): Metadata processed, database test_v4ezwkrr has 2 tables and 0 dictionaries in total. 2025.06.18 08:40:14.957569 [ 65992 ] {} TablesLoader: Parsed metadata of 161 tables in 18 databases in 0.102170031 sec 2025.06.18 08:40:14.968907 [ 65992 ] {} ReferentialDeps: Table test_qcf18570.realtimedrep has no dependencies (level 0) 2025.06.18 08:40:14.968974 [ 65992 ] {} ReferentialDeps: Table test_i227bf47.test_table has no dependencies (level 0) 2025.06.18 08:40:14.969014 [ 65992 ] {} ReferentialDeps: Table test_5ri8lnpr.data_b_02187 has no dependencies (level 0) 2025.06.18 08:40:14.969057 [ 65992 ] {} ReferentialDeps: Table test_5ri8lnpr.data_a_02187 has no dependencies (level 0) 2025.06.18 08:40:14.969092 [ 65992 ] {} ReferentialDeps: Table test_3.test has no dependencies (level 0) 2025.06.18 08:40:14.969126 [ 65992 ] {} ReferentialDeps: Table test_3.test_input has no dependencies (level 0) 2025.06.18 08:40:14.969157 [ 65992 ] {} ReferentialDeps: Table test.visits has no dependencies (level 0) 2025.06.18 08:40:14.969188 [ 65992 ] {} ReferentialDeps: Table test_3.dest_01019 has no dependencies (level 0) 2025.06.18 08:40:14.969232 [ 65992 ] {} ReferentialDeps: Table test_3.table_dst has no dependencies (level 0) 2025.06.18 08:40:14.969265 [ 65992 ] {} ReferentialDeps: Table test_3.table_src has no dependencies (level 0) 2025.06.18 08:40:14.969294 [ 65992 ] {} ReferentialDeps: Table test_3.dict_data has no dependencies (level 0) 2025.06.18 08:40:14.969327 [ 65992 ] {} ReferentialDeps: Table test_3.src_01019 has no dependencies (level 0) 2025.06.18 08:40:14.969356 [ 65992 ] {} ReferentialDeps: Table test.visits_null has no dependencies (level 0) 2025.06.18 08:40:14.969393 [ 65992 ] {} ReferentialDeps: Table test_v4ezwkrr.`null` has no dependencies (level 0) 2025.06.18 08:40:14.969432 [ 65992 ] {} ReferentialDeps: Table test_1.src has no dependencies (level 0) 2025.06.18 08:40:14.969463 [ 65992 ] {} ReferentialDeps: Table test_1.m has no dependencies (level 0) 2025.06.18 08:40:14.969498 [ 65992 ] {} ReferentialDeps: Table test_1.dictionary_decimal_source_table has no dependencies (level 0) 2025.06.18 08:40:14.969533 [ 65992 ] {} ReferentialDeps: Table test.hits has no dependencies (level 0) 2025.06.18 08:40:14.969599 [ 65992 ] {} ReferentialDeps: Table test_qcf18570.realtimedistributed has 1 dependencies: test_qcf18570.realtimedrep (level 1) 2025.06.18 08:40:14.969645 [ 65992 ] {} ReferentialDeps: Table test_i227bf47.test_dictionary has 1 dependencies: test_i227bf47.test_table (level 1) 2025.06.18 08:40:14.969691 [ 65992 ] {} ReferentialDeps: Table test_5ri8lnpr.mv5 has 2 dependencies: test_5ri8lnpr.data_b_02187, test_5ri8lnpr.data_a_02187 (level 1) 2025.06.18 08:40:14.969733 [ 65992 ] {} ReferentialDeps: Table test_5ri8lnpr.mv4 has 2 dependencies: test_5ri8lnpr.data_b_02187, test_5ri8lnpr.data_a_02187 (level 1) 2025.06.18 08:40:14.969774 [ 65992 ] {} ReferentialDeps: Table test_3.test_mv has 2 dependencies: test_3.test, test_3.test_input (level 1) 2025.06.18 08:40:14.969843 [ 65992 ] {} ReferentialDeps: Table test.basic_00040 has 1 dependencies: test.visits (level 1) 2025.06.18 08:40:14.969890 [ 65992 ] {} ReferentialDeps: Table test_3.mv_b_even has 2 dependencies: test_3.table_dst, test_3.table_src (level 1) 2025.06.18 08:40:14.969927 [ 65992 ] {} ReferentialDeps: Table test_3.dict has 1 dependencies: test_3.dict_data (level 1) 2025.06.18 08:40:14.969967 [ 65992 ] {} ReferentialDeps: Table test_3.pipe_01019 has 2 dependencies: test_3.dest_01019, test_3.src_01019 (level 1) 2025.06.18 08:40:14.970004 [ 65992 ] {} ReferentialDeps: Table test.basic has 1 dependencies: test.visits_null (level 1) 2025.06.18 08:40:14.970048 [ 65992 ] {} ReferentialDeps: Table test_v4ezwkrr.mv has 1 dependencies: test_v4ezwkrr.`null` (level 1) 2025.06.18 08:40:14.970085 [ 65992 ] {} ReferentialDeps: Table test_1.mv has 1 dependencies: test_1.src (level 1) 2025.06.18 08:40:14.970119 [ 65992 ] {} ReferentialDeps: Table test_1.dict has 1 dependencies: test_1.src (level 1) 2025.06.18 08:40:14.970152 [ 65992 ] {} ReferentialDeps: Table test_1.d has 1 dependencies: test_1.m (level 1) 2025.06.18 08:40:14.970194 [ 65992 ] {} ReferentialDeps: Table test_1.ssd_cache_dictionary has 1 dependencies: test_1.dictionary_decimal_source_table (level 1) 2025.06.18 08:40:14.970238 [ 65992 ] {} ReferentialDeps: Table db_dict.cache_hits has 1 dependencies: test.hits (level 1) 2025.06.18 08:40:14.970279 [ 65992 ] {} ReferentialDeps: Table test_qcf18570.realtimebuff__fuzz_20 has 1 dependencies: test_qcf18570.realtimedistributed (level 2) 2025.06.18 08:40:14.970320 [ 65992 ] {} ReferentialDeps: Table test_qcf18570.realtimebuff__fuzz_19 has 1 dependencies: test_qcf18570.realtimedistributed (level 2) 2025.06.18 08:40:14.970396 [ 65992 ] {} LoadingDeps: Table test_v4ezwkrr.mv has no dependencies (level 0) 2025.06.18 08:40:14.970433 [ 65992 ] {} LoadingDeps: Table test_sgwu2ec2.view_nulls has no dependencies (level 0) 2025.06.18 08:40:14.970472 [ 65992 ] {} LoadingDeps: Table test_qcf18570.realtimebuff__fuzz_19 has no dependencies (level 0) 2025.06.18 08:40:14.970505 [ 65992 ] {} LoadingDeps: Table test_7.unit has no dependencies (level 0) 2025.06.18 08:40:14.970536 [ 65992 ] {} LoadingDeps: Table test_5ri8lnpr.mv5 has no dependencies (level 0) 2025.06.18 08:40:14.970581 [ 65992 ] {} LoadingDeps: Table test_i227bf47.test_table has no dependencies (level 0) 2025.06.18 08:40:14.970611 [ 65992 ] {} LoadingDeps: Table test_5ri8lnpr.mv4 has no dependencies (level 0) 2025.06.18 08:40:14.970646 [ 65992 ] {} LoadingDeps: Table test_3.vt has no dependencies (level 0) 2025.06.18 08:40:14.970684 [ 65992 ] {} LoadingDeps: Table test_3.test_table_replicated has no dependencies (level 0) 2025.06.18 08:40:14.970715 [ 65992 ] {} LoadingDeps: Table test_3.test_table has no dependencies (level 0) 2025.06.18 08:40:14.970749 [ 65992 ] {} LoadingDeps: Table test_3.test_mv has no dependencies (level 0) 2025.06.18 08:40:14.970780 [ 65992 ] {} LoadingDeps: Table test_3.test_b has no dependencies (level 0) 2025.06.18 08:40:14.970815 [ 65992 ] {} LoadingDeps: Table test_3.test_a has no dependencies (level 0) 2025.06.18 08:40:14.970844 [ 65992 ] {} LoadingDeps: Table test_3.table1 has no dependencies (level 0) 2025.06.18 08:40:14.970873 [ 65992 ] {} LoadingDeps: Table test_3.tab has no dependencies (level 0) 2025.06.18 08:40:14.970904 [ 65992 ] {} LoadingDeps: Table test_v4ezwkrr.`null` has no dependencies (level 0) 2025.06.18 08:40:14.970933 [ 65992 ] {} LoadingDeps: Table test_3.r_prop_table2 has no dependencies (level 0) 2025.06.18 08:40:14.970967 [ 65992 ] {} LoadingDeps: Table test_3.r_prop_table1 has no dependencies (level 0) 2025.06.18 08:40:14.970996 [ 65992 ] {} LoadingDeps: Table test_3.dict_data has no dependencies (level 0) 2025.06.18 08:40:14.971026 [ 65992 ] {} LoadingDeps: Table test_7.distinct_in_order has no dependencies (level 0) 2025.06.18 08:40:14.971054 [ 65992 ] {} LoadingDeps: Table test_3.test_input has no dependencies (level 0) 2025.06.18 08:40:14.971082 [ 65992 ] {} LoadingDeps: Table test_3.ay has no dependencies (level 0) 2025.06.18 08:40:14.971117 [ 65992 ] {} LoadingDeps: Table test_3.right has no dependencies (level 0) 2025.06.18 08:40:14.971147 [ 65992 ] {} LoadingDeps: Table test_15.unit has no dependencies (level 0) 2025.06.18 08:40:14.971177 [ 65992 ] {} LoadingDeps: Table test_15.parsing_with_names has no dependencies (level 0) 2025.06.18 08:40:14.971207 [ 65992 ] {} LoadingDeps: Table test_15.distinct_in_order has no dependencies (level 0) 2025.06.18 08:40:14.971243 [ 65992 ] {} LoadingDeps: Table test_qcf18570.realtimebuff__fuzz_20 has no dependencies (level 0) 2025.06.18 08:40:14.971276 [ 65992 ] {} LoadingDeps: Table test_13.parsing_with_names has no dependencies (level 0) 2025.06.18 08:40:14.971306 [ 65992 ] {} LoadingDeps: Table test_13.hits_none has no dependencies (level 0) 2025.06.18 08:40:14.971336 [ 65992 ] {} LoadingDeps: Table test_7.parsing_with_names has no dependencies (level 0) 2025.06.18 08:40:14.971366 [ 65992 ] {} LoadingDeps: Table test_13.distinct_in_order has no dependencies (level 0) 2025.06.18 08:40:14.971404 [ 65992 ] {} LoadingDeps: Table test_1_db.test_mv2 has no dependencies (level 0) 2025.06.18 08:40:14.971439 [ 65992 ] {} LoadingDeps: Table test_13.`00163_column_oriented` has no dependencies (level 0) 2025.06.18 08:40:14.971469 [ 65992 ] {} LoadingDeps: Table test_1.with_fill_date has no dependencies (level 0) 2025.06.18 08:40:14.971504 [ 65992 ] {} LoadingDeps: Table test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` has no dependencies (level 0) 2025.06.18 08:40:14.971548 [ 65992 ] {} LoadingDeps: Table test_1.video_log_result__fuzz_0 has no dependencies (level 0) 2025.06.18 08:40:14.971584 [ 65992 ] {} LoadingDeps: Table test_1.test_table has no dependencies (level 0) 2025.06.18 08:40:14.971617 [ 65992 ] {} LoadingDeps: Table test_1.test_move_partition_src has no dependencies (level 0) 2025.06.18 08:40:14.971646 [ 65992 ] {} LoadingDeps: Table test_3.test1 has no dependencies (level 0) 2025.06.18 08:40:14.971676 [ 65992 ] {} LoadingDeps: Table test_1.test_lookup_table has no dependencies (level 0) 2025.06.18 08:40:14.971705 [ 65992 ] {} LoadingDeps: Table test_1.t_github_json has no dependencies (level 0) 2025.06.18 08:40:14.971739 [ 65992 ] {} LoadingDeps: Table test_1.t2__fuzz_0 has no dependencies (level 0) 2025.06.18 08:40:14.971775 [ 65992 ] {} LoadingDeps: Table test_1.t_local has no dependencies (level 0) 2025.06.18 08:40:14.971805 [ 65992 ] {} LoadingDeps: Table test_3.defaults has no dependencies (level 0) 2025.06.18 08:40:14.971834 [ 65992 ] {} LoadingDeps: Table test_1.partition_id has no dependencies (level 0) 2025.06.18 08:40:14.971862 [ 65992 ] {} LoadingDeps: Table test_1.t1__fuzz_17 has no dependencies (level 0) 2025.06.18 08:40:14.971896 [ 65992 ] {} LoadingDeps: Table test_1_db.test_mv has no dependencies (level 0) 2025.06.18 08:40:14.971925 [ 65992 ] {} LoadingDeps: Table test.hits_snippet has no dependencies (level 0) 2025.06.18 08:40:14.971960 [ 65992 ] {} LoadingDeps: Table test_1.table_for_concurrent_alter has no dependencies (level 0) 2025.06.18 08:40:14.971990 [ 65992 ] {} LoadingDeps: Table test_1.t1 has no dependencies (level 0) 2025.06.18 08:40:14.972021 [ 65992 ] {} LoadingDeps: Table test_1.t_02559 has no dependencies (level 0) 2025.06.18 08:40:14.972055 [ 65992 ] {} LoadingDeps: Table test_1.t02176 has no dependencies (level 0) 2025.06.18 08:40:14.972085 [ 65992 ] {} LoadingDeps: Table test_qcf18570.realtimedistributed has no dependencies (level 0) 2025.06.18 08:40:14.972115 [ 65992 ] {} LoadingDeps: Table test_1.t0 has no dependencies (level 0) 2025.06.18 08:40:14.972144 [ 65992 ] {} LoadingDeps: Table test_1.sample_prewhere has no dependencies (level 0) 2025.06.18 08:40:14.972173 [ 65992 ] {} LoadingDeps: Table test_1.regexp_dict4 has no dependencies (level 0) 2025.06.18 08:40:14.972207 [ 65992 ] {} LoadingDeps: Table test_3.t_uncompressed_cache has no dependencies (level 0) 2025.06.18 08:40:14.972240 [ 65992 ] {} LoadingDeps: Table test_3.stored_aggregates has no dependencies (level 0) 2025.06.18 08:40:14.972270 [ 65992 ] {} LoadingDeps: Table test_1_db.test_mv3 has no dependencies (level 0) 2025.06.18 08:40:14.972297 [ 65992 ] {} LoadingDeps: Table test_1.t2 has no dependencies (level 0) 2025.06.18 08:40:14.972326 [ 65992 ] {} LoadingDeps: Table test_1.regexp_dict3 has no dependencies (level 0) 2025.06.18 08:40:14.972361 [ 65992 ] {} LoadingDeps: Table test_1.mass_table_117 has no dependencies (level 0) 2025.06.18 08:40:14.972390 [ 65992 ] {} LoadingDeps: Table test_1.test has no dependencies (level 0) 2025.06.18 08:40:14.972418 [ 65992 ] {} LoadingDeps: Table test_1.ngrambf_tab has no dependencies (level 0) 2025.06.18 08:40:14.972446 [ 65992 ] {} LoadingDeps: Table test_1.data_r2 has no dependencies (level 0) 2025.06.18 08:40:14.972474 [ 65992 ] {} LoadingDeps: Table test_1.rdb has no dependencies (level 0) 2025.06.18 08:40:14.972506 [ 65992 ] {} LoadingDeps: Table test_1.test1 has no dependencies (level 0) 2025.06.18 08:40:14.972534 [ 65992 ] {} LoadingDeps: Table test_1.r2 has no dependencies (level 0) 2025.06.18 08:40:14.972574 [ 65992 ] {} LoadingDeps: Table test_1.quorum1 has no dependencies (level 0) 2025.06.18 08:40:14.972603 [ 65992 ] {} LoadingDeps: Table test_1.regexp_dict2 has no dependencies (level 0) 2025.06.18 08:40:14.972633 [ 65992 ] {} LoadingDeps: Table test_1.product_groups has no dependencies (level 0) 2025.06.18 08:40:14.972669 [ 65992 ] {} LoadingDeps: Table test.basic_00040 has no dependencies (level 0) 2025.06.18 08:40:14.972699 [ 65992 ] {} LoadingDeps: Table test_1.A has no dependencies (level 0) 2025.06.18 08:40:14.972731 [ 65992 ] {} LoadingDeps: Table test_1.table_default_protobuf_00825 has no dependencies (level 0) 2025.06.18 08:40:14.972761 [ 65992 ] {} LoadingDeps: Table test_1.src_table has no dependencies (level 0) 2025.06.18 08:40:14.972790 [ 65992 ] {} LoadingDeps: Table test.join has no dependencies (level 0) 2025.06.18 08:40:14.972825 [ 65992 ] {} LoadingDeps: Table test_1.products has no dependencies (level 0) 2025.06.18 08:40:14.972854 [ 65992 ] {} LoadingDeps: Table test_1.tokenbf_tab has no dependencies (level 0) 2025.06.18 08:40:14.972893 [ 65992 ] {} LoadingDeps: Table test_1.tab_00481 has no dependencies (level 0) 2025.06.18 08:40:14.972923 [ 65992 ] {} LoadingDeps: Table test_1.t_rename_alter has no dependencies (level 0) 2025.06.18 08:40:14.972952 [ 65992 ] {} LoadingDeps: Table test_1.location has no dependencies (level 0) 2025.06.18 08:40:14.972986 [ 65992 ] {} LoadingDeps: Table test_1.group_by_all has no dependencies (level 0) 2025.06.18 08:40:14.973019 [ 65992 ] {} LoadingDeps: Table test_1.dictionary_decimal_source_table has no dependencies (level 0) 2025.06.18 08:40:14.973050 [ 65992 ] {} LoadingDeps: Table test_3.mv_b_even has no dependencies (level 0) 2025.06.18 08:40:14.973080 [ 65992 ] {} LoadingDeps: Table test.visits_null has no dependencies (level 0) 2025.06.18 08:40:14.973108 [ 65992 ] {} LoadingDeps: Table test_1.src has no dependencies (level 0) 2025.06.18 08:40:14.973142 [ 65992 ] {} LoadingDeps: Table test_1.t_nested_with_dots has no dependencies (level 0) 2025.06.18 08:40:14.973171 [ 65992 ] {} LoadingDeps: Table test_1.rmt2 has no dependencies (level 0) 2025.06.18 08:40:14.973199 [ 65992 ] {} LoadingDeps: Table test_3.userid_set has no dependencies (level 0) 2025.06.18 08:40:14.973228 [ 65992 ] {} LoadingDeps: Table test_1.data_r1 has no dependencies (level 0) 2025.06.18 08:40:14.973264 [ 65992 ] {} LoadingDeps: Table test_1.zero_rows_per_granule has no dependencies (level 0) 2025.06.18 08:40:14.973293 [ 65992 ] {} LoadingDeps: Table test_1.tab_00717 has no dependencies (level 0) 2025.06.18 08:40:14.973321 [ 65992 ] {} LoadingDeps: Table test_3.t1 has no dependencies (level 0) 2025.06.18 08:40:14.973349 [ 65992 ] {} LoadingDeps: Table test_3.t has no dependencies (level 0) 2025.06.18 08:40:14.973376 [ 65992 ] {} LoadingDeps: Table test_1.B1 has no dependencies (level 0) 2025.06.18 08:40:14.973409 [ 65992 ] {} LoadingDeps: Table test_15.ordinary_distinct has no dependencies (level 0) 2025.06.18 08:40:14.973439 [ 65992 ] {} LoadingDeps: Table test_1.video_log has no dependencies (level 0) 2025.06.18 08:40:14.973469 [ 65992 ] {} LoadingDeps: Table test_1.data_native_copy has no dependencies (level 0) 2025.06.18 08:40:14.973498 [ 65992 ] {} LoadingDeps: Table test_1.data has no dependencies (level 0) 2025.06.18 08:40:14.973565 [ 65992 ] {} LoadingDeps: Table test_3.table_src has no dependencies (level 0) 2025.06.18 08:40:14.973608 [ 65992 ] {} LoadingDeps: Table test_1.concurrent_kill_5 has no dependencies (level 0) 2025.06.18 08:40:14.973638 [ 65992 ] {} LoadingDeps: Table test_1.d has no dependencies (level 0) 2025.06.18 08:40:14.973666 [ 65992 ] {} LoadingDeps: Table test_1.country_rings has no dependencies (level 0) 2025.06.18 08:40:14.973695 [ 65992 ] {} LoadingDeps: Table test_1.rmt1 has no dependencies (level 0) 2025.06.18 08:40:14.973722 [ 65992 ] {} LoadingDeps: Table test_1.j has no dependencies (level 0) 2025.06.18 08:40:14.973755 [ 65992 ] {} LoadingDeps: Table test_1.copied_table has no dependencies (level 0) 2025.06.18 08:40:14.973787 [ 65992 ] {} LoadingDeps: Table test_1.concurrent_kill_1 has no dependencies (level 0) 2025.06.18 08:40:14.973833 [ 65992 ] {} LoadingDeps: Table test_3.test2 has no dependencies (level 0) 2025.06.18 08:40:14.973865 [ 65992 ] {} LoadingDeps: Table test_3.pipe_01019 has no dependencies (level 0) 2025.06.18 08:40:14.973895 [ 65992 ] {} LoadingDeps: Table test_1.concurrent_kill_2 has no dependencies (level 0) 2025.06.18 08:40:14.973933 [ 65992 ] {} LoadingDeps: Table test_1.data2015 has no dependencies (level 0) 2025.06.18 08:40:14.973966 [ 65992 ] {} LoadingDeps: Table test_1.clickhouse_alias_issue_2 has no dependencies (level 0) 2025.06.18 08:40:14.973998 [ 65992 ] {} LoadingDeps: Table test_1.clickhouse_alias_issue_1 has no dependencies (level 0) 2025.06.18 08:40:14.974033 [ 65992 ] {} LoadingDeps: Table test_1.bug has no dependencies (level 0) 2025.06.18 08:40:14.974062 [ 65992 ] {} LoadingDeps: Table test_1.broken_table has no dependencies (level 0) 2025.06.18 08:40:14.974108 [ 65992 ] {} LoadingDeps: Table test_1.bad_arrays has no dependencies (level 0) 2025.06.18 08:40:14.974137 [ 65992 ] {} LoadingDeps: Table test_1.mytable has no dependencies (level 0) 2025.06.18 08:40:14.974166 [ 65992 ] {} LoadingDeps: Table test_1.defaults has no dependencies (level 0) 2025.06.18 08:40:14.974194 [ 65992 ] {} LoadingDeps: Table test_1.m has no dependencies (level 0) 2025.06.18 08:40:14.974224 [ 65992 ] {} LoadingDeps: Table test_1.concurrent_kill_4 has no dependencies (level 0) 2025.06.18 08:40:14.974258 [ 65992 ] {} LoadingDeps: Table test_3.left has no dependencies (level 0) 2025.06.18 08:40:14.974287 [ 65992 ] {} LoadingDeps: Table test_1.a has no dependencies (level 0) 2025.06.18 08:40:14.974321 [ 65992 ] {} LoadingDeps: Table test_1.`.inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd` has no dependencies (level 0) 2025.06.18 08:40:14.974354 [ 65992 ] {} LoadingDeps: Table test_1.nested_nested_table has no dependencies (level 0) 2025.06.18 08:40:14.974385 [ 65992 ] {} LoadingDeps: Table test_1.`distinct` has no dependencies (level 0) 2025.06.18 08:40:14.974422 [ 65992 ] {} LoadingDeps: Table test_1.`03006_test` has no dependencies (level 0) 2025.06.18 08:40:14.974452 [ 65992 ] {} LoadingDeps: Table test_1.LOG_T has no dependencies (level 0) 2025.06.18 08:40:14.974482 [ 65992 ] {} LoadingDeps: Table test_01516.primary_key_test has no dependencies (level 0) 2025.06.18 08:40:14.974511 [ 65992 ] {} LoadingDeps: Table test_1.mt has no dependencies (level 0) 2025.06.18 08:40:14.974551 [ 65992 ] {} LoadingDeps: Table test_1.`02500_nested` has no dependencies (level 0) 2025.06.18 08:40:14.974591 [ 65992 ] {} LoadingDeps: Table test_1.testJoinTable has no dependencies (level 0) 2025.06.18 08:40:14.974623 [ 65992 ] {} LoadingDeps: Table test_1.four_rows_per_granule has no dependencies (level 0) 2025.06.18 08:40:14.974656 [ 65992 ] {} LoadingDeps: Table test_1.test_grouping_sets_predicate has no dependencies (level 0) 2025.06.18 08:40:14.974688 [ 65992 ] {} LoadingDeps: Table test.hits_stripelog has no dependencies (level 0) 2025.06.18 08:40:14.974717 [ 65992 ] {} LoadingDeps: Table test.visits has no dependencies (level 0) 2025.06.18 08:40:14.974750 [ 65992 ] {} LoadingDeps: Table test.partitions has no dependencies (level 0) 2025.06.18 08:40:14.974779 [ 65992 ] {} LoadingDeps: Table test_1.rng has no dependencies (level 0) 2025.06.18 08:40:14.974808 [ 65992 ] {} LoadingDeps: Table test_3.src_01019 has no dependencies (level 0) 2025.06.18 08:40:14.974845 [ 65992 ] {} LoadingDeps: Table test.`.inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0` has no dependencies (level 0) 2025.06.18 08:40:14.974875 [ 65992 ] {} LoadingDeps: Table test.merge_hits has no dependencies (level 0) 2025.06.18 08:40:14.974910 [ 65992 ] {} LoadingDeps: Table test_1.error_win_func has no dependencies (level 0) 2025.06.18 08:40:14.974939 [ 65992 ] {} LoadingDeps: Table test_1.data_01882 has no dependencies (level 0) 2025.06.18 08:40:14.974969 [ 65992 ] {} LoadingDeps: Table test_qcf18570.realtimedrep has no dependencies (level 0) 2025.06.18 08:40:14.974999 [ 65992 ] {} LoadingDeps: Table test_1.test_table_comment has no dependencies (level 0) 2025.06.18 08:40:14.975028 [ 65992 ] {} LoadingDeps: Table test.hits_s3 has no dependencies (level 0) 2025.06.18 08:40:14.975065 [ 65992 ] {} LoadingDeps: Table test.`.inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b` has no dependencies (level 0) 2025.06.18 08:40:14.975098 [ 65992 ] {} LoadingDeps: Table test.basic has no dependencies (level 0) 2025.06.18 08:40:14.975126 [ 65992 ] {} LoadingDeps: Table test_13.unit has no dependencies (level 0) 2025.06.18 08:40:14.975160 [ 65992 ] {} LoadingDeps: Table test_1.regexp_dict1 has no dependencies (level 0) 2025.06.18 08:40:14.975188 [ 65992 ] {} LoadingDeps: Table test_1.mv has no dependencies (level 0) 2025.06.18 08:40:14.975221 [ 65992 ] {} LoadingDeps: Table test.avro has no dependencies (level 0) 2025.06.18 08:40:14.975251 [ 65992 ] {} LoadingDeps: Table test_1.tMM has no dependencies (level 0) 2025.06.18 08:40:14.975287 [ 65992 ] {} LoadingDeps: Table `02911_support_alias_column_in_indices`.test1 has no dependencies (level 0) 2025.06.18 08:40:14.975316 [ 65992 ] {} LoadingDeps: Table test.hits has no dependencies (level 0) 2025.06.18 08:40:14.975351 [ 65992 ] {} LoadingDeps: Table test_1.country_polygons has no dependencies (level 0) 2025.06.18 08:40:14.975381 [ 65992 ] {} LoadingDeps: Table test.hits_tinylog has no dependencies (level 0) 2025.06.18 08:40:14.975423 [ 65992 ] {} LoadingDeps: Table test_i227bf47.test_dictionary has 1 dependencies: test_i227bf47.test_table (level 1) 2025.06.18 08:40:14.975461 [ 65992 ] {} LoadingDeps: Table test_3.dict has 1 dependencies: test_3.dict_data (level 1) 2025.06.18 08:40:14.975501 [ 65992 ] {} LoadingDeps: Table test_1.ssd_cache_dictionary has 1 dependencies: test_1.dictionary_decimal_source_table (level 1) 2025.06.18 08:40:14.975556 [ 65992 ] {} LoadingDeps: Table test_1.dict has 1 dependencies: test_1.src (level 1) 2025.06.18 08:40:14.975594 [ 65992 ] {} LoadingDeps: Table db_dict.cache_hits has 1 dependencies: test.hits (level 1) 2025.06.18 08:40:14.977851 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Found 4 old parts to remove. Parts: [202506_272_368_22, 202506_369_369_0, 202506_370_370_0, 202506_371_371_0] 2025.06.18 08:40:14.977947 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 4 parts from filesystem (serially): Parts: [202506_272_368_22, 202506_369_369_0, 202506_370_370_0, 202506_371_371_0] 2025.06.18 08:40:14.982188 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_272_368_22 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.982200 [ 65992 ] {} loadMetadata: Start asynchronous loading of databases 2025.06.18 08:40:14.982277 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_369_369_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.982324 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_370_370_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.982384 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_371_371_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:14.982435 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 4 parts from memory: Parts: [202506_272_368_22, 202506_369_369_0, 202506_370_370_0, 202506_371_371_0] 2025.06.18 08:40:14.982855 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t2__fuzz_0' into BackgroundLoad 2025.06.18 08:40:14.982898 [ 65992 ] {} AsyncLoader: Schedule load job 'load table 02911_support_alias_column_in_indices.test1' into BackgroundLoad 2025.06.18 08:40:14.982926 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.A' into BackgroundLoad 2025.06.18 08:40:14.982953 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.data_native_copy' into BackgroundLoad 2025.06.18 08:40:14.982988 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.rmt2' into BackgroundLoad 2025.06.18 08:40:14.983012 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_7.parsing_with_names' into BackgroundLoad 2025.06.18 08:40:14.983036 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.nested_nested_table' into BackgroundLoad 2025.06.18 08:40:14.983066 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t_rename_alter' into BackgroundLoad 2025.06.18 08:40:14.983090 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.partition_id' into BackgroundLoad 2025.06.18 08:40:14.983122 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.country_rings' into BackgroundLoad 2025.06.18 08:40:14.983145 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_5ri8lnpr.mv4' into BackgroundLoad 2025.06.18 08:40:14.983167 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_13.hits_none' into BackgroundLoad 2025.06.18 08:40:14.983190 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0' into BackgroundLoad 2025.06.18 08:40:14.983213 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.ssd_cache_dictionary' into BackgroundLoad 2025.06.18 08:40:14.983246 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.tokenbf_tab' into BackgroundLoad 2025.06.18 08:40:14.983270 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1_db.test_mv3' into BackgroundLoad 2025.06.18 08:40:14.983291 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.r2' into BackgroundLoad 2025.06.18 08:40:14.983312 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_qcf18570.realtimebuff__fuzz_19' into BackgroundLoad 2025.06.18 08:40:14.983334 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test_table' into BackgroundLoad 2025.06.18 08:40:14.983367 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t0' into BackgroundLoad 2025.06.18 08:40:14.983389 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.sample_prewhere' into BackgroundLoad 2025.06.18 08:40:14.983411 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.group_by_all' into BackgroundLoad 2025.06.18 08:40:14.983433 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_5ri8lnpr.mv5' into BackgroundLoad 2025.06.18 08:40:14.983458 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.zero_rows_per_granule' into BackgroundLoad 2025.06.18 08:40:14.983492 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.table1' into BackgroundLoad 2025.06.18 08:40:14.983514 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.r_prop_table1' into BackgroundLoad 2025.06.18 08:40:14.983536 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.mass_table_117' into BackgroundLoad 2025.06.18 08:40:14.983569 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.a' into BackgroundLoad 2025.06.18 08:40:14.983601 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_7.distinct_in_order' into BackgroundLoad 2025.06.18 08:40:14.983633 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.mytable' into BackgroundLoad 2025.06.18 08:40:14.983656 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_qcf18570.realtimebuff__fuzz_20' into BackgroundLoad 2025.06.18 08:40:14.983679 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.error_win_func' into BackgroundLoad 2025.06.18 08:40:14.983703 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.product_groups' into BackgroundLoad 2025.06.18 08:40:14.983725 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test_input' into BackgroundLoad 2025.06.18 08:40:14.983765 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.t_uncompressed_cache' into BackgroundLoad 2025.06.18 08:40:14.983795 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_15.ordinary_distinct' into BackgroundLoad 2025.06.18 08:40:14.983825 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.ay' into BackgroundLoad 2025.06.18 08:40:14.983847 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test_table_replicated' into BackgroundLoad 2025.06.18 08:40:14.983879 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.data_r1' into BackgroundLoad 2025.06.18 08:40:14.983928 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.defaults' into BackgroundLoad 2025.06.18 08:40:14.983951 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.right' into BackgroundLoad 2025.06.18 08:40:14.983977 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_15.unit' into BackgroundLoad 2025.06.18 08:40:14.983999 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_15.parsing_with_names' into BackgroundLoad 2025.06.18 08:40:14.984021 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test_a' into BackgroundLoad 2025.06.18 08:40:14.984055 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.dict_data' into BackgroundLoad 2025.06.18 08:40:14.984077 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t_local' into BackgroundLoad 2025.06.18 08:40:14.984098 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.dict' into BackgroundLoad 2025.06.18 08:40:14.984122 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_13.parsing_with_names' into BackgroundLoad 2025.06.18 08:40:14.984147 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_sgwu2ec2.view_nulls' into BackgroundLoad 2025.06.18 08:40:14.984179 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.j' into BackgroundLoad 2025.06.18 08:40:14.984200 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.src_01019' into BackgroundLoad 2025.06.18 08:40:14.984221 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t2' into BackgroundLoad 2025.06.18 08:40:14.984241 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.video_log_result__fuzz_0' into BackgroundLoad 2025.06.18 08:40:14.984279 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.LOG_T' into BackgroundLoad 2025.06.18 08:40:14.984304 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b' into BackgroundLoad 2025.06.18 08:40:14.984326 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1_db.test_mv2' into BackgroundLoad 2025.06.18 08:40:14.984347 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.table_src' into BackgroundLoad 2025.06.18 08:40:14.984367 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.concurrent_kill_2' into BackgroundLoad 2025.06.18 08:40:14.984393 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.ngrambf_tab' into BackgroundLoad 2025.06.18 08:40:14.984414 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test_b' into BackgroundLoad 2025.06.18 08:40:14.984435 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.r_prop_table2' into BackgroundLoad 2025.06.18 08:40:14.984457 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.userid_set' into BackgroundLoad 2025.06.18 08:40:14.984478 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.with_fill_date' into BackgroundLoad 2025.06.18 08:40:14.984506 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.hits_snippet' into BackgroundLoad 2025.06.18 08:40:14.984528 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test_table' into BackgroundLoad 2025.06.18 08:40:14.984562 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd' into BackgroundLoad 2025.06.18 08:40:14.984585 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_v4ezwkrr.mv' into BackgroundLoad 2025.06.18 08:40:14.984605 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.regexp_dict2' into BackgroundLoad 2025.06.18 08:40:14.984642 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.defaults' into BackgroundLoad 2025.06.18 08:40:14.984670 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test_move_partition_src' into BackgroundLoad 2025.06.18 08:40:14.984693 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_15.distinct_in_order' into BackgroundLoad 2025.06.18 08:40:14.984713 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test1' into BackgroundLoad 2025.06.18 08:40:14.984734 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_v4ezwkrr.null' into BackgroundLoad 2025.06.18 08:40:14.984760 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test2' into BackgroundLoad 2025.06.18 08:40:14.984781 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.join' into BackgroundLoad 2025.06.18 08:40:14.984802 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_13.distinct_in_order' into BackgroundLoad 2025.06.18 08:40:14.984823 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.tab' into BackgroundLoad 2025.06.18 08:40:14.984843 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t_github_json' into BackgroundLoad 2025.06.18 08:40:14.984868 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test_lookup_table' into BackgroundLoad 2025.06.18 08:40:14.984891 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_01516.primary_key_test' into BackgroundLoad 2025.06.18 08:40:14.984912 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.mv_b_even' into BackgroundLoad 2025.06.18 08:40:14.984934 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t1__fuzz_17' into BackgroundLoad 2025.06.18 08:40:14.984955 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.tab_00717' into BackgroundLoad 2025.06.18 08:40:14.984980 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.video_log' into BackgroundLoad 2025.06.18 08:40:14.985001 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1_db.test_mv' into BackgroundLoad 2025.06.18 08:40:14.985027 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t_02559' into BackgroundLoad 2025.06.18 08:40:14.985053 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_13.00163_column_oriented' into BackgroundLoad 2025.06.18 08:40:14.985074 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t02176' into BackgroundLoad 2025.06.18 08:40:14.985098 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.distinct' into BackgroundLoad 2025.06.18 08:40:14.985120 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.regexp_dict4' into BackgroundLoad 2025.06.18 08:40:14.985140 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.data_r2' into BackgroundLoad 2025.06.18 08:40:14.985161 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.src_table' into BackgroundLoad 2025.06.18 08:40:14.985180 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.location' into BackgroundLoad 2025.06.18 08:40:14.985206 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.dictionary_decimal_source_table' into BackgroundLoad 2025.06.18 08:40:14.985230 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_7.unit' into BackgroundLoad 2025.06.18 08:40:14.985252 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test1' into BackgroundLoad 2025.06.18 08:40:14.985273 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.visits_null' into BackgroundLoad 2025.06.18 08:40:14.985301 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_qcf18570.realtimedistributed' into BackgroundLoad 2025.06.18 08:40:14.985326 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test' into BackgroundLoad 2025.06.18 08:40:14.985347 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.data' into BackgroundLoad 2025.06.18 08:40:14.985372 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.02500_nested' into BackgroundLoad 2025.06.18 08:40:14.985394 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.concurrent_kill_5' into BackgroundLoad 2025.06.18 08:40:14.985414 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.basic' into BackgroundLoad 2025.06.18 08:40:14.985441 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.partitions' into BackgroundLoad 2025.06.18 08:40:14.985462 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.d' into BackgroundLoad 2025.06.18 08:40:14.985481 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.mt' into BackgroundLoad 2025.06.18 08:40:14.985501 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.copied_table' into BackgroundLoad 2025.06.18 08:40:14.985526 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.src' into BackgroundLoad 2025.06.18 08:40:14.985561 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.tab_00481' into BackgroundLoad 2025.06.18 08:40:14.985584 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.concurrent_kill_4' into BackgroundLoad 2025.06.18 08:40:14.985605 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.bug' into BackgroundLoad 2025.06.18 08:40:14.985628 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test_grouping_sets_predicate' into BackgroundLoad 2025.06.18 08:40:14.985650 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.concurrent_kill_1' into BackgroundLoad 2025.06.18 08:40:14.985675 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.quorum1' into BackgroundLoad 2025.06.18 08:40:14.985696 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.data_01882' into BackgroundLoad 2025.06.18 08:40:14.985724 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.clickhouse_alias_issue_2' into BackgroundLoad 2025.06.18 08:40:14.985745 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.basic_00040' into BackgroundLoad 2025.06.18 08:40:14.985768 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.left' into BackgroundLoad 2025.06.18 08:40:14.985850 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.hits_tinylog' into BackgroundLoad 2025.06.18 08:40:14.985880 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t_nested_with_dots' into BackgroundLoad 2025.06.18 08:40:14.985902 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.hits_stripelog' into BackgroundLoad 2025.06.18 08:40:14.985922 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.m' into BackgroundLoad 2025.06.18 08:40:14.985946 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.rdb' into BackgroundLoad 2025.06.18 08:40:14.985967 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.tMM' into BackgroundLoad 2025.06.18 08:40:14.985988 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd' into BackgroundLoad 2025.06.18 08:40:14.986009 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.mv' into BackgroundLoad 2025.06.18 08:40:14.986029 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_i227bf47.test_dictionary' into BackgroundLoad 2025.06.18 08:40:14.986055 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.hits_s3' into BackgroundLoad 2025.06.18 08:40:14.986080 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.03006_test' into BackgroundLoad 2025.06.18 08:40:14.986102 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.four_rows_per_granule' into BackgroundLoad 2025.06.18 08:40:14.986124 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.t' into BackgroundLoad 2025.06.18 08:40:14.986152 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_13.unit' into BackgroundLoad 2025.06.18 08:40:14.986179 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.test_mv' into BackgroundLoad 2025.06.18 08:40:14.986206 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.B1' into BackgroundLoad 2025.06.18 08:40:14.986227 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.table_for_concurrent_alter' into BackgroundLoad 2025.06.18 08:40:14.986251 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.t1' into BackgroundLoad 2025.06.18 08:40:14.986272 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.pipe_01019' into BackgroundLoad 2025.06.18 08:40:14.986307 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.country_polygons' into BackgroundLoad 2025.06.18 08:40:14.986330 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.visits' into BackgroundLoad 2025.06.18 08:40:14.986349 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.t1' into BackgroundLoad 2025.06.18 08:40:14.986371 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.data2015' into BackgroundLoad 2025.06.18 08:40:14.986392 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.stored_aggregates' into BackgroundLoad 2025.06.18 08:40:14.986418 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.products' into BackgroundLoad 2025.06.18 08:40:14.986444 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.testJoinTable' into BackgroundLoad 2025.06.18 08:40:14.986465 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.dict' into BackgroundLoad 2025.06.18 08:40:14.986486 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.merge_hits' into BackgroundLoad 2025.06.18 08:40:14.986507 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.test_table_comment' into BackgroundLoad 2025.06.18 08:40:14.986534 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.clickhouse_alias_issue_1' into BackgroundLoad 2025.06.18 08:40:14.986568 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.regexp_dict3' into BackgroundLoad 2025.06.18 08:40:14.986590 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.broken_table' into BackgroundLoad 2025.06.18 08:40:14.986616 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.avro' into BackgroundLoad 2025.06.18 08:40:14.986638 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_3.vt' into BackgroundLoad 2025.06.18 08:40:14.986672 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_i227bf47.test_table' into BackgroundLoad 2025.06.18 08:40:14.986695 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.rmt1' into BackgroundLoad 2025.06.18 08:40:14.986715 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test.hits' into BackgroundLoad 2025.06.18 08:40:14.986736 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.bad_arrays' into BackgroundLoad 2025.06.18 08:40:14.986757 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.table_default_protobuf_00825' into BackgroundLoad 2025.06.18 08:40:14.986782 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_qcf18570.realtimedrep' into BackgroundLoad 2025.06.18 08:40:14.986804 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.regexp_dict1' into BackgroundLoad 2025.06.18 08:40:14.986826 [ 65992 ] {} AsyncLoader: Schedule load job 'load table test_1.rng' into BackgroundLoad 2025.06.18 08:40:14.986847 [ 65992 ] {} AsyncLoader: Schedule load job 'load table db_dict.cache_hits' into BackgroundLoad 2025.06.18 08:40:14.986885 [ 65992 ] {} AsyncLoader: Change current priority: none -> 1 2025.06.18 08:40:14.986924 [ 65992 ] {} AsyncLoader: Spawn loader worker #1 in BackgroundLoad 2025.06.18 08:40:14.986996 [ 65992 ] {} AsyncLoader: Spawn loader worker #2 in BackgroundLoad 2025.06.18 08:40:14.987039 [ 65992 ] {} AsyncLoader: Spawn loader worker #3 in BackgroundLoad 2025.06.18 08:40:14.987082 [ 65992 ] {} AsyncLoader: Spawn loader worker #4 in BackgroundLoad 2025.06.18 08:40:14.987138 [ 65992 ] {} AsyncLoader: Spawn loader worker #5 in BackgroundLoad 2025.06.18 08:40:14.987195 [ 65992 ] {} AsyncLoader: Spawn loader worker #6 in BackgroundLoad 2025.06.18 08:40:14.987263 [ 65992 ] {} AsyncLoader: Spawn loader worker #7 in BackgroundLoad 2025.06.18 08:40:14.987308 [ 65992 ] {} AsyncLoader: Spawn loader worker #8 in BackgroundLoad 2025.06.18 08:40:14.987348 [ 65992 ] {} AsyncLoader: Spawn loader worker #9 in BackgroundLoad 2025.06.18 08:40:14.987430 [ 65992 ] {} AsyncLoader: Spawn loader worker #10 in BackgroundLoad 2025.06.18 08:40:14.987493 [ 65992 ] {} AsyncLoader: Spawn loader worker #11 in BackgroundLoad 2025.06.18 08:40:14.987533 [ 65992 ] {} AsyncLoader: Spawn loader worker #12 in BackgroundLoad 2025.06.18 08:40:14.987653 [ 65992 ] {} AsyncLoader: Spawn loader worker #13 in BackgroundLoad 2025.06.18 08:40:14.987715 [ 65992 ] {} AsyncLoader: Spawn loader worker #14 in BackgroundLoad 2025.06.18 08:40:14.987754 [ 65992 ] {} AsyncLoader: Spawn loader worker #15 in BackgroundLoad 2025.06.18 08:40:14.987811 [ 65992 ] {} AsyncLoader: Spawn loader worker #16 in BackgroundLoad 2025.06.18 08:40:14.988164 [ 66703 ] {} AsyncLoader: Execute load job 'load table test_1.t2__fuzz_0' in BackgroundLoad 2025.06.18 08:40:14.988248 [ 66703 ] {} DatabaseAtomic (test_1): Loading table test_1.t2__fuzz_0 2025.06.18 08:40:14.988584 [ 66703 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.988651 [ 66703 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.988708 [ 66703 ] {} DatabaseAtomic (test_1): Counting attached table t2__fuzz_0 to database test_1 2025.06.18 08:40:14.988956 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_13' into BackgrndStartup 2025.06.18 08:40:14.988992 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_13.hits_none' into BackgrndStartup 2025.06.18 08:40:14.989018 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_sgwu2ec2.view_nulls' into BackgrndStartup 2025.06.18 08:40:14.989041 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_13.distinct_in_order' into BackgrndStartup 2025.06.18 08:40:14.989071 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_13.parsing_with_names' into BackgrndStartup 2025.06.18 08:40:14.989102 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd' into BackgrndStartup 2025.06.18 08:40:14.989137 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1_db.test_mv2' into BackgrndStartup 2025.06.18 08:40:14.989160 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_13.unit' into BackgrndStartup 2025.06.18 08:40:14.989187 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database 02911_support_alias_column_in_indices' into BackgrndStartup 2025.06.18 08:40:14.989215 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database datasets' into BackgrndStartup 2025.06.18 08:40:14.989238 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table db_dict.cache_hits' into BackgrndStartup 2025.06.18 08:40:14.989261 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database db_dict' into BackgrndStartup 2025.06.18 08:40:14.989284 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database default' into BackgrndStartup 2025.06.18 08:40:14.989305 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database default' into BackgrndStartup 2025.06.18 08:40:14.989335 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database empty_db_01036' into BackgrndStartup 2025.06.18 08:40:14.989377 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database empty_db_01036' into BackgrndStartup 2025.06.18 08:40:14.989418 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.hits_tinylog' into BackgrndStartup 2025.06.18 08:40:14.989458 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.basic' into BackgrndStartup 2025.06.18 08:40:14.989496 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_qcf18570' into BackgrndStartup 2025.06.18 08:40:14.989529 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b' into BackgrndStartup 2025.06.18 08:40:14.989570 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.basic_00040' into BackgrndStartup 2025.06.18 08:40:14.989594 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.hits_stripelog' into BackgrndStartup 2025.06.18 08:40:14.989615 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.partitions' into BackgrndStartup 2025.06.18 08:40:14.989637 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.hits' into BackgrndStartup 2025.06.18 08:40:14.989673 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_01516' into BackgrndStartup 2025.06.18 08:40:14.989695 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.join' into BackgrndStartup 2025.06.18 08:40:14.989715 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.visits' into BackgrndStartup 2025.06.18 08:40:14.989735 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.visits_null' into BackgrndStartup 2025.06.18 08:40:14.989759 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.hits_snippet' into BackgrndStartup 2025.06.18 08:40:14.989785 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test' into BackgrndStartup 2025.06.18 08:40:14.989806 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.tMM' into BackgrndStartup 2025.06.18 08:40:14.989851 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_v4ezwkrr' into BackgrndStartup 2025.06.18 08:40:14.989873 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.mv' into BackgrndStartup 2025.06.18 08:40:14.989894 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.ssd_cache_dictionary' into BackgrndStartup 2025.06.18 08:40:14.989920 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.four_rows_per_granule' into BackgrndStartup 2025.06.18 08:40:14.989942 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.distinct' into BackgrndStartup 2025.06.18 08:40:14.989982 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_sgwu2ec2' into BackgrndStartup 2025.06.18 08:40:14.990006 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_qcf18570.realtimebuff__fuzz_19' into BackgrndStartup 2025.06.18 08:40:14.990028 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test_grouping_sets_predicate' into BackgrndStartup 2025.06.18 08:40:14.990056 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.concurrent_kill_1' into BackgrndStartup 2025.06.18 08:40:14.990080 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_qcf18570.realtimebuff__fuzz_20' into BackgrndStartup 2025.06.18 08:40:14.990101 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.m' into BackgrndStartup 2025.06.18 08:40:14.990122 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_qcf18570.realtimedistributed' into BackgrndStartup 2025.06.18 08:40:14.990143 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.rmt1' into BackgrndStartup 2025.06.18 08:40:14.990173 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1_db.test_mv' into BackgrndStartup 2025.06.18 08:40:14.990196 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_1_db' into BackgrndStartup 2025.06.18 08:40:14.990216 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.d' into BackgrndStartup 2025.06.18 08:40:14.990237 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.regexp_dict1' into BackgrndStartup 2025.06.18 08:40:14.990258 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.hits_s3' into BackgrndStartup 2025.06.18 08:40:14.990283 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.video_log' into BackgrndStartup 2025.06.18 08:40:14.990304 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.rmt2' into BackgrndStartup 2025.06.18 08:40:14.990325 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t0' into BackgrndStartup 2025.06.18 08:40:14.990348 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_13.00163_column_oriented' into BackgrndStartup 2025.06.18 08:40:14.990370 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t_nested_with_dots' into BackgrndStartup 2025.06.18 08:40:14.990396 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.error_win_func' into BackgrndStartup 2025.06.18 08:40:14.990421 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.02500_nested' into BackgrndStartup 2025.06.18 08:40:14.990445 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Replicated database test_1_db' into BackgrndStartup 2025.06.18 08:40:14.990467 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd' into BackgrndStartup 2025.06.18 08:40:14.990489 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.src' into BackgrndStartup 2025.06.18 08:40:14.990516 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.group_by_all' into BackgrndStartup 2025.06.18 08:40:14.990552 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test_table_comment' into BackgrndStartup 2025.06.18 08:40:14.990576 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.B1' into BackgrndStartup 2025.06.18 08:40:14.990597 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t2__fuzz_0' into BackgrndStartup 2025.06.18 08:40:14.990623 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_v4ezwkrr.null' into BackgrndStartup 2025.06.18 08:40:14.990645 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.location' into BackgrndStartup 2025.06.18 08:40:14.990667 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.table_default_protobuf_00825' into BackgrndStartup 2025.06.18 08:40:14.990688 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.dictionary_decimal_source_table' into BackgrndStartup 2025.06.18 08:40:14.990710 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_7.unit' into BackgrndStartup 2025.06.18 08:40:14.990737 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.testJoinTable' into BackgrndStartup 2025.06.18 08:40:14.990760 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.clickhouse_alias_issue_2' into BackgrndStartup 2025.06.18 08:40:14.990781 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test_move_partition_src' into BackgrndStartup 2025.06.18 08:40:14.990807 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test_lookup_table' into BackgrndStartup 2025.06.18 08:40:14.990830 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.product_groups' into BackgrndStartup 2025.06.18 08:40:14.990868 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.products' into BackgrndStartup 2025.06.18 08:40:14.990891 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.regexp_dict2' into BackgrndStartup 2025.06.18 08:40:14.990912 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.data' into BackgrndStartup 2025.06.18 08:40:14.990934 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t_rename_alter' into BackgrndStartup 2025.06.18 08:40:14.990956 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.src_table' into BackgrndStartup 2025.06.18 08:40:14.990981 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.A' into BackgrndStartup 2025.06.18 08:40:14.991022 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_15.ordinary_distinct' into BackgrndStartup 2025.06.18 08:40:14.991047 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.j' into BackgrndStartup 2025.06.18 08:40:14.991068 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.rdb' into BackgrndStartup 2025.06.18 08:40:14.991090 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.zero_rows_per_granule' into BackgrndStartup 2025.06.18 08:40:14.991115 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.bad_arrays' into BackgrndStartup 2025.06.18 08:40:14.991140 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.avro' into BackgrndStartup 2025.06.18 08:40:14.991161 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t1' into BackgrndStartup 2025.06.18 08:40:14.991181 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.tab_00717' into BackgrndStartup 2025.06.18 08:40:14.991202 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.ay' into BackgrndStartup 2025.06.18 08:40:14.991234 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.sample_prewhere' into BackgrndStartup 2025.06.18 08:40:14.991257 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_qcf18570.realtimedrep' into BackgrndStartup 2025.06.18 08:40:14.991279 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database 02911_support_alias_column_in_indices' into BackgrndStartup 2025.06.18 08:40:14.991300 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.LOG_T' into BackgrndStartup 2025.06.18 08:40:14.991323 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t_02559' into BackgrndStartup 2025.06.18 08:40:14.991347 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.tab_00481' into BackgrndStartup 2025.06.18 08:40:14.991370 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.r_prop_table1' into BackgrndStartup 2025.06.18 08:40:14.991391 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.mass_table_117' into BackgrndStartup 2025.06.18 08:40:14.991413 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.concurrent_kill_4' into BackgrndStartup 2025.06.18 08:40:14.991434 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_5ri8lnpr' into BackgrndStartup 2025.06.18 08:40:14.991459 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t2' into BackgrndStartup 2025.06.18 08:40:14.991481 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.tokenbf_tab' into BackgrndStartup 2025.06.18 08:40:14.991504 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.ngrambf_tab' into BackgrndStartup 2025.06.18 08:40:14.991525 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test_table' into BackgrndStartup 2025.06.18 08:40:14.991557 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.partition_id' into BackgrndStartup 2025.06.18 08:40:14.991584 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.regexp_dict3' into BackgrndStartup 2025.06.18 08:40:14.991621 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.quorum1' into BackgrndStartup 2025.06.18 08:40:14.991643 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.regexp_dict4' into BackgrndStartup 2025.06.18 08:40:14.991664 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t_github_json' into BackgrndStartup 2025.06.18 08:40:14.991684 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.a' into BackgrndStartup 2025.06.18 08:40:14.991710 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.copied_table' into BackgrndStartup 2025.06.18 08:40:14.991731 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.dict' into BackgrndStartup 2025.06.18 08:40:14.991752 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.rng' into BackgrndStartup 2025.06.18 08:40:14.991773 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_v4ezwkrr' into BackgrndStartup 2025.06.18 08:40:14.991795 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.table_for_concurrent_alter' into BackgrndStartup 2025.06.18 08:40:14.991820 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.nested_nested_table' into BackgrndStartup 2025.06.18 08:40:14.991842 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.data_r1' into BackgrndStartup 2025.06.18 08:40:14.991864 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.data2015' into BackgrndStartup 2025.06.18 08:40:14.991889 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test_input' into BackgrndStartup 2025.06.18 08:40:14.991912 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.video_log_result__fuzz_0' into BackgrndStartup 2025.06.18 08:40:14.991938 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_7.parsing_with_names' into BackgrndStartup 2025.06.18 08:40:14.991959 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t1__fuzz_17' into BackgrndStartup 2025.06.18 08:40:14.991985 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test' into BackgrndStartup 2025.06.18 08:40:14.992021 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_i227bf47.test_table' into BackgrndStartup 2025.06.18 08:40:14.992051 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.country_rings' into BackgrndStartup 2025.06.18 08:40:14.992082 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.with_fill_date' into BackgrndStartup 2025.06.18 08:40:14.992110 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_15' into BackgrndStartup 2025.06.18 08:40:14.992135 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.pipe_01019' into BackgrndStartup 2025.06.18 08:40:14.992158 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.dict_data' into BackgrndStartup 2025.06.18 08:40:14.992187 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_15.distinct_in_order' into BackgrndStartup 2025.06.18 08:40:14.992212 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1_db.test_mv3' into BackgrndStartup 2025.06.18 08:40:14.992234 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.t' into BackgrndStartup 2025.06.18 08:40:14.992256 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database datasets' into BackgrndStartup 2025.06.18 08:40:14.992278 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.src_01019' into BackgrndStartup 2025.06.18 08:40:14.992306 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.dict' into BackgrndStartup 2025.06.18 08:40:14.992329 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_i227bf47' into BackgrndStartup 2025.06.18 08:40:14.992355 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_7' into BackgrndStartup 2025.06.18 08:40:14.992377 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test2' into BackgrndStartup 2025.06.18 08:40:14.992402 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_i227bf47' into BackgrndStartup 2025.06.18 08:40:14.992429 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.mytable' into BackgrndStartup 2025.06.18 08:40:14.992452 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.table_src' into BackgrndStartup 2025.06.18 08:40:14.992473 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.test1' into BackgrndStartup 2025.06.18 08:40:14.992497 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.userid_set' into BackgrndStartup 2025.06.18 08:40:14.992519 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.data_r2' into BackgrndStartup 2025.06.18 08:40:14.992556 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.t1' into BackgrndStartup 2025.06.18 08:40:14.992583 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table 02911_support_alias_column_in_indices.test1' into BackgrndStartup 2025.06.18 08:40:14.992607 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t02176' into BackgrndStartup 2025.06.18 08:40:14.992629 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.mv_b_even' into BackgrndStartup 2025.06.18 08:40:14.992651 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_15.parsing_with_names' into BackgrndStartup 2025.06.18 08:40:14.992679 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.left' into BackgrndStartup 2025.06.18 08:40:14.992704 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.country_polygons' into BackgrndStartup 2025.06.18 08:40:14.992727 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.stored_aggregates' into BackgrndStartup 2025.06.18 08:40:14.992749 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.right' into BackgrndStartup 2025.06.18 08:40:14.992771 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.03006_test' into BackgrndStartup 2025.06.18 08:40:14.992797 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.table1' into BackgrndStartup 2025.06.18 08:40:14.992820 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_01516.primary_key_test' into BackgrndStartup 2025.06.18 08:40:14.992842 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_v4ezwkrr.mv' into BackgrndStartup 2025.06.18 08:40:14.992863 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database db_dict' into BackgrndStartup 2025.06.18 08:40:14.992887 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_5ri8lnpr.mv5' into BackgrndStartup 2025.06.18 08:40:14.992914 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_13' into BackgrndStartup 2025.06.18 08:40:14.992936 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.defaults' into BackgrndStartup 2025.06.18 08:40:14.992958 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.tab' into BackgrndStartup 2025.06.18 08:40:14.992981 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test_table_replicated' into BackgrndStartup 2025.06.18 08:40:14.993004 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.defaults' into BackgrndStartup 2025.06.18 08:40:14.993030 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test_table' into BackgrndStartup 2025.06.18 08:40:14.993053 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_1' into BackgrndStartup 2025.06.18 08:40:14.993083 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.broken_table' into BackgrndStartup 2025.06.18 08:40:14.993106 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test1' into BackgrndStartup 2025.06.18 08:40:14.993127 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.mt' into BackgrndStartup 2025.06.18 08:40:14.993153 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.r_prop_table2' into BackgrndStartup 2025.06.18 08:40:14.993178 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test_mv' into BackgrndStartup 2025.06.18 08:40:14.993201 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_1' into BackgrndStartup 2025.06.18 08:40:14.993222 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.concurrent_kill_2' into BackgrndStartup 2025.06.18 08:40:14.993244 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test_a' into BackgrndStartup 2025.06.18 08:40:14.993272 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test' into BackgrndStartup 2025.06.18 08:40:14.993295 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_5ri8lnpr.mv4' into BackgrndStartup 2025.06.18 08:40:14.993317 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.t_local' into BackgrndStartup 2025.06.18 08:40:14.993339 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_1_db' into BackgrndStartup 2025.06.18 08:40:14.993361 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.vt' into BackgrndStartup 2025.06.18 08:40:14.993387 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_sgwu2ec2' into BackgrndStartup 2025.06.18 08:40:14.993409 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_3' into BackgrndStartup 2025.06.18 08:40:14.993432 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.data_native_copy' into BackgrndStartup 2025.06.18 08:40:14.993457 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_15.unit' into BackgrndStartup 2025.06.18 08:40:14.993479 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_7' into BackgrndStartup 2025.06.18 08:40:14.993504 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_5ri8lnpr' into BackgrndStartup 2025.06.18 08:40:14.993526 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test.merge_hits' into BackgrndStartup 2025.06.18 08:40:14.993562 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.test_b' into BackgrndStartup 2025.06.18 08:40:14.993585 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.data_01882' into BackgrndStartup 2025.06.18 08:40:14.993607 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.bug' into BackgrndStartup 2025.06.18 08:40:14.993634 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_i227bf47.test_dictionary' into BackgrndStartup 2025.06.18 08:40:14.993659 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Atomic database test_15' into BackgrndStartup 2025.06.18 08:40:14.993681 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_3.t_uncompressed_cache' into BackgrndStartup 2025.06.18 08:40:14.993704 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.concurrent_kill_5' into BackgrndStartup 2025.06.18 08:40:14.993730 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.r2' into BackgrndStartup 2025.06.18 08:40:14.993752 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_qcf18570' into BackgrndStartup 2025.06.18 08:40:14.993776 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_7.distinct_in_order' into BackgrndStartup 2025.06.18 08:40:14.993800 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0' into BackgrndStartup 2025.06.18 08:40:14.993853 [ 65992 ] {} AsyncLoader: Schedule load job 'startup table test_1.clickhouse_alias_issue_1' into BackgrndStartup 2025.06.18 08:40:14.993887 [ 65992 ] {} AsyncLoader: Schedule load job 'startup Ordinary database test_3' into BackgrndStartup 2025.06.18 08:40:14.994284 [ 66733 ] {} AsyncLoader: Execute load job 'load table 02911_support_alias_column_in_indices.test1' in BackgroundLoad 2025.06.18 08:40:14.994358 [ 66733 ] {} DatabaseAtomic (02911_support_alias_column_in_indices): Loading table 02911_support_alias_column_in_indices.test1 2025.06.18 08:40:14.994407 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_1.A' in BackgroundLoad 2025.06.18 08:40:14.994516 [ 66741 ] {} DatabaseAtomic (test_1): Loading table test_1.A 2025.06.18 08:40:14.994533 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.data_native_copy' in BackgroundLoad 2025.06.18 08:40:14.994634 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.data_native_copy 2025.06.18 08:40:14.994670 [ 66722 ] {} AsyncLoader: Execute load job 'load table test_1.rmt2' in BackgroundLoad 2025.06.18 08:40:14.994772 [ 66722 ] {} DatabaseAtomic (test_1): Loading table test_1.rmt2 2025.06.18 08:40:14.994888 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_7.parsing_with_names' in BackgroundLoad 2025.06.18 08:40:14.995103 [ 66738 ] {} DatabaseAtomic (test_7): Loading table test_7.parsing_with_names 2025.06.18 08:40:14.995168 [ 65992 ] {} UserDefinedSQLObjectsLoaderFromDisk: Loading user defined objects from /var/lib/clickhouse/user_defined/ 2025.06.18 08:40:14.995165 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_1.nested_nested_table' in BackgroundLoad 2025.06.18 08:40:14.995315 [ 65992 ] {} UserDefinedSQLObjectsLoaderFromDisk: User defined objects loaded 2025.06.18 08:40:14.995343 [ 66747 ] {} DatabaseAtomic (test_1): Loading table test_1.nested_nested_table 2025.06.18 08:40:14.995395 [ 66720 ] {} AsyncLoader: Execute load job 'load table test_1.t_rename_alter' in BackgroundLoad 2025.06.18 08:40:14.995523 [ 66720 ] {} DatabaseAtomic (test_1): Loading table test_1.t_rename_alter 2025.06.18 08:40:14.995562 [ 65992 ] {} Application: Loaded metadata. 2025.06.18 08:40:14.995576 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.partition_id' in BackgroundLoad 2025.06.18 08:40:14.995708 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.country_rings' in BackgroundLoad 2025.06.18 08:40:14.995817 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.partition_id 2025.06.18 08:40:14.995939 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.country_rings 2025.06.18 08:40:14.995967 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_5ri8lnpr.mv4' in BackgroundLoad 2025.06.18 08:40:14.996067 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): Loading table test_5ri8lnpr.mv4 2025.06.18 08:40:14.996094 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_13.hits_none' in BackgroundLoad 2025.06.18 08:40:14.996231 [ 66729 ] {} DatabaseAtomic (test_13): Loading table test_13.hits_none 2025.06.18 08:40:14.996281 [ 66730 ] {} AsyncLoader: Execute load job 'load table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0' in BackgroundLoad 2025.06.18 08:40:14.996357 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk azure 2025.06.18 08:40:14.996422 [ 66730 ] {} DatabaseAtomic (test): Loading table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0 2025.06.18 08:40:14.996461 [ 66732 ] {} AsyncLoader: Execute load job 'load table test_1.tokenbf_tab' in BackgroundLoad 2025.06.18 08:40:14.996513 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk backups 2025.06.18 08:40:14.996584 [ 66732 ] {} DatabaseAtomic (test_1): Loading table test_1.tokenbf_tab 2025.06.18 08:40:14.996619 [ 66747 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.996605 [ 66735 ] {} AsyncLoader: Execute load job 'load table test_1_db.test_mv3' in BackgroundLoad 2025.06.18 08:40:14.996593 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk cached_azure 2025.06.18 08:40:14.996711 [ 66747 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.996763 [ 66735 ] {} DatabaseReplicated (test_1_db): Loading table test_1_db.test_mv3 2025.06.18 08:40:14.996797 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.r2' in BackgroundLoad 2025.06.18 08:40:14.996832 [ 66747 ] {} DatabaseAtomic (test_1): Counting attached table nested_nested_table to database test_1 2025.06.18 08:40:14.996894 [ 65992 ] {} bool DB::(anonymous namespace)::checkPermissionsImpl(): Code: 412. DB::Exception: Can't receive Netlink response: error -2. (NETLINK_ERROR) (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:14.996937 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.r2 2025.06.18 08:40:14.997006 [ 65992 ] {} Application: Tasks stats provider: procfs 2025.06.18 08:40:14.997182 [ 66703 ] {} AsyncLoader: Finish load job 'load table test_1.t2__fuzz_0' with status OK 2025.06.18 08:40:14.997269 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.997343 [ 66703 ] {} AsyncLoader: Execute load job 'load table test_qcf18570.realtimebuff__fuzz_19' in BackgroundLoad 2025.06.18 08:40:14.997375 [ 65992 ] {} DatabaseAtomic (system): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.997418 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.997485 [ 66703 ] {} DatabaseAtomic (test_qcf18570): Loading table test_qcf18570.realtimebuff__fuzz_19 2025.06.18 08:40:14.997502 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): Counting attached table mv4 to database test_5ri8lnpr 2025.06.18 08:40:14.997553 [ 66735 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.997434 [ 65992 ] {} DatabaseAtomic (system): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.997639 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_1.nested_nested_table' with status OK 2025.06.18 08:40:14.997664 [ 66735 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.997735 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_3.test_table' in BackgroundLoad 2025.06.18 08:40:14.997746 [ 66735 ] {} DatabaseReplicated (test_1_db): Counting attached table test_mv3 to database test_1_db 2025.06.18 08:40:14.997808 [ 66747 ] {} DatabaseAtomic (test_3): Loading table test_3.test_table 2025.06.18 08:40:14.997934 [ 66735 ] {} AsyncLoader: Finish load job 'load table test_1_db.test_mv3' with status OK 2025.06.18 08:40:14.998027 [ 66735 ] {} AsyncLoader: Execute load job 'load table test_1.t0' in BackgroundLoad 2025.06.18 08:40:14.998082 [ 66703 ] {} DatabaseAtomic (test_qcf18570): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.998095 [ 66735 ] {} DatabaseAtomic (test_1): Loading table test_1.t0 2025.06.18 08:40:14.998162 [ 66703 ] {} DatabaseAtomic (test_qcf18570): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.998279 [ 66703 ] {} DatabaseAtomic (test_qcf18570): Counting attached table realtimebuff__fuzz_19 to database test_qcf18570 2025.06.18 08:40:14.998420 [ 66703 ] {} AsyncLoader: Finish load job 'load table test_qcf18570.realtimebuff__fuzz_19' with status OK 2025.06.18 08:40:14.998498 [ 66703 ] {} AsyncLoader: Execute load job 'load table test_1.sample_prewhere' in BackgroundLoad 2025.06.18 08:40:14.998591 [ 66703 ] {} DatabaseAtomic (test_1): Loading table test_1.sample_prewhere 2025.06.18 08:40:14.998723 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_5ri8lnpr.mv4' with status OK 2025.06.18 08:40:14.998878 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_1.group_by_all' in BackgroundLoad 2025.06.18 08:40:14.998940 [ 66696 ] {} DatabaseAtomic (test_1): Loading table test_1.group_by_all 2025.06.18 08:40:14.999301 [ 66696 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:14.999363 [ 66696 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:14.999433 [ 66696 ] {} DatabaseAtomic (test_1): Counting attached table group_by_all to database test_1 2025.06.18 08:40:14.999564 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_1.group_by_all' with status OK 2025.06.18 08:40:14.999725 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_5ri8lnpr.mv5' in BackgroundLoad 2025.06.18 08:40:14.999778 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): Loading table test_5ri8lnpr.mv5 2025.06.18 08:40:15.000435 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.000493 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.000569 [ 66696 ] {} DatabaseAtomic (test_5ri8lnpr): Counting attached table mv5 to database test_5ri8lnpr 2025.06.18 08:40:15.000696 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_5ri8lnpr.mv5' with status OK 2025.06.18 08:40:15.000814 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_1.zero_rows_per_granule' in BackgroundLoad 2025.06.18 08:40:15.000873 [ 66696 ] {} DatabaseAtomic (test_1): Loading table test_1.zero_rows_per_granule 2025.06.18 08:40:15.003913 [ 66741 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): Loading data parts 2025.06.18 08:40:15.004326 [ 66741 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.004440 [ 66741 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.004732 [ 66711 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.005799 [ 66722 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ovw/vbymwvaxwotmblluvlmrgtqnqhgpl (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/format_version.txt) 2025.06.18 08:40:15.006106 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Reset state for seek to position 0 2025.06.18 08:40:15.006358 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.006470 [ 66722 ] {} FileSegment(0ae96a510d060e814a1f119ed5c1770b) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.007033 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 0ae96a510d060e814a1f119ed5c1770b, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:BackgroundLoad:66722, current write offset: 0, caller id: None:BackgroundLoad:66722, kind: Regular, unbound: 0 2025.06.18 08:40:15.007187 [ 66747 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): Loading data parts 2025.06.18 08:40:15.007256 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 0ae96a510d060e814a1f119ed5c1770b, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:BackgroundLoad:66722, current write offset: 0, caller id: None:BackgroundLoad:66722, kind: Regular, unbound: 0 2025.06.18 08:40:15.007348 [ 66734 ] {} StoragePolicy (__s3_disk): Storage policy __s3_disk created, total volumes 1 2025.06.18 08:40:15.007478 [ 66722 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/ovw/vbymwvaxwotmblluvlmrgtqnqhgpl, Version: Latest, Range: 0-0 2025.06.18 08:40:15.007924 [ 66747 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.007995 [ 66747 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.008022 [ 66734 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/fpc/sygmfjduodjsrjdrspbdxjjmvuzcg (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/format_version.txt) 2025.06.18 08:40:15.008235 [ 66711 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.008372 [ 66711 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.008427 [ 66732 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): Loading data parts 2025.06.18 08:40:15.008570 [ 66741 ] {} test_1.A (48a231f1-b942-4fa1-8549-1947e9a97446): Loaded data parts (1 items) 2025.06.18 08:40:15.008597 [ 66687 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.008718 [ 66733 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Loading data parts 2025.06.18 08:40:15.008860 [ 66732 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.008948 [ 66732 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.009054 [ 66733 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.009094 [ 66741 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.009122 [ 66733 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.009172 [ 66737 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.009232 [ 66741 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.009331 [ 66741 ] {} DatabaseAtomic (test_1): Counting attached table A to database test_1 2025.06.18 08:40:15.009401 [ 66750 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Loading Active part all_2_2_0 from disk default 2025.06.18 08:40:15.009438 [ 66690 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.009496 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_1.A' with status OK 2025.06.18 08:40:15.009626 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_3.table1' in BackgroundLoad 2025.06.18 08:40:15.009725 [ 66741 ] {} DatabaseAtomic (test_3): Loading table test_3.table1 2025.06.18 08:40:15.010092 [ 66741 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.010156 [ 66741 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.010483 [ 66741 ] {} DatabaseAtomic (test_3): Counting attached table table1 to database test_3 2025.06.18 08:40:15.010627 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_3.table1' with status OK 2025.06.18 08:40:15.010712 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_3.r_prop_table1' in BackgroundLoad 2025.06.18 08:40:15.010754 [ 66710 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Loading data parts 2025.06.18 08:40:15.010773 [ 66741 ] {} DatabaseAtomic (test_3): Loading table test_3.r_prop_table1 2025.06.18 08:40:15.010900 [ 66735 ] {} test_1.t0 (23ee484b-3233-4026-b71e-68a4abdd4401): Loading data parts 2025.06.18 08:40:15.011203 [ 66735 ] {} test_1.t0 (23ee484b-3233-4026-b71e-68a4abdd4401): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.011256 [ 66735 ] {} test_1.t0 (23ee484b-3233-4026-b71e-68a4abdd4401): There are no data parts 2025.06.18 08:40:15.011416 [ 66687 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.011500 [ 66687 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.011512 [ 66710 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.011613 [ 66710 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.011673 [ 66735 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.011732 [ 66735 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.011822 [ 66735 ] {} DatabaseAtomic (test_1): Counting attached table t0 to database test_1 2025.06.18 08:40:15.011859 [ 66728 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Loading Active part 19701028_19701028_3_3_0 from disk default 2025.06.18 08:40:15.011876 [ 66684 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): Loading data parts 2025.06.18 08:40:15.011891 [ 66711 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Loading Active part 19700720_19700720_2_2_0 from disk default 2025.06.18 08:40:15.011916 [ 66723 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Loading Active part 19700411_19700411_1_1_0 from disk default 2025.06.18 08:40:15.011938 [ 66735 ] {} AsyncLoader: Finish load job 'load table test_1.t0' with status OK 2025.06.18 08:40:15.012079 [ 66735 ] {} AsyncLoader: Execute load job 'load table test_1.mass_table_117' in BackgroundLoad 2025.06.18 08:40:15.012129 [ 66735 ] {} DatabaseAtomic (test_1): Loading table test_1.mass_table_117 2025.06.18 08:40:15.012266 [ 66684 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.012389 [ 66747 ] {} test_3.test_table (94cfedbb-6ae7-4db7-8a15-a5ef64320e7d): Loaded data parts (1 items) 2025.06.18 08:40:15.012382 [ 66718 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zcw/kqfyainmnfamgkvnlsilnezuyafuh (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/format_version.txt) 2025.06.18 08:40:15.012428 [ 66684 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.012624 [ 66750 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.012680 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Reset state for seek to position 0 2025.06.18 08:40:15.012706 [ 66750 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Finished loading Active part all_2_2_0 on disk default 2025.06.18 08:40:15.012790 [ 66747 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.012296 [ 66737 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.012865 [ 66703 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Loading data parts 2025.06.18 08:40:15.012924 [ 66737 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.013022 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.013051 [ 66747 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.013169 [ 66747 ] {} DatabaseAtomic (test_3): Counting attached table test_table to database test_3 2025.06.18 08:40:15.013207 [ 66718 ] {} FileSegment(965f71c318c928e790144875ffc2fab6) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.013244 [ 66703 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.013299 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_3.test_table' with status OK 2025.06.18 08:40:15.013317 [ 66703 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.013574 [ 66729 ] {} test_13.hits_none (4c045ce4-bca9-412e-881d-8c286958634b): Loading data parts 2025.06.18 08:40:15.013576 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 965f71c318c928e790144875ffc2fab6, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:BackgroundLoad:66718, current write offset: 0, caller id: None:BackgroundLoad:66718, kind: Regular, unbound: 0 2025.06.18 08:40:15.013770 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_1.a' in BackgroundLoad 2025.06.18 08:40:15.013845 [ 66747 ] {} DatabaseAtomic (test_1): Loading table test_1.a 2025.06.18 08:40:15.013888 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 965f71c318c928e790144875ffc2fab6, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:BackgroundLoad:66718, current write offset: 0, caller id: None:BackgroundLoad:66718, kind: Regular, unbound: 0 2025.06.18 08:40:15.013928 [ 66732 ] {} test_1.tokenbf_tab (4a72ff2c-261a-4635-9051-372ec970bfd6): Loaded data parts (1 items) 2025.06.18 08:40:15.013947 [ 66690 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.014004 [ 66718 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/zcw/kqfyainmnfamgkvnlsilnezuyafuh, Version: Latest, Range: 0-0 2025.06.18 08:40:15.014031 [ 66690 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.014215 [ 66747 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.014274 [ 66747 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.014330 [ 66747 ] {} DatabaseAtomic (test_1): Counting attached table a to database test_1 2025.06.18 08:40:15.014438 [ 66729 ] {} test_13.hits_none (4c045ce4-bca9-412e-881d-8c286958634b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.014449 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_1.a' with status OK 2025.06.18 08:40:15.014550 [ 66729 ] {} test_13.hits_none (4c045ce4-bca9-412e-881d-8c286958634b): There are no data parts 2025.06.18 08:40:15.014567 [ 66711 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): loadDataPart: inserting 19700720_19700720_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.014643 [ 66711 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Finished loading Active part 19700720_19700720_2_2_0 on disk default 2025.06.18 08:40:15.014668 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_7.distinct_in_order' in BackgroundLoad 2025.06.18 08:40:15.014735 [ 66747 ] {} DatabaseAtomic (test_7): Loading table test_7.distinct_in_order 2025.06.18 08:40:15.014792 [ 66733 ] {} `02911_support_alias_column_in_indices`.test1 (ab817616-53cb-416f-8457-ab89b1bf21ea): Loaded data parts (2 items) 2025.06.18 08:40:15.014784 [ 66728 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): loadDataPart: inserting 19701028_19701028_3_3_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.014913 [ 66728 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Finished loading Active part 19701028_19701028_3_3_0 on disk default 2025.06.18 08:40:15.014947 [ 66711 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Loading Active part 20190101_2_2_0 from disk default 2025.06.18 08:40:15.014964 [ 66729 ] {} DatabaseAtomic (test_13): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.015043 [ 66750 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Loading Active part 20190102_3_3_0 from disk default 2025.06.18 08:40:15.015098 [ 66729 ] {} DatabaseAtomic (test_13): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.015218 [ 66733 ] {} DatabaseAtomic (02911_support_alias_column_in_indices): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.015239 [ 66729 ] {} DatabaseAtomic (test_13): Counting attached table hits_none to database test_13 2025.06.18 08:40:15.015280 [ 66733 ] {} DatabaseAtomic (02911_support_alias_column_in_indices): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.015356 [ 66733 ] {} DatabaseAtomic (02911_support_alias_column_in_indices): Counting attached table test1 to database 02911_support_alias_column_in_indices 2025.06.18 08:40:15.015399 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_13.hits_none' with status OK 2025.06.18 08:40:15.015498 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.mytable' in BackgroundLoad 2025.06.18 08:40:15.015587 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.mytable 2025.06.18 08:40:15.015718 [ 66733 ] {} AsyncLoader: Finish load job 'load table 02911_support_alias_column_in_indices.test1' with status OK 2025.06.18 08:40:15.015837 [ 66723 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): loadDataPart: inserting 19700411_19700411_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.015827 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_qcf18570.realtimebuff__fuzz_20' in BackgroundLoad 2025.06.18 08:40:15.015997 [ 66733 ] {} DatabaseAtomic (test_qcf18570): Loading table test_qcf18570.realtimebuff__fuzz_20 2025.06.18 08:40:15.016030 [ 66723 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Finished loading Active part 19700411_19700411_1_1_0 on disk default 2025.06.18 08:40:15.016184 [ 66730 ] {} test.`.inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0` (d33e4685-3ebf-48c1-b2cb-6ab8daa81d88): Loading data parts 2025.06.18 08:40:15.016388 [ 66733 ] {} DatabaseAtomic (test_qcf18570): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.016449 [ 66733 ] {} DatabaseAtomic (test_qcf18570): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.016504 [ 66733 ] {} DatabaseAtomic (test_qcf18570): Counting attached table realtimebuff__fuzz_20 to database test_qcf18570 2025.06.18 08:40:15.016583 [ 66730 ] {} test.`.inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0` (d33e4685-3ebf-48c1-b2cb-6ab8daa81d88): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.016637 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_qcf18570.realtimebuff__fuzz_20' with status OK 2025.06.18 08:40:15.016673 [ 66710 ] {} test_1.partition_id (15fea4aa-3b98-48bc-8437-0456a719a88e): Loaded data parts (3 items) 2025.06.18 08:40:15.016683 [ 66730 ] {} test.`.inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0` (d33e4685-3ebf-48c1-b2cb-6ab8daa81d88): There are no data parts 2025.06.18 08:40:15.016713 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_1.error_win_func' in BackgroundLoad 2025.06.18 08:40:15.016962 [ 66733 ] {} DatabaseAtomic (test_1): Loading table test_1.error_win_func 2025.06.18 08:40:15.017269 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.017337 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.017403 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table partition_id to database test_1 2025.06.18 08:40:15.017474 [ 66730 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.017528 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.partition_id' with status OK 2025.06.18 08:40:15.017609 [ 66730 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.017630 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.product_groups' in BackgroundLoad 2025.06.18 08:40:15.017699 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.product_groups 2025.06.18 08:40:15.017702 [ 66730 ] {} DatabaseAtomic (test): Counting attached table .inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0 to database test 2025.06.18 08:40:15.017844 [ 66696 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): Loading data parts 2025.06.18 08:40:15.017941 [ 66737 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Loading Active part 20190101_1_1_0 from disk default 2025.06.18 08:40:15.018008 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.017946 [ 66730 ] {} AsyncLoader: Finish load job 'load table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0' with status OK 2025.06.18 08:40:15.018068 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.018141 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table product_groups to database test_1 2025.06.18 08:40:15.018164 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_3.test_input' in BackgroundLoad 2025.06.18 08:40:15.018282 [ 66730 ] {} DatabaseAtomic (test_3): Loading table test_3.test_input 2025.06.18 08:40:15.018477 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.product_groups' with status OK 2025.06.18 08:40:15.018588 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_3.t_uncompressed_cache' in BackgroundLoad 2025.06.18 08:40:15.018650 [ 66710 ] {} DatabaseAtomic (test_3): Loading table test_3.t_uncompressed_cache 2025.06.18 08:40:15.018743 [ 66732 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.018825 [ 66711 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): loadDataPart: inserting 20190101_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.018835 [ 66732 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.018917 [ 66711 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Finished loading Active part 20190101_2_2_0 on disk default 2025.06.18 08:40:15.018940 [ 66732 ] {} DatabaseAtomic (test_1): Counting attached table tokenbf_tab to database test_1 2025.06.18 08:40:15.019076 [ 66732 ] {} AsyncLoader: Finish load job 'load table test_1.tokenbf_tab' with status OK 2025.06.18 08:40:15.019139 [ 66732 ] {} AsyncLoader: Execute load job 'load table test_15.ordinary_distinct' in BackgroundLoad 2025.06.18 08:40:15.019178 [ 66732 ] {} DatabaseAtomic (test_15): Loading table test_15.ordinary_distinct 2025.06.18 08:40:15.019760 [ 66750 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): loadDataPart: inserting 20190102_3_3_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.019807 [ 66696 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.019805 [ 66735 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading data parts 2025.06.18 08:40:15.019897 [ 66696 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.019899 [ 66750 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Finished loading Active part 20190102_3_3_0 on disk default 2025.06.18 08:40:15.020142 [ 66691 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): Loading Active part 201805_1_2_1 from disk default 2025.06.18 08:40:15.020555 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.020701 [ 66685 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.020774 [ 66722 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for 0ae96a510d060e814a1f119ed5c1770b:0, current usage: size: 0/104857600, elements: 0/10000000 (description: s3_cache) 2025.06.18 08:40:15.020997 [ 66747 ] {} test_7.distinct_in_order (6f5051ce-6878-49c3-9d74-c65ed42d1dca): Loading data parts 2025.06.18 08:40:15.021168 [ 66722 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 0 2025.06.18 08:40:15.021311 [ 66722 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 0ae96a510d060e814a1f119ed5c1770b, offset: 0, size: 1 2025.06.18 08:40:15.021339 [ 66747 ] {} test_7.distinct_in_order (6f5051ce-6878-49c3-9d74-c65ed42d1dca): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.021401 [ 66747 ] {} test_7.distinct_in_order (6f5051ce-6878-49c3-9d74-c65ed42d1dca): There are no data parts 2025.06.18 08:40:15.021536 [ 66737 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): loadDataPart: inserting 20190101_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.021565 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Successfully written 1 bytes 2025.06.18 08:40:15.021639 [ 66737 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Finished loading Active part 20190101_1_1_0 on disk default 2025.06.18 08:40:15.021720 [ 66747 ] {} DatabaseAtomic (test_7): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.021809 [ 66703 ] {} test_1.sample_prewhere (d353cc28-1b5e-4e2f-86fd-a5505a585a00): Loaded data parts (3 items) 2025.06.18 08:40:15.021832 [ 66747 ] {} DatabaseAtomic (test_7): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.021936 [ 66747 ] {} DatabaseAtomic (test_7): Counting attached table distinct_in_order to database test_7 2025.06.18 08:40:15.022022 [ 66735 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.022063 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_7.distinct_in_order' with status OK 2025.06.18 08:40:15.022085 [ 66735 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Will load 97 parts using up to 64 threads 2025.06.18 08:40:15.022089 [ 66710 ] {} test_3.t_uncompressed_cache (7950c53c-6a10-44f0-886e-4fc284a0fcf0): Loading data parts 2025.06.18 08:40:15.022134 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_3.ay' in BackgroundLoad 2025.06.18 08:40:15.022186 [ 66747 ] {} DatabaseAtomic (test_3): Loading table test_3.ay 2025.06.18 08:40:15.022309 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20000707_20000707_10_10_0 from disk default 2025.06.18 08:40:15.022426 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20120119_20120119_15_15_0 from disk default 2025.06.18 08:40:15.022328 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.021653 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.022553 [ 66710 ] {} test_3.t_uncompressed_cache (7950c53c-6a10-44f0-886e-4fc284a0fcf0): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.022586 [ 66718 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for 965f71c318c928e790144875ffc2fab6:0, current usage: size: 1/104857600, elements: 1/10000000 (description: s3_cache) 2025.06.18 08:40:15.022612 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21450628_21450628_50_50_0 from disk default 2025.06.18 08:40:15.022493 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20400620_20400620_93_93_0 from disk default 2025.06.18 08:40:15.022621 [ 66710 ] {} test_3.t_uncompressed_cache (7950c53c-6a10-44f0-886e-4fc284a0fcf0): There are no data parts 2025.06.18 08:40:15.022622 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19771229_19771229_36_36_0 from disk default 2025.06.18 08:40:15.022698 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20621222_20621222_40_40_0 from disk default 2025.06.18 08:40:15.022800 [ 66718 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 1 2025.06.18 08:40:15.022863 [ 66718 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 965f71c318c928e790144875ffc2fab6, offset: 0, size: 1 2025.06.18 08:40:15.022861 [ 66722 ] {} FileSegment(0ae96a510d060e814a1f119ed5c1770b) : [0, 0]: Resetting downloader from None:BackgroundLoad:66722 2025.06.18 08:40:15.023054 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Successfully written 1 bytes 2025.06.18 08:40:15.023083 [ 66703 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.023107 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.023093 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21041008_21041008_49_49_0 from disk default 2025.06.18 08:40:15.023198 [ 66718 ] {} FileSegment(965f71c318c928e790144875ffc2fab6) : [0, 0]: Resetting downloader from None:BackgroundLoad:66718 2025.06.18 08:40:15.023459 [ 66710 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.023453 [ 66718 ] {} FileSegment(965f71c318c928e790144875ffc2fab6) : [0, 0]: Complete batch. (File segment: [0, 0], key: 965f71c318c928e790144875ffc2fab6, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:BackgroundLoad:66718, kind: Regular, unbound: 0) 2025.06.18 08:40:15.023453 [ 66722 ] {} FileSegment(0ae96a510d060e814a1f119ed5c1770b) : [0, 0]: Complete batch. (File segment: [0, 0], key: 0ae96a510d060e814a1f119ed5c1770b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:BackgroundLoad:66722, kind: Regular, unbound: 0) 2025.06.18 08:40:15.023576 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk default 2025.06.18 08:40:15.023701 [ 66722 ] {} CachedOnDiskReadBufferFromFile(0ae96a510d060e814a1f119ed5c1770b): Key: 0ae96a510d060e814a1f119ed5c1770b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.023733 [ 66718 ] {} CachedOnDiskReadBufferFromFile(965f71c318c928e790144875ffc2fab6): Key: 965f71c318c928e790144875ffc2fab6. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.023705 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk1_02961 2025.06.18 08:40:15.023857 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk2_02961 2025.06.18 08:40:15.023877 [ 66733 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): Loading data parts 2025.06.18 08:40:15.023507 [ 66734 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): Loading data parts 2025.06.18 08:40:15.023945 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk3_02961 2025.06.18 08:40:15.023948 [ 66729 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): Loading data parts 2025.06.18 08:40:15.024088 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk4_02961 2025.06.18 08:40:15.024726 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_cache 2025.06.18 08:40:15.024797 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_cache_2 2025.06.18 08:40:15.024801 [ 66703 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.024979 [ 66691 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): loadDataPart: inserting 201805_1_2_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.024982 [ 66703 ] {} DatabaseAtomic (test_1): Counting attached table sample_prewhere to database test_1 2025.06.18 08:40:15.025053 [ 66691 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): Finished loading Active part 201805_1_2_1 on disk default 2025.06.18 08:40:15.025263 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_cache_3 2025.06.18 08:40:15.025275 [ 66696 ] {} test_1.zero_rows_per_granule (62016341-9d99-4cf5-b708-38b777129103): Loaded data parts (1 items) 2025.06.18 08:40:15.025323 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_disk 2025.06.18 08:40:15.025334 [ 66703 ] {} AsyncLoader: Finish load job 'load table test_1.sample_prewhere' with status OK 2025.06.18 08:40:15.025376 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_disk_2 2025.06.18 08:40:15.025438 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20400620_20400620_93_93_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.025476 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_disk_3 2025.06.18 08:40:15.025512 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20400620_20400620_93_93_0 on disk default 2025.06.18 08:40:15.025562 [ 66703 ] {} AsyncLoader: Execute load job 'load table test_3.test_table_replicated' in BackgroundLoad 2025.06.18 08:40:15.025620 [ 66730 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Loading data parts 2025.06.18 08:40:15.025721 [ 66703 ] {} DatabaseAtomic (test_3): Loading table test_3.test_table_replicated 2025.06.18 08:40:15.025758 [ 66696 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.025833 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20000707_20000707_10_10_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.025912 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20000707_20000707_10_10_0 on disk default 2025.06.18 08:40:15.026143 [ 66685 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.026205 [ 66685 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.026655 [ 66730 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.026686 [ 66696 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.026722 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache 2025.06.18 08:40:15.026736 [ 66730 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.026781 [ 66696 ] {} DatabaseAtomic (test_1): Counting attached table zero_rows_per_granule to database test_1 2025.06.18 08:40:15.026988 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_1.zero_rows_per_granule' with status OK 2025.06.18 08:40:15.027054 [ 66733 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.027085 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_1.data_r1' in BackgroundLoad 2025.06.18 08:40:15.027125 [ 66733 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.027178 [ 66696 ] {} DatabaseAtomic (test_1): Loading table test_1.data_r1 2025.06.18 08:40:15.027225 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_02933 2025.06.18 08:40:15.027558 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19771229_19771229_36_36_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.027563 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21051222_21051222_91_91_0 from disk default 2025.06.18 08:40:15.027638 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19771229_19771229_36_36_0 on disk default 2025.06.18 08:40:15.027667 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_02944 2025.06.18 08:40:15.027703 [ 66710 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.028038 [ 66684 ] {} test_1.country_rings (eea63bf5-6ee6-4896-ad62-943026af1690): Loaded data parts (1 items) 2025.06.18 08:40:15.028116 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_multi 2025.06.18 08:40:15.028141 [ 66710 ] {} DatabaseAtomic (test_3): Counting attached table t_uncompressed_cache to database test_3 2025.06.18 08:40:15.028146 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20120119_20120119_15_15_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.028227 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20120119_20120119_15_15_0 on disk default 2025.06.18 08:40:15.028432 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21450628_21450628_50_50_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.028438 [ 66732 ] {} test_15.ordinary_distinct (63d3f77a-52ea-4149-a91b-482b55798268): Loading data parts 2025.06.18 08:40:15.028488 [ 66741 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Loading data parts 2025.06.18 08:40:15.028510 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21450628_21450628_50_50_0 on disk default 2025.06.18 08:40:15.028535 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20621222_20621222_40_40_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.028561 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_multi_2 2025.06.18 08:40:15.028624 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20621222_20621222_40_40_0 on disk default 2025.06.18 08:40:15.028692 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.028968 [ 66732 ] {} test_15.ordinary_distinct (63d3f77a-52ea-4149-a91b-482b55798268): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.028977 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.029030 [ 66732 ] {} test_15.ordinary_distinct (63d3f77a-52ea-4149-a91b-482b55798268): There are no data parts 2025.06.18 08:40:15.029079 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21041008_21041008_49_49_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.029136 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21041008_21041008_49_49_0 on disk default 2025.06.18 08:40:15.029002 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_disk 2025.06.18 08:40:15.028986 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_3.t_uncompressed_cache' with status OK 2025.06.18 08:40:15.029619 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_3.defaults' in BackgroundLoad 2025.06.18 08:40:15.029128 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table country_rings to database test_1 2025.06.18 08:40:15.029304 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_disk_02944 2025.06.18 08:40:15.029423 [ 66732 ] {} DatabaseAtomic (test_15): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.029683 [ 66710 ] {} DatabaseAtomic (test_3): Loading table test_3.defaults 2025.06.18 08:40:15.029760 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_disk_02963 2025.06.18 08:40:15.029788 [ 66718 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Loading data parts 2025.06.18 08:40:15.029803 [ 66732 ] {} DatabaseAtomic (test_15): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.029831 [ 66729 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.029845 [ 66126 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_no_cache 2025.06.18 08:40:15.029846 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.country_rings' with status OK 2025.06.18 08:40:15.030130 [ 66729 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.030198 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_3.right' in BackgroundLoad 2025.06.18 08:40:15.030192 [ 66732 ] {} DatabaseAtomic (test_15): Counting attached table ordinary_distinct to database test_15 2025.06.18 08:40:15.030253 [ 66684 ] {} DatabaseAtomic (test_3): Loading table test_3.right 2025.06.18 08:40:15.030380 [ 66732 ] {} AsyncLoader: Finish load job 'load table test_15.ordinary_distinct' with status OK 2025.06.18 08:40:15.030480 [ 66732 ] {} AsyncLoader: Execute load job 'load table test_15.unit' in BackgroundLoad 2025.06.18 08:40:15.030535 [ 66732 ] {} DatabaseAtomic (test_15): Loading table test_15.unit 2025.06.18 08:40:15.030728 [ 66728 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.030754 [ 66723 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.031142 [ 66722 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Loading data parts 2025.06.18 08:40:15.031173 [ 66685 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Loading Active part all_2_2_0 from disk default 2025.06.18 08:40:15.031406 [ 66732 ] {} DatabaseAtomic (test_15): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.031473 [ 66732 ] {} DatabaseAtomic (test_15): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.032030 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21051222_21051222_91_91_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.032103 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21051222_21051222_91_91_0 on disk default 2025.06.18 08:40:15.032214 [ 66732 ] {} DatabaseAtomic (test_15): Counting attached table unit to database test_15 2025.06.18 08:40:15.032344 [ 66732 ] {} AsyncLoader: Finish load job 'load table test_15.unit' with status OK 2025.06.18 08:40:15.032427 [ 66732 ] {} AsyncLoader: Execute load job 'load table test_15.parsing_with_names' in BackgroundLoad 2025.06.18 08:40:15.032491 [ 66732 ] {} DatabaseAtomic (test_15): Loading table test_15.parsing_with_names 2025.06.18 08:40:15.032660 [ 66747 ] {} test_3.ay (fd8485f5-d933-491f-a202-5f1bcd250d9d): Loading data parts 2025.06.18 08:40:15.033176 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19860618_19860618_76_76_0 from disk default 2025.06.18 08:40:15.033367 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21000501_21000501_27_27_0 from disk default 2025.06.18 08:40:15.033414 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20270927_20270927_16_16_0 from disk default 2025.06.18 08:40:15.033594 [ 66685 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.033600 [ 66747 ] {} test_3.ay (fd8485f5-d933-491f-a202-5f1bcd250d9d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.033213 [ 66766 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.033655 [ 66685 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Finished loading Active part all_2_2_0 on disk default 2025.06.18 08:40:15.033653 [ 66728 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.033692 [ 66747 ] {} test_3.ay (fd8485f5-d933-491f-a202-5f1bcd250d9d): There are no data parts 2025.06.18 08:40:15.033726 [ 66710 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.033856 [ 66728 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.034793 [ 66710 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.034822 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20101010_20101010_73_73_0 from disk default 2025.06.18 08:40:15.034908 [ 66733 ] {} test_1.error_win_func (685a1ea6-26d9-4aa4-8191-64b7eb8c7df8): Loaded data parts (1 items) 2025.06.18 08:40:15.034700 [ 66741 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.034603 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21480314_21480314_55_55_0 from disk default 2025.06.18 08:40:15.034949 [ 66684 ] {} test_3.right (5bb6d2bf-0f8a-4bcc-b22b-6904980e3f55): Loading data parts 2025.06.18 08:40:15.034884 [ 66710 ] {} DatabaseAtomic (test_3): Counting attached table defaults to database test_3 2025.06.18 08:40:15.035205 [ 66747 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.035285 [ 66747 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.035356 [ 66733 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.035390 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_3.defaults' with status OK 2025.06.18 08:40:15.035388 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21490528_21490528_44_44_0 from disk default 2025.06.18 08:40:15.035490 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19800915_19800915_95_95_0 from disk default 2025.06.18 08:40:15.035553 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20110414_20110414_68_68_0 from disk default 2025.06.18 08:40:15.035745 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19830531_19830531_38_38_0 from disk default 2025.06.18 08:40:15.035841 [ 66741 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.035935 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20890221_20890221_90_90_0 from disk default 2025.06.18 08:40:15.036011 [ 66747 ] {} DatabaseAtomic (test_3): Counting attached table ay to database test_3 2025.06.18 08:40:15.036121 [ 66733 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.036178 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_3.test_a' in BackgroundLoad 2025.06.18 08:40:15.036285 [ 66696 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Loading data parts 2025.06.18 08:40:15.036020 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21261126_21261126_13_13_0 from disk default 2025.06.18 08:40:15.036529 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20270927_20270927_16_16_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.036167 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21420518_21420518_84_84_0 from disk default 2025.06.18 08:40:15.036650 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20270927_20270927_16_16_0 on disk default 2025.06.18 08:40:15.036734 [ 66733 ] {} DatabaseAtomic (test_1): Counting attached table error_win_func to database test_1 2025.06.18 08:40:15.037303 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19860618_19860618_76_76_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.037381 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19860618_19860618_76_76_0 on disk default 2025.06.18 08:40:15.038153 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21000501_21000501_27_27_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.038238 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21000501_21000501_27_27_0 on disk default 2025.06.18 08:40:15.038355 [ 66710 ] {} DatabaseAtomic (test_3): Loading table test_3.test_a 2025.06.18 08:40:15.038456 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_3.ay' with status OK 2025.06.18 08:40:15.038874 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_3.dict_data' in BackgroundLoad 2025.06.18 08:40:15.038950 [ 66747 ] {} DatabaseAtomic (test_3): Loading table test_3.dict_data 2025.06.18 08:40:15.039221 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_1.error_win_func' with status OK 2025.06.18 08:40:15.039224 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21490528_21490528_44_44_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.039321 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21490528_21490528_44_44_0 on disk default 2025.06.18 08:40:15.039485 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_1.t_local' in BackgroundLoad 2025.06.18 08:40:15.039572 [ 66733 ] {} DatabaseAtomic (test_1): Loading table test_1.t_local 2025.06.18 08:40:15.039648 [ 66747 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.039861 [ 66733 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.040004 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21480314_21480314_55_55_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.040026 [ 66684 ] {} test_3.right (5bb6d2bf-0f8a-4bcc-b22b-6904980e3f55): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.040072 [ 66723 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.040078 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21480314_21480314_55_55_0 on disk default 2025.06.18 08:40:15.040054 [ 66747 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.040151 [ 66723 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.040233 [ 66733 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.040125 [ 66684 ] {} test_3.right (5bb6d2bf-0f8a-4bcc-b22b-6904980e3f55): There are no data parts 2025.06.18 08:40:15.040301 [ 66747 ] {} DatabaseAtomic (test_3): Counting attached table dict_data to database test_3 2025.06.18 08:40:15.040300 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21230101_21230101_92_92_0 from disk default 2025.06.18 08:40:15.040309 [ 66729 ] {} test_1.mytable (6ff38041-b0c0-40ce-bbec-d1fd1a379dad): Loaded data parts (1 items) 2025.06.18 08:40:15.040340 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19940304_19940304_43_43_0 from disk default 2025.06.18 08:40:15.040428 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_3.dict_data' with status OK 2025.06.18 08:40:15.040754 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19830531_19830531_38_38_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.040860 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19830531_19830531_38_38_0 on disk default 2025.06.18 08:40:15.040918 [ 66733 ] {} DatabaseAtomic (test_1): Counting attached table t_local to database test_1 2025.06.18 08:40:15.041163 [ 66684 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.041315 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.041684 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_13.parsing_with_names' in BackgroundLoad 2025.06.18 08:40:15.041987 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19800915_19800915_95_95_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.042008 [ 66684 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.042047 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19800915_19800915_95_95_0 on disk default 2025.06.18 08:40:15.042083 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.042561 [ 66684 ] {} DatabaseAtomic (test_3): Counting attached table right to database test_3 2025.06.18 08:40:15.042580 [ 66690 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Loading Active part all_0_2_1 from disk default 2025.06.18 08:40:15.042603 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_1.t_local' with status OK 2025.06.18 08:40:15.042601 [ 66747 ] {} DatabaseAtomic (test_13): Loading table test_13.parsing_with_names 2025.06.18 08:40:15.042647 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table mytable to database test_1 2025.06.18 08:40:15.042846 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20110414_20110414_68_68_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.042924 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20110414_20110414_68_68_0 on disk default 2025.06.18 08:40:15.043202 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_sgwu2ec2.view_nulls' in BackgroundLoad 2025.06.18 08:40:15.043287 [ 66733 ] {} DatabaseAtomic (test_sgwu2ec2): Loading table test_sgwu2ec2.view_nulls 2025.06.18 08:40:15.043359 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_3.right' with status OK 2025.06.18 08:40:15.043711 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19940304_19940304_43_43_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.043780 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19940304_19940304_43_43_0 on disk default 2025.06.18 08:40:15.043959 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.j' in BackgroundLoad 2025.06.18 08:40:15.044027 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.j 2025.06.18 08:40:15.044285 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.mytable' with status OK 2025.06.18 08:40:15.044475 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_3.src_01019' in BackgroundLoad 2025.06.18 08:40:15.044525 [ 66696 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.044623 [ 66696 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.044687 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20390816_20390816_3_3_0 from disk default 2025.06.18 08:40:15.044751 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21230502_21230502_23_23_0 from disk default 2025.06.18 08:40:15.044796 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20920301_20920301_82_82_0 from disk default 2025.06.18 08:40:15.044843 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21230101_21230101_92_92_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.044927 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21230101_21230101_92_92_0 on disk default 2025.06.18 08:40:15.044967 [ 66729 ] {} DatabaseAtomic (test_3): Loading table test_3.src_01019 2025.06.18 08:40:15.045036 [ 66684 ] {} HashJoin: Keys: [() = (id)], datatype: EMPTY, kind: Left, strictness: Any, right header: id UInt32 UInt32(size = 0), val UInt8 UInt8(size = 0) 2025.06.18 08:40:15.045326 [ 66768 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21370513_21370513_46_46_0 from disk default 2025.06.18 08:40:15.045480 [ 66733 ] {} DatabaseAtomic (test_sgwu2ec2): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.045477 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20101010_20101010_73_73_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.045517 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21490404_21490404_72_72_0 from disk default 2025.06.18 08:40:15.045551 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21371215_21371215_63_63_0 from disk default 2025.06.18 08:40:15.045593 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20101010_20101010_73_73_0 on disk default 2025.06.18 08:40:15.045595 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20460913_20460913_8_8_0 from disk default 2025.06.18 08:40:15.045687 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21140415_21140415_54_54_0 from disk default 2025.06.18 08:40:15.045747 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20890221_20890221_90_90_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.045781 [ 66729 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.045852 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20890221_20890221_90_90_0 on disk default 2025.06.18 08:40:15.045891 [ 66729 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.046135 [ 66690 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): loadDataPart: inserting all_0_2_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.046208 [ 66690 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Finished loading Active part all_0_2_1 on disk default 2025.06.18 08:40:15.046683 [ 66729 ] {} DatabaseAtomic (test_3): Counting attached table src_01019 to database test_3 2025.06.18 08:40:15.046763 [ 66733 ] {} DatabaseAtomic (test_sgwu2ec2): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.046790 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_3.src_01019' with status OK 2025.06.18 08:40:15.046837 [ 66733 ] {} DatabaseAtomic (test_sgwu2ec2): Counting attached table view_nulls to database test_sgwu2ec2 2025.06.18 08:40:15.047103 [ 66766 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.047169 [ 66766 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.047237 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.t2' in BackgroundLoad 2025.06.18 08:40:15.047304 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.t2 2025.06.18 08:40:15.047320 [ 66730 ] {} test_3.test_input (a9ea7e2d-ace3-40fb-9eb4-8646cbf15648): Loaded data parts (2 items) 2025.06.18 08:40:15.048383 [ 66730 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.046647 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21220624_21220624_62_62_0 from disk default 2025.06.18 08:40:15.049039 [ 66741 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Loaded data parts (1 items) 2025.06.18 08:40:15.049359 [ 66730 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.049440 [ 66730 ] {} DatabaseAtomic (test_3): Counting attached table test_input to database test_3 2025.06.18 08:40:15.049442 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_sgwu2ec2.view_nulls' with status OK 2025.06.18 08:40:15.049551 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_1.video_log_result__fuzz_0' in BackgroundLoad 2025.06.18 08:40:15.049619 [ 66733 ] {} DatabaseAtomic (test_1): Loading table test_1.video_log_result__fuzz_0 2025.06.18 08:40:15.049619 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21490404_21490404_72_72_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.049721 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21490404_21490404_72_72_0 on disk default 2025.06.18 08:40:15.049730 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21371215_21371215_63_63_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.049721 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_3.test_input' with status OK 2025.06.18 08:40:15.049807 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21371215_21371215_63_63_0 on disk default 2025.06.18 08:40:15.050334 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.LOG_T' in BackgroundLoad 2025.06.18 08:40:15.050601 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20390816_20390816_3_3_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.050750 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.LOG_T 2025.06.18 08:40:15.050761 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20390816_20390816_3_3_0 on disk default 2025.06.18 08:40:15.050641 [ 66741 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.050812 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21140415_21140415_54_54_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.050936 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21140415_21140415_54_54_0 on disk default 2025.06.18 08:40:15.051042 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21230502_21230502_23_23_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.051062 [ 65992 ] {} CertificateReloader: Reloading certificate (/etc/clickhouse-server/server.crt) and key (/etc/clickhouse-server/server.key). 2025.06.18 08:40:15.051118 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21230502_21230502_23_23_0 on disk default 2025.06.18 08:40:15.051156 [ 66741 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.051214 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21261126_21261126_13_13_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.051284 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21261126_21261126_13_13_0 on disk default 2025.06.18 08:40:15.051574 [ 66684 ] {} StorageSetOrJoinBase: Loaded from backup file store/b14/b147c82c-3f43-4e11-aea6-fde0b5d80959/1.bin. 2 rows, 10.00 B. State has 2 unique rows. 2025.06.18 08:40:15.051635 [ 66741 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.051410 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20920301_20920301_82_82_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.051746 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.051784 [ 66684 ] {} HashJoin: Shrinking stored blocks, memory consumption is 6.25 KiB calculated by join, 0.00 B by memory tracker 2025.06.18 08:40:15.051814 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20460913_20460913_8_8_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.051836 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.051763 [ 66741 ] {} DatabaseAtomic (test_3): Counting attached table r_prop_table1 to database test_3 2025.06.18 08:40:15.051786 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20920301_20920301_82_82_0 on disk default 2025.06.18 08:40:15.051930 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table t2 to database test_1 2025.06.18 08:40:15.051917 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20460913_20460913_8_8_0 on disk default 2025.06.18 08:40:15.051946 [ 66684 ] {} HashJoin: Shrunk stored blocks 127.00 B freed (0.00 B by memory tracker), new memory consumption is 6.13 KiB (10.75 MiB by memory tracker) 2025.06.18 08:40:15.052036 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_3.r_prop_table1' with status OK 2025.06.18 08:40:15.052139 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21420518_21420518_84_84_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.052212 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21420518_21420518_84_84_0 on disk default 2025.06.18 08:40:15.052219 [ 66741 ] {} AsyncLoader: Execute load job 'load table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b' in BackgroundLoad 2025.06.18 08:40:15.052212 [ 66684 ] {} StorageJoin: Optimized Join storage from 6400 to 6273 bytes 2025.06.18 08:40:15.052354 [ 66741 ] {} DatabaseAtomic (test): Loading table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b 2025.06.18 08:40:15.052405 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.052428 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.t2' with status OK 2025.06.18 08:40:15.052472 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.052492 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20120520_20120531_12_12_0 from disk default 2025.06.18 08:40:15.052522 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21220421_21220421_28_28_0 from disk default 2025.06.18 08:40:15.052506 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1_db.test_mv2' in BackgroundLoad 2025.06.18 08:40:15.052692 [ 66768 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21370513_21370513_46_46_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.052711 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table j to database test_1 2025.06.18 08:40:15.052716 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20830812_20830812_19_19_0 from disk default 2025.06.18 08:40:15.052766 [ 66768 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21370513_21370513_46_46_0 on disk default 2025.06.18 08:40:15.052765 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20961103_20961103_21_21_0 from disk default 2025.06.18 08:40:15.052860 [ 66690 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Loading Active part all_94_101_1 from disk default 2025.06.18 08:40:15.053883 [ 66729 ] {} DatabaseReplicated (test_1_db): Loading table test_1_db.test_mv2 2025.06.18 08:40:15.053977 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.j' with status OK 2025.06.18 08:40:15.054076 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_3.table_src' in BackgroundLoad 2025.06.18 08:40:15.054142 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21220624_21220624_62_62_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.054171 [ 66684 ] {} DatabaseAtomic (test_3): Loading table test_3.table_src 2025.06.18 08:40:15.054217 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21220624_21220624_62_62_0 on disk default 2025.06.18 08:40:15.054247 [ 66729 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.054291 [ 66729 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.054338 [ 66729 ] {} DatabaseReplicated (test_1_db): Counting attached table test_mv2 to database test_1_db 2025.06.18 08:40:15.054433 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1_db.test_mv2' with status OK 2025.06.18 08:40:15.054733 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.concurrent_kill_2' in BackgroundLoad 2025.06.18 08:40:15.054750 [ 66690 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): loadDataPart: inserting all_94_101_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.054790 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.concurrent_kill_2 2025.06.18 08:40:15.054836 [ 66690 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Finished loading Active part all_94_101_1 on disk default 2025.06.18 08:40:15.055297 [ 66685 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Loading Active part all_50_93_2 from disk default 2025.06.18 08:40:15.055437 [ 65992 ] {} CertificateReloader: Reloaded certificate (/etc/clickhouse-server/server.crt) and key (/etc/clickhouse-server/server.key). 2025.06.18 08:40:15.055436 [ 66769 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Loading Active part all_0_49_3 from disk default 2025.06.18 08:40:15.055520 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21130612_21130612_1_1_0 from disk default 2025.06.18 08:40:15.055592 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21031103_21031108_5_5_0 from disk default 2025.06.18 08:40:15.055635 [ 65992 ] {} CertificateReloader: Initializing certificate reloader. 2025.06.18 08:40:15.055655 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20961103_20961103_21_21_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.055726 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20961103_20961103_21_21_0 on disk default 2025.06.18 08:40:15.055744 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20120520_20120531_12_12_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.055751 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19970411_19970411_4_4_0 from disk default 2025.06.18 08:40:15.055814 [ 66711 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20120520_20120531_12_12_0 on disk default 2025.06.18 08:40:15.056165 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19740222_19740222_56_56_0 from disk default 2025.06.18 08:40:15.056303 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21480912_21480912_32_32_0 from disk default 2025.06.18 08:40:15.056393 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21480824_21480824_97_97_0 from disk default 2025.06.18 08:40:15.056600 [ 65992 ] {} AsynchronousMetrics: MemoryTracking: was 10.75 MiB, peak 10.75 MiB, free memory in arenas 0.00 B, will set to 1.53 GiB (RSS), difference: 1.52 GiB 2025.06.18 08:40:15.056662 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21251112_21251112_74_74_0 from disk default 2025.06.18 08:40:15.056720 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20080724_20080724_88_88_0 from disk default 2025.06.18 08:40:15.056811 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20760924_20760924_14_14_0 from disk default 2025.06.18 08:40:15.056432 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21071202_21071202_61_61_0 from disk default 2025.06.18 08:40:15.057003 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21220421_21220421_28_28_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.057069 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21220421_21220421_28_28_0 on disk default 2025.06.18 08:40:15.057089 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20830812_20830812_19_19_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.057185 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20830812_20830812_19_19_0 on disk default 2025.06.18 08:40:15.056913 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19940713_19940713_65_65_0 from disk default 2025.06.18 08:40:15.058087 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20310508_20310508_26_26_0 from disk default 2025.06.18 08:40:15.058087 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20080316_20080316_9_9_0 from disk default 2025.06.18 08:40:15.058123 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21350530_21350530_33_33_0 from disk default 2025.06.18 08:40:15.058137 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20830507_20830507_71_71_0 from disk default 2025.06.18 08:40:15.059751 [ 66730 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): Loading data parts 2025.06.18 08:40:15.059917 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21130612_21130612_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.060338 [ 65992 ] {} MemoryTracker: Current memory usage (total): 1.53 GiB. 2025.06.18 08:40:15.060518 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21130612_21130612_1_1_0 on disk default 2025.06.18 08:40:15.060536 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19970411_19970411_4_4_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.060624 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19970411_19970411_4_4_0 on disk default 2025.06.18 08:40:15.060890 [ 66685 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): loadDataPart: inserting all_50_93_2 (state Active) into data_parts_indexes 2025.06.18 08:40:15.060945 [ 66685 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Finished loading Active part all_50_93_2 on disk default 2025.06.18 08:40:15.062049 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20720102_20720102_30_30_0 from disk default 2025.06.18 08:40:15.063144 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21480824_21480824_97_97_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.063337 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21480824_21480824_97_97_0 on disk default 2025.06.18 08:40:15.063521 [ 66734 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.063612 [ 66734 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.064901 [ 66684 ] {} test_3.table_src (a07dd0c2-f85e-4ae1-9080-9c3b521a7002): Loading data parts 2025.06.18 08:40:15.065067 [ 66768 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): Loading Active part all_1_1_0 from disk s3_disk 2025.06.18 08:40:15.064844 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20080724_20080724_88_88_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.065169 [ 66684 ] {} test_3.table_src (a07dd0c2-f85e-4ae1-9080-9c3b521a7002): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.065242 [ 66684 ] {} test_3.table_src (a07dd0c2-f85e-4ae1-9080-9c3b521a7002): There are no data parts 2025.06.18 08:40:15.065358 [ 66718 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.066176 [ 66684 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.066191 [ 66718 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.066038 [ 66723 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20080724_20080724_88_88_0 on disk default 2025.06.18 08:40:15.066633 [ 66684 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.066395 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21031103_21031108_5_5_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.066782 [ 66684 ] {} DatabaseAtomic (test_3): Counting attached table table_src to database test_3 2025.06.18 08:40:15.066801 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21031103_21031108_5_5_0 on disk default 2025.06.18 08:40:15.066807 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20310508_20310508_26_26_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.066905 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_3.table_src' with status OK 2025.06.18 08:40:15.066908 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20310508_20310508_26_26_0 on disk default 2025.06.18 08:40:15.067048 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21480912_21480912_32_32_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.067045 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/fkm/wobumavxtgfoyfrftljxbyrtqlqmv (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/columns.txt) 2025.06.18 08:40:15.067123 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.ngrambf_tab' in BackgroundLoad 2025.06.18 08:40:15.067131 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21480912_21480912_32_32_0 on disk default 2025.06.18 08:40:15.067139 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20760924_20760924_14_14_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.067341 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20760924_20760924_14_14_0 on disk default 2025.06.18 08:40:15.067404 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20640814_20640814_7_7_0 from disk default 2025.06.18 08:40:15.067265 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.ngrambf_tab 2025.06.18 08:40:15.067683 [ 66769 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): loadDataPart: inserting all_0_49_3 (state Active) into data_parts_indexes 2025.06.18 08:40:15.067909 [ 66723 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Loading Active part all_0_0_0 from disk s3_disk 2025.06.18 08:40:15.068045 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20830507_20830507_71_71_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.068185 [ 66722 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.067915 [ 66769 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Finished loading Active part all_0_49_3 on disk default 2025.06.18 08:40:15.068515 [ 66722 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.068856 [ 66696 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Loaded data parts (3 items) 2025.06.18 08:40:15.068800 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20830507_20830507_71_71_0 on disk default 2025.06.18 08:40:15.069168 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20470620_20470620_41_41_0 from disk default 2025.06.18 08:40:15.069345 [ 66696 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.069424 [ 66769 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Loading Active part all_1_1_0_3 from disk s3_disk 2025.06.18 08:40:15.069341 [ 66730 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.069846 [ 66730 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.070038 [ 66711 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Loading Active part all_2_2_0_3 from disk s3_disk 2025.06.18 08:40:15.070170 [ 66696 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.070230 [ 66696 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.070284 [ 66696 ] {} DatabaseAtomic (test_1): Counting attached table data_r1 to database test_1 2025.06.18 08:40:15.070423 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19740222_19740222_56_56_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.070639 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_1.data_r1' with status OK 2025.06.18 08:40:15.070415 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20990408_20990408_11_11_0 from disk default 2025.06.18 08:40:15.070747 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_3.test_b' in BackgroundLoad 2025.06.18 08:40:15.070783 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19740222_19740222_56_56_0 on disk default 2025.06.18 08:40:15.070805 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kaf/gjnpyvwkdjcrafqqzsohnqvvnzule (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/columns.txt) 2025.06.18 08:40:15.070849 [ 66696 ] {} DatabaseAtomic (test_3): Loading table test_3.test_b 2025.06.18 08:40:15.070882 [ 66729 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Loading data parts 2025.06.18 08:40:15.071205 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/columns.txt) 2025.06.18 08:40:15.070793 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21350530_21350530_33_33_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.071300 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:15.071348 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21350530_21350530_33_33_0 on disk default 2025.06.18 08:40:15.071447 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20080316_20080316_9_9_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.071308 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Reset state for seek to position 0 2025.06.18 08:40:15.071773 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20640814_20640814_7_7_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.071833 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20640814_20640814_7_7_0 on disk default 2025.06.18 08:40:15.072395 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20080316_20080316_9_9_0 on disk default 2025.06.18 08:40:15.072415 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.072412 [ 66765 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.072460 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19830310_19830310_52_52_0 from disk default 2025.06.18 08:40:15.072496 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20720102_20720102_30_30_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.072555 [ 66723 ] {} FileSegment(629f0fbdf4a60b326229d1e4f55b7d2c) : [0, 46]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.072630 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20720102_20720102_30_30_0 on disk default 2025.06.18 08:40:15.072742 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20241216_20241216_25_25_0 from disk default 2025.06.18 08:40:15.072749 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 629f0fbdf4a60b326229d1e4f55b7d2c, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.072771 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21071202_21071202_61_61_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.072811 [ 66729 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.072854 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20991124_20991124_86_86_0 from disk default 2025.06.18 08:40:15.072874 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21071202_21071202_61_61_0 on disk default 2025.06.18 08:40:15.072944 [ 66729 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.072965 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.072919 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 629f0fbdf4a60b326229d1e4f55b7d2c, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.073045 [ 66711 ] {} FileSegment(d4577545012ce613fa1602212590f556) : [0, 66]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.073081 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20441016_20441016_47_47_0 from disk default 2025.06.18 08:40:15.073125 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21251112_21251112_74_74_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.073175 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.073196 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kaf/gjnpyvwkdjcrafqqzsohnqvvnzule, Version: Latest, Range: 0-46 2025.06.18 08:40:15.073218 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20930830_20930830_67_67_0 from disk default 2025.06.18 08:40:15.073254 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21251112_21251112_74_74_0 on disk default 2025.06.18 08:40:15.073330 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20790411_20790411_96_96_0 from disk default 2025.06.18 08:40:15.073550 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.073613 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20411120_20411120_89_89_0 from disk default 2025.06.18 08:40:15.073471 [ 66776 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20850407_20850407_29_29_0 from disk default 2025.06.18 08:40:15.073610 [ 66778 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21350822_21350822_31_31_0 from disk default 2025.06.18 08:40:15.073509 [ 66779 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Loading Active part all_0_0_0_18 from disk default 2025.06.18 08:40:15.073941 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20880917_20880917_60_60_0 from disk default 2025.06.18 08:40:15.073979 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19940713_19940713_65_65_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.074114 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/columns.txt) 2025.06.18 08:40:15.074060 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19940713_19940713_65_65_0 on disk default 2025.06.18 08:40:15.074262 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20470620_20470620_41_41_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.073746 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi, Version: Latest, Range: 0-66 2025.06.18 08:40:15.074366 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20470620_20470620_41_41_0 on disk default 2025.06.18 08:40:15.074458 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20851231_20851231_70_70_0 from disk default 2025.06.18 08:40:15.074683 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20990408_20990408_11_11_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.074760 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:15.074776 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20990408_20990408_11_11_0 on disk default 2025.06.18 08:40:15.074497 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21410808_21410809_2_2_0 from disk default 2025.06.18 08:40:15.075399 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19760607_19760607_18_18_0 from disk default 2025.06.18 08:40:15.075661 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.075688 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21010704_21010704_59_59_0 from disk default 2025.06.18 08:40:15.075696 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20040204_20040204_58_58_0 from disk default 2025.06.18 08:40:15.075892 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20251024_20251024_66_66_0 from disk default 2025.06.18 08:40:15.075711 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19830621_19830621_80_80_0 from disk default 2025.06.18 08:40:15.076374 [ 66769 ] {} FileSegment(5355cd98919a2b306d501e636785db15) : [0, 66]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.076814 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.077133 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.077104 [ 66777 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20661119_20661119_6_6_0 from disk default 2025.06.18 08:40:15.077941 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf, Version: Latest, Range: 0-66 2025.06.18 08:40:15.079296 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20930830_20930830_67_67_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.079479 [ 66684 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): Loading data parts 2025.06.18 08:40:15.079607 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20700810_20700810_87_87_0 from disk default 2025.06.18 08:40:15.079467 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gtw/jzjwvtrwugumadottmlvpiwfpjrct (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/serialization.json) 2025.06.18 08:40:15.079896 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20930830_20930830_67_67_0 on disk default 2025.06.18 08:40:15.080454 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19830310_19830310_52_52_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.080480 [ 66741 ] {} test.`.inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b` (ff21631d-7b1d-4c5d-87ae-4cbd5ed78507): Loading data parts 2025.06.18 08:40:15.080561 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19830310_19830310_52_52_0 on disk default 2025.06.18 08:40:15.080884 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20991124_20991124_86_86_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.080987 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20991124_20991124_86_86_0 on disk default 2025.06.18 08:40:15.081022 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20241216_20241216_25_25_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.081103 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20241216_20241216_25_25_0 on disk default 2025.06.18 08:40:15.081127 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20790411_20790411_96_96_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.081211 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20790411_20790411_96_96_0 on disk default 2025.06.18 08:40:15.081511 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20441016_20441016_47_47_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.081633 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20441016_20441016_47_47_0 on disk default 2025.06.18 08:40:15.081684 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20411120_20411120_89_89_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.081752 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20411120_20411120_89_89_0 on disk default 2025.06.18 08:40:15.081928 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19830621_19830621_80_80_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.082005 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19830621_19830621_80_80_0 on disk default 2025.06.18 08:40:15.082028 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21010704_21010704_59_59_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.082106 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21010704_21010704_59_59_0 on disk default 2025.06.18 08:40:15.082146 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20880917_20880917_60_60_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.082237 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20880917_20880917_60_60_0 on disk default 2025.06.18 08:40:15.082255 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19760607_19760607_18_18_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.082316 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19760607_19760607_18_18_0 on disk default 2025.06.18 08:40:15.083302 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20851231_20851231_70_70_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.083361 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20851231_20851231_70_70_0 on disk default 2025.06.18 08:40:15.083642 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20040204_20040204_58_58_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.083708 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20040204_20040204_58_58_0 on disk default 2025.06.18 08:40:15.084126 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19910202_19910202_17_17_0 from disk default 2025.06.18 08:40:15.084748 [ 66741 ] {} test.`.inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b` (ff21631d-7b1d-4c5d-87ae-4cbd5ed78507): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.084793 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21141116_21141116_81_81_0 from disk default 2025.06.18 08:40:15.084833 [ 66741 ] {} test.`.inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b` (ff21631d-7b1d-4c5d-87ae-4cbd5ed78507): There are no data parts 2025.06.18 08:40:15.084988 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21440116_21440116_64_64_0 from disk default 2025.06.18 08:40:15.085056 [ 66780 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20940519_20940519_85_85_0 from disk default 2025.06.18 08:40:15.085227 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20700810_20700810_87_87_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.085255 [ 66781 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20630421_20630421_53_53_0 from disk default 2025.06.18 08:40:15.085518 [ 66741 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.085437 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Read 47 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.085557 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20700810_20700810_87_87_0 on disk default 2025.06.18 08:40:15.085521 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20700213_20700213_77_77_0 from disk default 2025.06.18 08:40:15.085591 [ 66741 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.085971 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.085980 [ 66684 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.086012 [ 66741 ] {} DatabaseAtomic (test): Counting attached table .inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b to database test 2025.06.18 08:40:15.085933 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (47 bytes) for 629f0fbdf4a60b326229d1e4f55b7d2c:0, current usage: size: 2/104857600, elements: 2/10000000 (description: s3_cache) 2025.06.18 08:40:15.086082 [ 66684 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.086359 [ 66741 ] {} AsyncLoader: Finish load job 'load table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b' with status OK 2025.06.18 08:40:15.086490 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 47, current is 2 2025.06.18 08:40:15.086550 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_3.r_prop_table2' in BackgroundLoad 2025.06.18 08:40:15.086627 [ 66741 ] {} DatabaseAtomic (test_3): Loading table test_3.r_prop_table2 2025.06.18 08:40:15.086833 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19710106_19710106_42_42_0 from disk default 2025.06.18 08:40:15.086912 [ 66737 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.086909 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 629f0fbdf4a60b326229d1e4f55b7d2c, offset: 0, size: 47 2025.06.18 08:40:15.086959 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21400124_21400124_39_39_0 from disk default 2025.06.18 08:40:15.087006 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20400118_20400118_35_35_0 from disk default 2025.06.18 08:40:15.087306 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (67 bytes) for d4577545012ce613fa1602212590f556:0, current usage: size: 49/104857600, elements: 3/10000000 (description: s3_cache) 2025.06.18 08:40:15.087393 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21360413_21360413_34_34_0 from disk default 2025.06.18 08:40:15.087510 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 67, current is 49 2025.06.18 08:40:15.087575 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: d4577545012ce613fa1602212590f556, offset: 0, size: 67 2025.06.18 08:40:15.087864 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21210225_21210225_79_79_0 from disk default 2025.06.18 08:40:15.087959 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Successfully written 47 bytes 2025.06.18 08:40:15.088013 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Successfully written 67 bytes 2025.06.18 08:40:15.087703 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20000815_20000815_75_75_0 from disk default 2025.06.18 08:40:15.088173 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.088386 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19840611_19840611_94_94_0 from disk default 2025.06.18 08:40:15.088419 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.088551 [ 66723 ] {} FileSegment(629f0fbdf4a60b326229d1e4f55b7d2c) : [0, 46]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.088588 [ 66778 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21350822_21350822_31_31_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.088849 [ 66778 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21350822_21350822_31_31_0 on disk default 2025.06.18 08:40:15.088768 [ 66723 ] {} FileSegment(629f0fbdf4a60b326229d1e4f55b7d2c) : [0, 46]: Complete batch. (File segment: [0, 46], key: 629f0fbdf4a60b326229d1e4f55b7d2c, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.088199 [ 66782 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19900324_19900324_83_83_0 from disk default 2025.06.18 08:40:15.089164 [ 66723 ] {} CachedOnDiskReadBufferFromFile(629f0fbdf4a60b326229d1e4f55b7d2c): Key: 629f0fbdf4a60b326229d1e4f55b7d2c. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.089362 [ 66711 ] {} FileSegment(d4577545012ce613fa1602212590f556) : [0, 66]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.088766 [ 66783 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20941218_20941218_37_37_0 from disk default 2025.06.18 08:40:15.089865 [ 66711 ] {} FileSegment(d4577545012ce613fa1602212590f556) : [0, 66]: Complete batch. (File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.089030 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20680927_20680927_22_22_0 from disk default 2025.06.18 08:40:15.090611 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/abu/zkckixjkhuminuzcppeyryoxcrryz (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/serialization.json) 2025.06.18 08:40:15.090697 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.090979 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19730731_19730731_20_20_0 from disk default 2025.06.18 08:40:15.091281 [ 66711 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.091707 [ 66778 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20580111_20580111_69_69_0 from disk default 2025.06.18 08:40:15.092244 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (67 bytes) for 5355cd98919a2b306d501e636785db15:0, current usage: size: 116/104857600, elements: 4/10000000 (description: s3_cache) 2025.06.18 08:40:15.092072 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Reset state for seek to position 0 2025.06.18 08:40:15.126601 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21141116_21141116_81_81_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.125313 [ 66765 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.127589 [ 66785 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 21360302_21360302_48_48_0 from disk default 2025.06.18 08:40:15.128374 [ 66691 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21141116_21141116_81_81_0 on disk default 2025.06.18 08:40:15.128738 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Having 1 file segments to read: [0, 84], current read range: [0, 85) 2025.06.18 08:40:15.128795 [ 66765 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.125527 [ 66784 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20490108_20490108_24_24_0 from disk default 2025.06.18 08:40:15.129574 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 67, current is 116 2025.06.18 08:40:15.129659 [ 66723 ] {} FileSegment(4dbbe4bd751f8e75463d3e77bc30bc66) : [0, 84]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.129786 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 5355cd98919a2b306d501e636785db15, offset: 0, size: 67 2025.06.18 08:40:15.129399 [ 66776 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20850407_20850407_29_29_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.130633 [ 66737 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.131179 [ 66776 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20850407_20850407_29_29_0 on disk default 2025.06.18 08:40:15.131247 [ 66737 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.132320 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Successfully written 67 bytes 2025.06.18 08:40:15.132313 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 84], key: 4dbbe4bd751f8e75463d3e77bc30bc66, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.131628 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20700213_20700213_77_77_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.132357 [ 66730 ] {} test_1.LOG_T (cb7bb97d-a4d4-41a4-9fc4-7c0de66afda9): Loaded data parts (1 items) 2025.06.18 08:40:15.132422 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.133146 [ 66769 ] {} FileSegment(5355cd98919a2b306d501e636785db15) : [0, 66]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.133246 [ 66772 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20700213_20700213_77_77_0 on disk default 2025.06.18 08:40:15.133414 [ 66779 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): loadDataPart: inserting all_0_0_0_18 (state Active) into data_parts_indexes 2025.06.18 08:40:15.133496 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21210225_21210225_79_79_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.133580 [ 66779 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Finished loading Active part all_0_0_0_18 on disk default 2025.06.18 08:40:15.133617 [ 66685 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21210225_21210225_79_79_0 on disk default 2025.06.18 08:40:15.133703 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20000815_20000815_75_75_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.133842 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/serialization.json) 2025.06.18 08:40:15.133963 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 84], key: 4dbbe4bd751f8e75463d3e77bc30bc66, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.134323 [ 66688 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20000815_20000815_75_75_0 on disk default 2025.06.18 08:40:15.133457 [ 66769 ] {} FileSegment(5355cd98919a2b306d501e636785db15) : [0, 66]: Complete batch. (File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.134412 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19910202_19910202_17_17_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.134502 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.134515 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:15.134704 [ 66684 ] {} test_1.ngrambf_tab (1005a0da-830f-467a-b033-50dde2db901e): Loaded data parts (1 items) 2025.06.18 08:40:15.134717 [ 66729 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Loaded data parts (1 items) 2025.06.18 08:40:15.134508 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/abu/zkckixjkhuminuzcppeyryoxcrryz, Version: Latest, Range: 0-84 2025.06.18 08:40:15.135169 [ 66775 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19910202_19910202_17_17_0 on disk default 2025.06.18 08:40:15.135180 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19710106_19710106_42_42_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.135495 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20860313_20860313_78_78_0 from disk default 2025.06.18 08:40:15.135260 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.135425 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwr/keykswsemgxqnjeozrlvxhsdofwjm (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/metadata_version.txt) 2025.06.18 08:40:15.135738 [ 66687 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19710106_19710106_42_42_0 on disk default 2025.06.18 08:40:15.135761 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20550326_20550326_57_57_0 from disk default 2025.06.18 08:40:15.135751 [ 66786 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 19861010_19861010_51_51_0 from disk default 2025.06.18 08:40:15.135664 [ 66711 ] {} FileSegment(010668954635108bb41ac4d25be76a56) : [0, 204]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.135822 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21360413_21360413_34_34_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.136040 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.136126 [ 66779 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loading Active part 20130517_20130517_45_45_0 from disk default 2025.06.18 08:40:15.136176 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.136238 [ 66729 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.136597 [ 66763 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21360413_21360413_34_34_0 on disk default 2025.06.18 08:40:15.136850 [ 66781 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20630421_20630421_53_53_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.137102 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli, Version: Latest, Range: 0-204 2025.06.18 08:40:15.137173 [ 66781 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20630421_20630421_53_53_0 on disk default 2025.06.18 08:40:15.137320 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21400124_21400124_39_39_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.137529 [ 66780 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20940519_20940519_85_85_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.137849 [ 66780 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20940519_20940519_85_85_0 on disk default 2025.06.18 08:40:15.137943 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20400118_20400118_35_35_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.138052 [ 66750 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21400124_21400124_39_39_0 on disk default 2025.06.18 08:40:15.138076 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.138312 [ 66767 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20400118_20400118_35_35_0 on disk default 2025.06.18 08:40:15.138618 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.138667 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20251024_20251024_66_66_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.138844 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/serialization.json) 2025.06.18 08:40:15.138882 [ 66771 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20251024_20251024_66_66_0 on disk default 2025.06.18 08:40:15.138942 [ 66778 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20580111_20580111_69_69_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.139034 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table LOG_T to database test_1 2025.06.18 08:40:15.139065 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:15.139178 [ 66778 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20580111_20580111_69_69_0 on disk default 2025.06.18 08:40:15.139271 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.139361 [ 66769 ] {} FileSegment(fbfa7751fe0b3c92650a6e326bf525b6) : [0, 204]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.139383 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.139499 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.139568 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20550326_20550326_57_57_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.139649 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.139662 [ 66737 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20550326_20550326_57_57_0 on disk default 2025.06.18 08:40:15.139771 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj, Version: Latest, Range: 0-204 2025.06.18 08:40:15.139781 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.139835 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21410808_21410809_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.139979 [ 66764 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21410808_21410809_2_2_0 on disk default 2025.06.18 08:40:15.140013 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table ngrambf_tab to database test_1 2025.06.18 08:40:15.140198 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.140273 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.140326 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21440116_21440116_64_64_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.140573 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table concurrent_kill_2 to database test_1 2025.06.18 08:40:15.140586 [ 66728 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21440116_21440116_64_64_0 on disk default 2025.06.18 08:40:15.140593 [ 66782 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19900324_19900324_83_83_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.140702 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.LOG_T' with status OK 2025.06.18 08:40:15.140716 [ 66782 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19900324_19900324_83_83_0 on disk default 2025.06.18 08:40:15.140770 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19730731_19730731_20_20_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.140877 [ 66770 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19730731_19730731_20_20_0 on disk default 2025.06.18 08:40:15.144178 [ 66777 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20661119_20661119_6_6_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.144290 [ 66777 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20661119_20661119_6_6_0 on disk default 2025.06.18 08:40:15.144408 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19840611_19840611_94_94_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.144477 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_3.userid_set' in BackgroundLoad 2025.06.18 08:40:15.144587 [ 66690 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19840611_19840611_94_94_0 on disk default 2025.06.18 08:40:15.144734 [ 66730 ] {} DatabaseAtomic (test_3): Loading table test_3.userid_set 2025.06.18 08:40:15.144804 [ 66783 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20941218_20941218_37_37_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.144946 [ 66783 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20941218_20941218_37_37_0 on disk default 2025.06.18 08:40:15.144957 [ 66784 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20490108_20490108_24_24_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.145070 [ 66784 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20490108_20490108_24_24_0 on disk default 2025.06.18 08:40:15.145105 [ 66786 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 19861010_19861010_51_51_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.145161 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.ngrambf_tab' with status OK 2025.06.18 08:40:15.145207 [ 66786 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 19861010_19861010_51_51_0 on disk default 2025.06.18 08:40:15.145269 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20680927_20680927_22_22_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.145414 [ 66766 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20680927_20680927_22_22_0 on disk default 2025.06.18 08:40:15.145425 [ 66785 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 21360302_21360302_48_48_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.145471 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.with_fill_date' in BackgroundLoad 2025.06.18 08:40:15.145527 [ 66785 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 21360302_21360302_48_48_0 on disk default 2025.06.18 08:40:15.145629 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.with_fill_date 2025.06.18 08:40:15.145669 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20860313_20860313_78_78_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.145808 [ 66765 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20860313_20860313_78_78_0 on disk default 2025.06.18 08:40:15.145962 [ 66779 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): loadDataPart: inserting 20130517_20130517_45_45_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.146032 [ 66779 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Finished loading Active part 20130517_20130517_45_45_0 on disk default 2025.06.18 08:40:15.146220 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.146284 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.146731 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table with_fill_date to database test_1 2025.06.18 08:40:15.146930 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.concurrent_kill_2' with status OK 2025.06.18 08:40:15.147203 [ 66729 ] {} AsyncLoader: Execute load job 'load table test.hits_snippet' in BackgroundLoad 2025.06.18 08:40:15.147304 [ 66729 ] {} DatabaseAtomic (test): Loading table test.hits_snippet 2025.06.18 08:40:15.147388 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.with_fill_date' with status OK 2025.06.18 08:40:15.147604 [ 66730 ] {} StorageSetOrJoinBase: Loaded from backup file store/3ea/3ea3ff04-93c4-49ab-b56d-a796fc03576e/1.bin. 4 rows, 84.00 B. State has 4 unique rows. 2025.06.18 08:40:15.147652 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.test_table' in BackgroundLoad 2025.06.18 08:40:15.147736 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.test_table 2025.06.18 08:40:15.147781 [ 66730 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.147841 [ 66730 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.148053 [ 66730 ] {} DatabaseAtomic (test_3): Counting attached table userid_set to database test_3 2025.06.18 08:40:15.148215 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_3.userid_set' with status OK 2025.06.18 08:40:15.148436 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd' in BackgroundLoad 2025.06.18 08:40:15.148526 [ 66730 ] {} DatabaseReplicated (test_1_db): Loading table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd 2025.06.18 08:40:15.149085 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Read 85 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 85/85, impl position: 0, segment: [0, 84] 2025.06.18 08:40:15.149101 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.149159 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.149291 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/bvc/tztogkysvzzokuzwspvmvpjleqftl (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/checksums.txt) 2025.06.18 08:40:15.149324 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (85 bytes) for 4dbbe4bd751f8e75463d3e77bc30bc66:0, current usage: size: 183/104857600, elements: 5/10000000 (description: s3_cache) 2025.06.18 08:40:15.149572 [ 66735 ] {} test_1.mass_table_117 (81cb9153-cf8f-4884-97b2-207306b020ad): Loaded data parts (97 items) 2025.06.18 08:40:15.149609 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 85, current is 183 2025.06.18 08:40:15.149769 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 4dbbe4bd751f8e75463d3e77bc30bc66, offset: 0, size: 85 2025.06.18 08:40:15.149930 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (205 bytes) for fbfa7751fe0b3c92650a6e326bf525b6:0, current usage: size: 268/104857600, elements: 6/10000000 (description: s3_cache) 2025.06.18 08:40:15.150067 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Successfully written 85 bytes 2025.06.18 08:40:15.150143 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Remaining size to read: 85, read: 85. Resizing buffer to 85 2025.06.18 08:40:15.150190 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 205, current is 268 2025.06.18 08:40:15.150267 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: fbfa7751fe0b3c92650a6e326bf525b6, offset: 0, size: 205 2025.06.18 08:40:15.150287 [ 66723 ] {} FileSegment(4dbbe4bd751f8e75463d3e77bc30bc66) : [0, 84]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.150402 [ 66723 ] {} FileSegment(4dbbe4bd751f8e75463d3e77bc30bc66) : [0, 84]: Complete batch. (File segment: [0, 84], key: 4dbbe4bd751f8e75463d3e77bc30bc66, state: DOWNLOADED, downloaded size: 85, reserved size: 85, downloader id: None, current write offset: 85, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.150400 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (205 bytes) for 010668954635108bb41ac4d25be76a56:0, current usage: size: 473/104857600, elements: 7/10000000 (description: s3_cache) 2025.06.18 08:40:15.150467 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Successfully written 205 bytes 2025.06.18 08:40:15.150525 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.150566 [ 66723 ] {} CachedOnDiskReadBufferFromFile(4dbbe4bd751f8e75463d3e77bc30bc66): Key: 4dbbe4bd751f8e75463d3e77bc30bc66. Returning with 85 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 85, current range: [0, 84], file offset of buffer end: 85, file segment state: DOWNLOADED, current write offset: 85, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 85, started with offset: 0, remaining ranges: [0, 84] 2025.06.18 08:40:15.150644 [ 66769 ] {} FileSegment(fbfa7751fe0b3c92650a6e326bf525b6) : [0, 204]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.150711 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 205, current is 473 2025.06.18 08:40:15.150728 [ 66769 ] {} FileSegment(fbfa7751fe0b3c92650a6e326bf525b6) : [0, 204]: Complete batch. (File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.150810 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 010668954635108bb41ac4d25be76a56, offset: 0, size: 205 2025.06.18 08:40:15.150877 [ 66769 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.150990 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Successfully written 205 bytes 2025.06.18 08:40:15.151041 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.151121 [ 66711 ] {} FileSegment(010668954635108bb41ac4d25be76a56) : [0, 204]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.151185 [ 66711 ] {} FileSegment(010668954635108bb41ac4d25be76a56) : [0, 204]: Complete batch. (File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.151269 [ 66711 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.151428 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/fmy/dqgplrteojtchrtncygjjywzagxef (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/metadata_version.txt) 2025.06.18 08:40:15.151557 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Reset state for seek to position 0 2025.06.18 08:40:15.151617 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:15.151752 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.151756 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:15.151844 [ 66723 ] {} FileSegment(e681c0b4922e3560aee0a7fad95fc2c5) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.151884 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:15.151930 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.151960 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:15.152007 [ 66769 ] {} FileSegment(5cd413ef3fae0cd351cae018c6e7feb5) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.151995 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: e681c0b4922e3560aee0a7fad95fc2c5, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.152106 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.152164 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.152170 [ 66711 ] {} FileSegment(ccedd24c74b3a8c6391fb6094032c53b) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.152220 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: e681c0b4922e3560aee0a7fad95fc2c5, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.152289 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.152312 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.152327 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/fmy/dqgplrteojtchrtncygjjywzagxef, Version: Latest, Range: 0-0 2025.06.18 08:40:15.152380 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd, Version: Latest, Range: 0-0 2025.06.18 08:40:15.152414 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.152495 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg, Version: Latest, Range: 0-0 2025.06.18 08:40:15.152903 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/aeq/irfflybobcgjtjhklhxzylwpqdacm (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/data.cmrk3) 2025.06.18 08:40:15.152951 [ 66741 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Loading data parts 2025.06.18 08:40:15.153470 [ 66741 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.153589 [ 66741 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.153839 [ 66776 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Loading Active part all_0_2_1 from disk default 2025.06.18 08:40:15.153873 [ 66735 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.153956 [ 66735 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.154039 [ 66735 ] {} DatabaseAtomic (test_1): Counting attached table mass_table_117 to database test_1 2025.06.18 08:40:15.154634 [ 66735 ] {} AsyncLoader: Finish load job 'load table test_1.mass_table_117' with status OK 2025.06.18 08:40:15.154806 [ 66730 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): Loading data parts 2025.06.18 08:40:15.154872 [ 66735 ] {} AsyncLoader: Execute load job 'load table test_v4ezwkrr.mv' in BackgroundLoad 2025.06.18 08:40:15.154990 [ 66735 ] {} DatabaseAtomic (test_v4ezwkrr): Loading table test_v4ezwkrr.mv 2025.06.18 08:40:15.155172 [ 66730 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.155243 [ 66730 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.155363 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.155440 [ 66685 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.155460 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.155500 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.155498 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for ccedd24c74b3a8c6391fb6094032c53b:0, current usage: size: 678/104857600, elements: 8/10000000 (description: s3_cache) 2025.06.18 08:40:15.155676 [ 66684 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): Loading data parts 2025.06.18 08:40:15.155831 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 678 2025.06.18 08:40:15.155902 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: ccedd24c74b3a8c6391fb6094032c53b, offset: 0, size: 1 2025.06.18 08:40:15.155916 [ 66735 ] {} DatabaseAtomic (test_v4ezwkrr): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.155974 [ 66735 ] {} DatabaseAtomic (test_v4ezwkrr): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.156015 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for 5cd413ef3fae0cd351cae018c6e7feb5:0, current usage: size: 679/104857600, elements: 9/10000000 (description: s3_cache) 2025.06.18 08:40:15.156063 [ 66735 ] {} DatabaseAtomic (test_v4ezwkrr): Counting attached table mv to database test_v4ezwkrr 2025.06.18 08:40:15.156083 [ 66684 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.156104 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Successfully written 1 bytes 2025.06.18 08:40:15.156165 [ 66684 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.156170 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.156233 [ 66735 ] {} AsyncLoader: Finish load job 'load table test_v4ezwkrr.mv' with status OK 2025.06.18 08:40:15.156243 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 679 2025.06.18 08:40:15.156303 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 5cd413ef3fae0cd351cae018c6e7feb5, offset: 0, size: 1 2025.06.18 08:40:15.156325 [ 66711 ] {} FileSegment(ccedd24c74b3a8c6391fb6094032c53b) : [0, 0]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.156332 [ 66688 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.156419 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for e681c0b4922e3560aee0a7fad95fc2c5:0, current usage: size: 680/104857600, elements: 10/10000000 (description: s3_cache) 2025.06.18 08:40:15.156434 [ 66735 ] {} AsyncLoader: Execute load job 'load table test_1.regexp_dict2' in BackgroundLoad 2025.06.18 08:40:15.156438 [ 66711 ] {} FileSegment(ccedd24c74b3a8c6391fb6094032c53b) : [0, 0]: Complete batch. (File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.156511 [ 66735 ] {} DatabaseAtomic (test_1): Loading table test_1.regexp_dict2 2025.06.18 08:40:15.156513 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Successfully written 1 bytes 2025.06.18 08:40:15.156563 [ 66711 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.156616 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 680 2025.06.18 08:40:15.156631 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.156633 [ 66776 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): loadDataPart: inserting all_0_2_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.156682 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: e681c0b4922e3560aee0a7fad95fc2c5, offset: 0, size: 1 2025.06.18 08:40:15.156749 [ 66769 ] {} FileSegment(5cd413ef3fae0cd351cae018c6e7feb5) : [0, 0]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.156757 [ 66776 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Finished loading Active part all_0_2_1 on disk default 2025.06.18 08:40:15.156770 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vbc/rinqyiupuygnbevwmvhyooqqgjndj (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/count.txt) 2025.06.18 08:40:15.156866 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Successfully written 1 bytes 2025.06.18 08:40:15.156885 [ 66741 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Loaded data parts (1 items) 2025.06.18 08:40:15.156913 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.156820 [ 66769 ] {} FileSegment(5cd413ef3fae0cd351cae018c6e7feb5) : [0, 0]: Complete batch. (File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.157005 [ 66723 ] {} FileSegment(e681c0b4922e3560aee0a7fad95fc2c5) : [0, 0]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.157013 [ 66741 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.157045 [ 66769 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.157072 [ 66723 ] {} FileSegment(e681c0b4922e3560aee0a7fad95fc2c5) : [0, 0]: Complete batch. (File segment: [0, 0], key: e681c0b4922e3560aee0a7fad95fc2c5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.157152 [ 66723 ] {} CachedOnDiskReadBufferFromFile(e681c0b4922e3560aee0a7fad95fc2c5): Key: e681c0b4922e3560aee0a7fad95fc2c5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.157313 [ 65992 ] {} AsynchronousMetrics: Update heavy metrics. Update period 1 sec. Update heavy metrics period 120 sec. Heavy metrics calculation elapsed: 0.024219825 sec. 2025.06.18 08:40:15.157497 [ 66741 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.157492 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/checksums.txt) 2025.06.18 08:40:15.157589 [ 66741 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.157689 [ 66741 ] {} DatabaseAtomic (test_3): Counting attached table r_prop_table2 to database test_3 2025.06.18 08:40:15.157711 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:15.157749 [ 66685 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.157831 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/checksums.txt) 2025.06.18 08:40:15.157855 [ 66685 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.157848 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.157867 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kbe/csgbmojzjgpdkwcgprfhvgduvmzra (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/checksums.txt) 2025.06.18 08:40:15.157963 [ 66711 ] {} FileSegment(0892477eba8f8adf41e91d6781ca5ecb) : [0, 275]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.157972 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:15.157992 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_3.r_prop_table2' with status OK 2025.06.18 08:40:15.158009 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Reset state for seek to position 0 2025.06.18 08:40:15.158063 [ 66730 ] {} test_1_db.`.inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd` (c08457c0-693d-4cad-93ba-b3fe7012ed70): Loaded data parts (1 items) 2025.06.18 08:40:15.158087 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.158151 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.158214 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Having 1 file segments to read: [0, 209], current read range: [0, 210) 2025.06.18 08:40:15.158231 [ 66769 ] {} FileSegment(0e1651943582be3521d041ee1c35f583) : [0, 275]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.158218 [ 66688 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.158211 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.158309 [ 66688 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.158287 [ 66723 ] {} FileSegment(d67bdd7466bb2b3694a67107e8e0e79f) : [0, 209]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.158346 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.158372 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz, Version: Latest, Range: 0-275 2025.06.18 08:40:15.158224 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_1.defaults' in BackgroundLoad 2025.06.18 08:40:15.158432 [ 66684 ] {} test_1.test_table (93bf661f-87b4-4bcc-b58d-f785d94b46c9): Loaded data parts (1 items) 2025.06.18 08:40:15.158458 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 209], key: d67bdd7466bb2b3694a67107e8e0e79f, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.158487 [ 66730 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.158513 [ 66741 ] {} DatabaseAtomic (test_1): Loading table test_1.defaults 2025.06.18 08:40:15.158491 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.158573 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 209], key: d67bdd7466bb2b3694a67107e8e0e79f, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.158583 [ 66730 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.158641 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh, Version: Latest, Range: 0-275 2025.06.18 08:40:15.158651 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kbe/csgbmojzjgpdkwcgprfhvgduvmzra, Version: Latest, Range: 0-209 2025.06.18 08:40:15.158706 [ 66730 ] {} DatabaseReplicated (test_1_db): Counting attached table .inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd to database test_1_db 2025.06.18 08:40:15.158835 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.158891 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.158895 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd' with status OK 2025.06.18 08:40:15.159030 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table test_table to database test_1 2025.06.18 08:40:15.159121 [ 66741 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.159128 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.test_move_partition_src' in BackgroundLoad 2025.06.18 08:40:15.159182 [ 66741 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.159262 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.test_move_partition_src 2025.06.18 08:40:15.159275 [ 66741 ] {} DatabaseAtomic (test_1): Counting attached table defaults to database test_1 2025.06.18 08:40:15.159351 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.test_table' with status OK 2025.06.18 08:40:15.159473 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_15.distinct_in_order' in BackgroundLoad 2025.06.18 08:40:15.159569 [ 66684 ] {} DatabaseAtomic (test_15): Loading table test_15.distinct_in_order 2025.06.18 08:40:15.159630 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_1.defaults' with status OK 2025.06.18 08:40:15.159805 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_3.test1' in BackgroundLoad 2025.06.18 08:40:15.159900 [ 66741 ] {} DatabaseAtomic (test_3): Loading table test_3.test1 2025.06.18 08:40:15.160165 [ 66741 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.160209 [ 66741 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.160251 [ 66741 ] {} DatabaseAtomic (test_3): Counting attached table test1 to database test_3 2025.06.18 08:40:15.160345 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_3.test1' with status OK 2025.06.18 08:40:15.160463 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_v4ezwkrr.null' in BackgroundLoad 2025.06.18 08:40:15.160711 [ 66741 ] {} DatabaseAtomic (test_v4ezwkrr): Loading table test_v4ezwkrr.null 2025.06.18 08:40:15.160761 [ 65992 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/decimals_dictionary.xml'. 2025.06.18 08:40:15.160898 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.160865 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Read 210 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 210/210, impl position: 0, segment: [0, 209] 2025.06.18 08:40:15.161025 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (276 bytes) for 0892477eba8f8adf41e91d6781ca5ecb:0, current usage: size: 681/104857600, elements: 11/10000000 (description: s3_cache) 2025.06.18 08:40:15.161048 [ 66741 ] {} DatabaseAtomic (test_v4ezwkrr): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.161105 [ 66741 ] {} DatabaseAtomic (test_v4ezwkrr): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.161185 [ 66741 ] {} DatabaseAtomic (test_v4ezwkrr): Counting attached table null to database test_v4ezwkrr 2025.06.18 08:40:15.161210 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 276, current is 681 2025.06.18 08:40:15.161272 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 0892477eba8f8adf41e91d6781ca5ecb, offset: 0, size: 276 2025.06.18 08:40:15.161292 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.161321 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_v4ezwkrr.null' with status OK 2025.06.18 08:40:15.161641 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (210 bytes) for d67bdd7466bb2b3694a67107e8e0e79f:0, current usage: size: 957/104857600, elements: 12/10000000 (description: s3_cache) 2025.06.18 08:40:15.161658 [ 66768 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/feh/fpwlnzpuzlbfrpquzkesgogycslbx (store/9cd/9cd6b815-cfe8-467a-b895-fef7d7f642d8/all_1_1_0/default_compression_codec.txt) 2025.06.18 08:40:15.161739 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Successfully written 276 bytes 2025.06.18 08:40:15.161798 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.161843 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 210, current is 957 2025.06.18 08:40:15.161903 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: d67bdd7466bb2b3694a67107e8e0e79f, offset: 0, size: 210 2025.06.18 08:40:15.161926 [ 66711 ] {} FileSegment(0892477eba8f8adf41e91d6781ca5ecb) : [0, 275]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.162001 [ 66711 ] {} FileSegment(0892477eba8f8adf41e91d6781ca5ecb) : [0, 275]: Complete batch. (File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.162007 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (276 bytes) for 0e1651943582be3521d041ee1c35f583:0, current usage: size: 1167/104857600, elements: 13/10000000 (description: s3_cache) 2025.06.18 08:40:15.162058 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Successfully written 210 bytes 2025.06.18 08:40:15.162073 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_3.test2' in BackgroundLoad 2025.06.18 08:40:15.162107 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Remaining size to read: 210, read: 210. Resizing buffer to 210 2025.06.18 08:40:15.162106 [ 66711 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.162146 [ 66741 ] {} DatabaseAtomic (test_3): Loading table test_3.test2 2025.06.18 08:40:15.162195 [ 66723 ] {} FileSegment(d67bdd7466bb2b3694a67107e8e0e79f) : [0, 209]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.162245 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 276, current is 1167 2025.06.18 08:40:15.162264 [ 66723 ] {} FileSegment(d67bdd7466bb2b3694a67107e8e0e79f) : [0, 209]: Complete batch. (File segment: [0, 209], key: d67bdd7466bb2b3694a67107e8e0e79f, state: DOWNLOADED, downloaded size: 210, reserved size: 210, downloader id: None, current write offset: 210, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.162324 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 0e1651943582be3521d041ee1c35f583, offset: 0, size: 276 2025.06.18 08:40:15.162349 [ 66723 ] {} CachedOnDiskReadBufferFromFile(d67bdd7466bb2b3694a67107e8e0e79f): Key: d67bdd7466bb2b3694a67107e8e0e79f. Returning with 210 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 210, current range: [0, 209], file offset of buffer end: 210, file segment state: DOWNLOADED, current write offset: 210, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 210, started with offset: 0, remaining ranges: [0, 209] 2025.06.18 08:40:15.162410 [ 66741 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.162475 [ 66741 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.162517 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Successfully written 276 bytes 2025.06.18 08:40:15.162579 [ 66741 ] {} DatabaseAtomic (test_3): Counting attached table test2 to database test_3 2025.06.18 08:40:15.162590 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.162675 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_3.test2' with status OK 2025.06.18 08:40:15.162705 [ 66769 ] {} FileSegment(0e1651943582be3521d041ee1c35f583) : [0, 275]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.162799 [ 66769 ] {} FileSegment(0e1651943582be3521d041ee1c35f583) : [0, 275]: Complete batch. (File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.162823 [ 66741 ] {} AsyncLoader: Execute load job 'load table test.join' in BackgroundLoad 2025.06.18 08:40:15.162810 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:15.162914 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ula/upddwtjdhegqawbyoelgbmzsqghjm (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/data.cmrk3) 2025.06.18 08:40:15.162921 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.162940 [ 66741 ] {} DatabaseAtomic (test): Loading table test.join 2025.06.18 08:40:15.162976 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:15.163033 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Reset state for seek to position 0 2025.06.18 08:40:15.163139 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.163213 [ 66711 ] {} FileSegment(9017d8e8332975ac7f59689d7ee2bc69) : [0, 46]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.163235 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Having 1 file segments to read: [0, 47], current read range: [0, 48) 2025.06.18 08:40:15.163320 [ 66723 ] {} FileSegment(8f27b5b7b3c4a302f6adf8e42c005778) : [0, 47]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.163378 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.163466 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 47], key: 8f27b5b7b3c4a302f6adf8e42c005778, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.163503 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.163603 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 47], key: 8f27b5b7b3c4a302f6adf8e42c005778, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.163612 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr, Version: Latest, Range: 0-46 2025.06.18 08:40:15.163707 [ 66741 ] {} HashJoin: Keys: [() = (UserID)], datatype: EMPTY, kind: Left, strictness: Semi, right header: UserID UInt64 UInt64(size = 0), loyalty Int8 Int8(size = 0) 2025.06.18 08:40:15.163717 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/ula/upddwtjdhegqawbyoelgbmzsqghjm, Version: Latest, Range: 0-47 2025.06.18 08:40:15.163734 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:15.163913 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:15.164031 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.164086 [ 66741 ] {} HashJoin: Shrinking stored blocks, memory consumption is 6.00 KiB calculated by join, 1.53 GiB by memory tracker 2025.06.18 08:40:15.164103 [ 66769 ] {} FileSegment(153f717bd4cc249a954deb95500a2a55) : [0, 46]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.164175 [ 66741 ] {} HashJoin: Shrunk stored blocks 0.00 B freed (0.00 B by memory tracker), new memory consumption is 6.00 KiB (1.53 GiB by memory tracker) 2025.06.18 08:40:15.164230 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.164283 [ 66741 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.164330 [ 66741 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.164352 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.164389 [ 66741 ] {} DatabaseAtomic (test): Counting attached table join to database test 2025.06.18 08:40:15.164441 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv, Version: Latest, Range: 0-46 2025.06.18 08:40:15.164640 [ 66741 ] {} AsyncLoader: Finish load job 'load table test.join' with status OK 2025.06.18 08:40:15.164737 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_13.distinct_in_order' in BackgroundLoad 2025.06.18 08:40:15.164816 [ 66741 ] {} DatabaseAtomic (test_13): Loading table test_13.distinct_in_order 2025.06.18 08:40:15.165284 [ 66684 ] {} test_15.distinct_in_order (fd4110b8-cdf9-4b52-8ac0-5d9be1869d4a): Loading data parts 2025.06.18 08:40:15.165444 [ 66768 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.165577 [ 66768 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): Finished loading Active part all_1_1_0 on disk s3_disk 2025.06.18 08:40:15.165655 [ 66684 ] {} test_15.distinct_in_order (fd4110b8-cdf9-4b52-8ac0-5d9be1869d4a): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.165665 [ 66730 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): Loading data parts 2025.06.18 08:40:15.165728 [ 66684 ] {} test_15.distinct_in_order (fd4110b8-cdf9-4b52-8ac0-5d9be1869d4a): There are no data parts 2025.06.18 08:40:15.165986 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.166013 [ 66730 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.166029 [ 66684 ] {} DatabaseAtomic (test_15): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.165979 [ 66734 ] {} test_1.data_native_copy (9cd6b815-cfe8-467a-b895-fef7d7f642d8): Loaded data parts (1 items) 2025.06.18 08:40:15.166090 [ 66730 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.166090 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (47 bytes) for 9017d8e8332975ac7f59689d7ee2bc69:0, current usage: size: 1443/104857600, elements: 14/10000000 (description: s3_cache) 2025.06.18 08:40:15.166119 [ 66684 ] {} DatabaseAtomic (test_15): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.166188 [ 66684 ] {} DatabaseAtomic (test_15): Counting attached table distinct_in_order to database test_15 2025.06.18 08:40:15.166270 [ 66785 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): Loading Active part 0_1_20_1 from disk default 2025.06.18 08:40:15.166298 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 47, current is 1443 2025.06.18 08:40:15.166323 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_15.distinct_in_order' with status OK 2025.06.18 08:40:15.166364 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 9017d8e8332975ac7f59689d7ee2bc69, offset: 0, size: 47 2025.06.18 08:40:15.166454 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_3.tab' in BackgroundLoad 2025.06.18 08:40:15.166447 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Read 48 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 48/48, impl position: 0, segment: [0, 47] 2025.06.18 08:40:15.166529 [ 66684 ] {} DatabaseAtomic (test_3): Loading table test_3.tab 2025.06.18 08:40:15.166555 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Successfully written 47 bytes 2025.06.18 08:40:15.166621 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.166618 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (48 bytes) for 8f27b5b7b3c4a302f6adf8e42c005778:0, current usage: size: 1490/104857600, elements: 15/10000000 (description: s3_cache) 2025.06.18 08:40:15.166710 [ 66711 ] {} FileSegment(9017d8e8332975ac7f59689d7ee2bc69) : [0, 46]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.166783 [ 66711 ] {} FileSegment(9017d8e8332975ac7f59689d7ee2bc69) : [0, 46]: Complete batch. (File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.166872 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 48, current is 1490 2025.06.18 08:40:15.166897 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.166914 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.166903 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.166973 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 8f27b5b7b3c4a302f6adf8e42c005778, offset: 0, size: 48 2025.06.18 08:40:15.166992 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.167096 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (47 bytes) for 153f717bd4cc249a954deb95500a2a55:0, current usage: size: 1538/104857600, elements: 16/10000000 (description: s3_cache) 2025.06.18 08:40:15.167156 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table data_native_copy to database test_1 2025.06.18 08:40:15.167263 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 47, current is 1538 2025.06.18 08:40:15.167280 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Successfully written 48 bytes 2025.06.18 08:40:15.167319 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 153f717bd4cc249a954deb95500a2a55, offset: 0, size: 47 2025.06.18 08:40:15.167461 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Successfully written 47 bytes 2025.06.18 08:40:15.167507 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.data_native_copy' with status OK 2025.06.18 08:40:15.167514 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Remaining size to read: 48, read: 48. Resizing buffer to 48 2025.06.18 08:40:15.167514 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.167629 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.t_github_json' in BackgroundLoad 2025.06.18 08:40:15.167665 [ 66769 ] {} FileSegment(153f717bd4cc249a954deb95500a2a55) : [0, 46]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.167678 [ 66723 ] {} FileSegment(8f27b5b7b3c4a302f6adf8e42c005778) : [0, 47]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.167714 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.t_github_json 2025.06.18 08:40:15.167740 [ 66769 ] {} FileSegment(153f717bd4cc249a954deb95500a2a55) : [0, 46]: Complete batch. (File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.167792 [ 66723 ] {} FileSegment(8f27b5b7b3c4a302f6adf8e42c005778) : [0, 47]: Complete batch. (File segment: [0, 47], key: 8f27b5b7b3c4a302f6adf8e42c005778, state: DOWNLOADED, downloaded size: 48, reserved size: 48, downloader id: None, current write offset: 48, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.167830 [ 66769 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.167929 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/count.txt) 2025.06.18 08:40:15.168071 [ 66723 ] {} CachedOnDiskReadBufferFromFile(8f27b5b7b3c4a302f6adf8e42c005778): Key: 8f27b5b7b3c4a302f6adf8e42c005778. Returning with 48 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 48, current range: [0, 47], file offset of buffer end: 48, file segment state: DOWNLOADED, current write offset: 48, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 48, started with offset: 0, remaining ranges: [0, 47] 2025.06.18 08:40:15.168264 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:15.168566 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.168724 [ 66711 ] {} FileSegment(9a775cd6b3f02f8cf2e0e075bd39dd62) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.168744 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/count.txt) 2025.06.18 08:40:15.168842 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:15.168896 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.169080 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.169091 [ 66741 ] {} test_13.distinct_in_order (cb38a23a-27fe-48f9-8f5a-6fbee78ea08c): Loading data parts 2025.06.18 08:40:15.169107 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.169141 [ 66769 ] {} FileSegment(d36b2ad475fec116fe7225b3a96e766a) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.169210 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc, Version: Latest, Range: 0-0 2025.06.18 08:40:15.169250 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.169365 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.169364 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/fni/wmciuaktkgflhssonfreiqcqjfcdu (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/count.txt) 2025.06.18 08:40:15.169454 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh, Version: Latest, Range: 0-0 2025.06.18 08:40:15.169515 [ 66741 ] {} test_13.distinct_in_order (cb38a23a-27fe-48f9-8f5a-6fbee78ea08c): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.169510 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Reset state for seek to position 0 2025.06.18 08:40:15.169588 [ 66741 ] {} test_13.distinct_in_order (cb38a23a-27fe-48f9-8f5a-6fbee78ea08c): There are no data parts 2025.06.18 08:40:15.169717 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.169790 [ 66723 ] {} FileSegment(a93fd7b6e7e40a822f55ba1e1512d02c) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.169894 [ 66741 ] {} DatabaseAtomic (test_13): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.169944 [ 66741 ] {} DatabaseAtomic (test_13): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.169962 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: a93fd7b6e7e40a822f55ba1e1512d02c, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.169991 [ 66741 ] {} DatabaseAtomic (test_13): Counting attached table distinct_in_order to database test_13 2025.06.18 08:40:15.169967 [ 66785 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): loadDataPart: inserting 0_1_20_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.170065 [ 66785 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): Finished loading Active part 0_1_20_1 on disk default 2025.06.18 08:40:15.170096 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: a93fd7b6e7e40a822f55ba1e1512d02c, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.170169 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_13.distinct_in_order' with status OK 2025.06.18 08:40:15.170185 [ 66730 ] {} test_1.test_move_partition_src (1048d755-5c50-4bec-8a72-f5b8fa3b8d2a): Loaded data parts (1 items) 2025.06.18 08:40:15.170188 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/fni/wmciuaktkgflhssonfreiqcqjfcdu, Version: Latest, Range: 0-0 2025.06.18 08:40:15.170279 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_1.test_lookup_table' in BackgroundLoad 2025.06.18 08:40:15.170342 [ 66741 ] {} DatabaseAtomic (test_1): Loading table test_1.test_lookup_table 2025.06.18 08:40:15.170551 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.170599 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.170678 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table test_move_partition_src to database test_1 2025.06.18 08:40:15.170750 [ 66741 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.170812 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.test_move_partition_src' with status OK 2025.06.18 08:40:15.170816 [ 66741 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.170885 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_01516.primary_key_test' in BackgroundLoad 2025.06.18 08:40:15.170899 [ 66741 ] {} DatabaseAtomic (test_1): Counting attached table test_lookup_table to database test_1 2025.06.18 08:40:15.170959 [ 66684 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): Loading data parts 2025.06.18 08:40:15.170986 [ 66730 ] {} DatabaseOrdinary (test_01516): Loading table test_01516.primary_key_test 2025.06.18 08:40:15.170999 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_1.test_lookup_table' with status OK 2025.06.18 08:40:15.171151 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_3.mv_b_even' in BackgroundLoad 2025.06.18 08:40:15.171197 [ 66741 ] {} DatabaseAtomic (test_3): Loading table test_3.mv_b_even 2025.06.18 08:40:15.171375 [ 66684 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.171439 [ 66684 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.171663 [ 66767 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): Loading Active part 48406fdb38e23228b776558b4edfa795_1_1_0 from disk default 2025.06.18 08:40:15.171798 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.171896 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for d36b2ad475fec116fe7225b3a96e766a:0, current usage: size: 1585/104857600, elements: 17/10000000 (description: s3_cache) 2025.06.18 08:40:15.171955 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.172080 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 1585 2025.06.18 08:40:15.172135 [ 66741 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.172145 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: d36b2ad475fec116fe7225b3a96e766a, offset: 0, size: 1 2025.06.18 08:40:15.172188 [ 66741 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.172238 [ 66741 ] {} DatabaseAtomic (test_3): Counting attached table mv_b_even to database test_3 2025.06.18 08:40:15.172254 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for 9a775cd6b3f02f8cf2e0e075bd39dd62:0, current usage: size: 1586/104857600, elements: 18/10000000 (description: s3_cache) 2025.06.18 08:40:15.172335 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Successfully written 1 bytes 2025.06.18 08:40:15.172362 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_3.mv_b_even' with status OK 2025.06.18 08:40:15.172394 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.172428 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 1586 2025.06.18 08:40:15.172463 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_1.t1__fuzz_17' in BackgroundLoad 2025.06.18 08:40:15.172484 [ 66769 ] {} FileSegment(d36b2ad475fec116fe7225b3a96e766a) : [0, 0]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.172512 [ 66741 ] {} DatabaseAtomic (test_1): Loading table test_1.t1__fuzz_17 2025.06.18 08:40:15.172489 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 9a775cd6b3f02f8cf2e0e075bd39dd62, offset: 0, size: 1 2025.06.18 08:40:15.172580 [ 66769 ] {} FileSegment(d36b2ad475fec116fe7225b3a96e766a) : [0, 0]: Complete batch. (File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.172685 [ 66769 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.172688 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Successfully written 1 bytes 2025.06.18 08:40:15.172771 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.172849 [ 66711 ] {} FileSegment(9a775cd6b3f02f8cf2e0e075bd39dd62) : [0, 0]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.172856 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.172917 [ 66711 ] {} FileSegment(9a775cd6b3f02f8cf2e0e075bd39dd62) : [0, 0]: Complete batch. (File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.172978 [ 66741 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.172990 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for a93fd7b6e7e40a822f55ba1e1512d02c:0, current usage: size: 1587/104857600, elements: 19/10000000 (description: s3_cache) 2025.06.18 08:40:15.173018 [ 66741 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.173026 [ 66711 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.173090 [ 66741 ] {} DatabaseAtomic (test_1): Counting attached table t1__fuzz_17 to database test_1 2025.06.18 08:40:15.173209 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_1.t1__fuzz_17' with status OK 2025.06.18 08:40:15.173213 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 1587 2025.06.18 08:40:15.173309 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_1.tab_00717' in BackgroundLoad 2025.06.18 08:40:15.173333 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: a93fd7b6e7e40a822f55ba1e1512d02c, offset: 0, size: 1 2025.06.18 08:40:15.173382 [ 66741 ] {} DatabaseAtomic (test_1): Loading table test_1.tab_00717 2025.06.18 08:40:15.173569 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Successfully written 1 bytes 2025.06.18 08:40:15.173633 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.173705 [ 66723 ] {} FileSegment(a93fd7b6e7e40a822f55ba1e1512d02c) : [0, 0]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.173782 [ 66723 ] {} FileSegment(a93fd7b6e7e40a822f55ba1e1512d02c) : [0, 0]: Complete batch. (File segment: [0, 0], key: a93fd7b6e7e40a822f55ba1e1512d02c, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.173886 [ 66723 ] {} CachedOnDiskReadBufferFromFile(a93fd7b6e7e40a822f55ba1e1512d02c): Key: a93fd7b6e7e40a822f55ba1e1512d02c. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.173925 [ 66769 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:15.174039 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:15.174177 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.174241 [ 66769 ] {} FileSegment(0400c7ab1c29805388345a0482cb56e8) : [0, 9]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.174333 [ 66711 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/4b2/4b2be74c-b043-4c29-be1e-e2afc5672375/all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:15.174356 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.174427 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:15.174467 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66769, current write offset: 0, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0 2025.06.18 08:40:15.174584 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.174601 [ 66769 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy, Version: Latest, Range: 0-9 2025.06.18 08:40:15.174649 [ 66711 ] {} FileSegment(1a2ad12bea0766a7a5bb42b1411957c0) : [0, 9]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.174777 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.174792 [ 66734 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): Loading data parts 2025.06.18 08:40:15.174886 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66711, current write offset: 0, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0 2025.06.18 08:40:15.174892 [ 66723 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dno/dghazkxwynailzvnccyletbkzulxk (store/704/7048ad88-f039-43aa-b1fb-990007a5bcdb/all_0_0_0/default_compression_codec.txt) 2025.06.18 08:40:15.174956 [ 66711 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp, Version: Latest, Range: 0-9 2025.06.18 08:40:15.175030 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Reset state for seek to position 0 2025.06.18 08:40:15.175046 [ 66730 ] {} test_01516.primary_key_test: Loading data parts 2025.06.18 08:40:15.175113 [ 66734 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.175172 [ 66734 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.175187 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.175252 [ 66723 ] {} FileSegment(844c0511e308d9be6fd2bc9f160a5890) : [0, 9]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.175322 [ 66782 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.175372 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 844c0511e308d9be6fd2bc9f160a5890, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.175437 [ 66730 ] {} test_01516.primary_key_test: loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.175481 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 844c0511e308d9be6fd2bc9f160a5890, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66723, current write offset: 0, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0 2025.06.18 08:40:15.175494 [ 66730 ] {} test_01516.primary_key_test: Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.175559 [ 66767 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): loadDataPart: inserting 48406fdb38e23228b776558b4edfa795_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.175595 [ 66723 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/dno/dghazkxwynailzvnccyletbkzulxk, Version: Latest, Range: 0-9 2025.06.18 08:40:15.175713 [ 66770 ] {} test_01516.primary_key_test: Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.175718 [ 66767 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): Finished loading Active part 48406fdb38e23228b776558b4edfa795_1_1_0 on disk default 2025.06.18 08:40:15.175877 [ 66684 ] {} test_3.tab (b90df850-cc55-4610-acd8-ce0b9ce0ce9f): Loaded data parts (1 items) 2025.06.18 08:40:15.176192 [ 66684 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.176244 [ 66684 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.176317 [ 66684 ] {} DatabaseAtomic (test_3): Counting attached table tab to database test_3 2025.06.18 08:40:15.176418 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_3.tab' with status OK 2025.06.18 08:40:15.176494 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.video_log' in BackgroundLoad 2025.06.18 08:40:15.176735 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.video_log 2025.06.18 08:40:15.177169 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.177168 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.177271 [ 66711 ] {} FileCache(s3_cache): Trying to reserve space (10 bytes) for 1a2ad12bea0766a7a5bb42b1411957c0:0, current usage: size: 1588/104857600, elements: 20/10000000 (description: s3_cache) 2025.06.18 08:40:15.177320 [ 66770 ] {} test_01516.primary_key_test: loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.177381 [ 66770 ] {} test_01516.primary_key_test: Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.177480 [ 66741 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): Loading data parts 2025.06.18 08:40:15.177485 [ 66730 ] {} test_01516.primary_key_test: Loaded data parts (1 items) 2025.06.18 08:40:15.177558 [ 66711 ] {} LRUFileCachePriority(s3_cache): Updating size with 10, current is 1588 2025.06.18 08:40:15.177611 [ 66711 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 1a2ad12bea0766a7a5bb42b1411957c0, offset: 0, size: 10 2025.06.18 08:40:15.177709 [ 66769 ] {} FileCache(s3_cache): Trying to reserve space (10 bytes) for 0400c7ab1c29805388345a0482cb56e8:0, current usage: size: 1598/104857600, elements: 21/10000000 (description: s3_cache) 2025.06.18 08:40:15.177780 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Successfully written 10 bytes 2025.06.18 08:40:15.177834 [ 66730 ] {} DatabaseOrdinary (test_01516): Counting attached table primary_key_test to database test_01516 2025.06.18 08:40:15.177861 [ 66741 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.177849 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.177897 [ 66769 ] {} LRUFileCachePriority(s3_cache): Updating size with 10, current is 1598 2025.06.18 08:40:15.177927 [ 66741 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.177945 [ 66769 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 0400c7ab1c29805388345a0482cb56e8, offset: 0, size: 10 2025.06.18 08:40:15.177974 [ 66711 ] {} FileSegment(1a2ad12bea0766a7a5bb42b1411957c0) : [0, 9]: Resetting downloader from None:ActiveParts:66711 2025.06.18 08:40:15.178044 [ 66711 ] {} FileSegment(1a2ad12bea0766a7a5bb42b1411957c0) : [0, 9]: Complete batch. (File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66711, kind: Regular, unbound: 0) 2025.06.18 08:40:15.178060 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_01516.primary_key_test' with status OK 2025.06.18 08:40:15.178082 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Successfully written 10 bytes 2025.06.18 08:40:15.178103 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Read 10 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.178133 [ 66711 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.178096 [ 66779 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.178174 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1_db.test_mv' in BackgroundLoad 2025.06.18 08:40:15.178188 [ 66723 ] {} FileCache(s3_cache): Trying to reserve space (10 bytes) for 844c0511e308d9be6fd2bc9f160a5890:0, current usage: size: 1608/104857600, elements: 22/10000000 (description: s3_cache) 2025.06.18 08:40:15.178151 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.178224 [ 66782 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.178270 [ 66730 ] {} DatabaseReplicated (test_1_db): Loading table test_1_db.test_mv 2025.06.18 08:40:15.178315 [ 66769 ] {} FileSegment(0400c7ab1c29805388345a0482cb56e8) : [0, 9]: Resetting downloader from None:ActiveParts:66769 2025.06.18 08:40:15.178336 [ 66782 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.178376 [ 66769 ] {} FileSegment(0400c7ab1c29805388345a0482cb56e8) : [0, 9]: Complete batch. (File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66769, kind: Regular, unbound: 0) 2025.06.18 08:40:15.178385 [ 66723 ] {} LRUFileCachePriority(s3_cache): Updating size with 10, current is 1608 2025.06.18 08:40:15.178457 [ 66723 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 844c0511e308d9be6fd2bc9f160a5890, offset: 0, size: 10 2025.06.18 08:40:15.178467 [ 66769 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.178480 [ 66734 ] {} test_1.t_github_json (96daca3f-33b0-4ce5-b767-b7c6397332c1): Loaded data parts (1 items) 2025.06.18 08:40:15.178487 [ 66711 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): loadDataPart: inserting all_2_2_0_3 (state Active) into data_parts_indexes 2025.06.18 08:40:15.178606 [ 66711 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Finished loading Active part all_2_2_0_3 on disk s3_disk 2025.06.18 08:40:15.178618 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Successfully written 10 bytes 2025.06.18 08:40:15.178669 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.178744 [ 66723 ] {} FileSegment(844c0511e308d9be6fd2bc9f160a5890) : [0, 9]: Resetting downloader from None:ActiveParts:66723 2025.06.18 08:40:15.178751 [ 66730 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.178801 [ 66769 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): loadDataPart: inserting all_1_1_0_3 (state Active) into data_parts_indexes 2025.06.18 08:40:15.178823 [ 66723 ] {} FileSegment(844c0511e308d9be6fd2bc9f160a5890) : [0, 9]: Complete batch. (File segment: [0, 9], key: 844c0511e308d9be6fd2bc9f160a5890, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66723, kind: Regular, unbound: 0) 2025.06.18 08:40:15.178844 [ 66730 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.178852 [ 66769 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Finished loading Active part all_1_1_0_3 on disk s3_disk 2025.06.18 08:40:15.178908 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.178912 [ 66723 ] {} CachedOnDiskReadBufferFromFile(844c0511e308d9be6fd2bc9f160a5890): Key: 844c0511e308d9be6fd2bc9f160a5890. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.178926 [ 66730 ] {} DatabaseReplicated (test_1_db): Counting attached table test_mv to database test_1_db 2025.06.18 08:40:15.178984 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.179116 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table t_github_json to database test_1 2025.06.18 08:40:15.179139 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1_db.test_mv' with status OK 2025.06.18 08:40:15.179224 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.t_02559' in BackgroundLoad 2025.06.18 08:40:15.179295 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.t_02559 2025.06.18 08:40:15.179287 [ 66722 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Loaded data parts (2 items) 2025.06.18 08:40:15.179344 [ 66723 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): loadDataPart: inserting all_0_0_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.179406 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.t_github_json' with status OK 2025.06.18 08:40:15.179454 [ 66723 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Finished loading Active part all_0_0_0 on disk s3_disk 2025.06.18 08:40:15.179527 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_13.00163_column_oriented' in BackgroundLoad 2025.06.18 08:40:15.179596 [ 66734 ] {} DatabaseAtomic (test_13): Loading table test_13.00163_column_oriented 2025.06.18 08:40:15.179646 [ 66722 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.179880 [ 66718 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Loaded data parts (1 items) 2025.06.18 08:40:15.180241 [ 66718 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.180724 [ 66722 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.180815 [ 66722 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.180926 [ 66722 ] {} DatabaseAtomic (test_1): Counting attached table rmt2 to database test_1 2025.06.18 08:40:15.181029 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.181087 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.181194 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table r2 to database test_1 2025.06.18 08:40:15.181291 [ 66722 ] {} AsyncLoader: Finish load job 'load table test_1.rmt2' with status OK 2025.06.18 08:40:15.181296 [ 66779 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.181424 [ 66779 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.181434 [ 66722 ] {} AsyncLoader: Execute load job 'load table test_1.t02176' in BackgroundLoad 2025.06.18 08:40:15.181595 [ 66741 ] {} test_1.tab_00717 (e2cdb755-7c0b-4d7c-aed6-b301afc14d5d): Loaded data parts (1 items) 2025.06.18 08:40:15.181613 [ 66722 ] {} DatabaseAtomic (test_1): Loading table test_1.t02176 2025.06.18 08:40:15.181805 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.r2' with status OK 2025.06.18 08:40:15.181936 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.distinct' in BackgroundLoad 2025.06.18 08:40:15.181977 [ 66741 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.181993 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.distinct 2025.06.18 08:40:15.182059 [ 66741 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.182171 [ 66741 ] {} DatabaseAtomic (test_1): Counting attached table tab_00717 to database test_1 2025.06.18 08:40:15.182337 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_1.tab_00717' with status OK 2025.06.18 08:40:15.182414 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.182423 [ 66741 ] {} AsyncLoader: Execute load job 'load table test_1.regexp_dict4' in BackgroundLoad 2025.06.18 08:40:15.182480 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.182528 [ 66741 ] {} DatabaseAtomic (test_1): Loading table test_1.regexp_dict4 2025.06.18 08:40:15.182564 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table distinct to database test_1 2025.06.18 08:40:15.182674 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.distinct' with status OK 2025.06.18 08:40:15.182763 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.data_r2' in BackgroundLoad 2025.06.18 08:40:15.182809 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.data_r2 2025.06.18 08:40:15.183264 [ 66730 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): Loading data parts 2025.06.18 08:40:15.183596 [ 66730 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.183656 [ 66730 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.183852 [ 66690 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.186517 [ 66690 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.186619 [ 66690 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.186779 [ 66730 ] {} test_1.t_02559 (5c5c3658-9927-43ea-acd8-5ac7fbac46cb): Loaded data parts (1 items) 2025.06.18 08:40:15.187101 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.187160 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.187284 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table t_02559 to database test_1 2025.06.18 08:40:15.187437 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.t_02559' with status OK 2025.06.18 08:40:15.187536 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.src_table' in BackgroundLoad 2025.06.18 08:40:15.187623 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.src_table 2025.06.18 08:40:15.189983 [ 66718 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Loading data parts 2025.06.18 08:40:15.190431 [ 66718 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.190493 [ 66718 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.190571 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Found 8 old parts to remove. Parts: [202506_1_211_42, 202506_1_216_43, 202506_212_212_0, 202506_213_213_0, 202506_214_214_0, 202506_215_215_0, 202506_216_216_0, 202506_217_217_0] 2025.06.18 08:40:15.190710 [ 66786 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Loading Active part all_0_49_3 from disk default 2025.06.18 08:40:15.190789 [ 66784 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Loading Active part all_94_101_1 from disk default 2025.06.18 08:40:15.190784 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Removing 8 parts from filesystem (serially): Parts: [202506_1_211_42, 202506_1_216_43, 202506_212_212_0, 202506_213_213_0, 202506_214_214_0, 202506_215_215_0, 202506_216_216_0, 202506_217_217_0] 2025.06.18 08:40:15.190826 [ 66781 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Loading Active part all_50_93_2 from disk default 2025.06.18 08:40:15.192599 [ 66784 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): loadDataPart: inserting all_94_101_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.192666 [ 66784 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Finished loading Active part all_94_101_1 on disk default 2025.06.18 08:40:15.192688 [ 66786 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): loadDataPart: inserting all_0_49_3 (state Active) into data_parts_indexes 2025.06.18 08:40:15.192786 [ 66786 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Finished loading Active part all_0_49_3 on disk default 2025.06.18 08:40:15.193183 [ 66781 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): loadDataPart: inserting all_50_93_2 (state Active) into data_parts_indexes 2025.06.18 08:40:15.193278 [ 66781 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Finished loading Active part all_50_93_2 on disk default 2025.06.18 08:40:15.193446 [ 66718 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Loaded data parts (3 items) 2025.06.18 08:40:15.193547 [ 66718 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.193721 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.193771 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.193887 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table data_r2 to database test_1 2025.06.18 08:40:15.194036 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.data_r2' with status OK 2025.06.18 08:40:15.194149 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.location' in BackgroundLoad 2025.06.18 08:40:15.194195 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.location 2025.06.18 08:40:15.198177 [ 66718 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): Loading data parts 2025.06.18 08:40:15.198529 [ 66718 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.198612 [ 66718 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.198840 [ 66787 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.199006 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_1_211_42 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199094 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_1_216_43 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199134 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_212_212_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199178 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_213_213_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199230 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_214_214_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199280 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_215_215_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199320 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_216_216_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199364 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_217_217_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.199434 [ 66660 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Removing 8 parts from memory: Parts: [202506_1_211_42, 202506_1_216_43, 202506_212_212_0, 202506_213_213_0, 202506_214_214_0, 202506_215_215_0, 202506_216_216_0, 202506_217_217_0] 2025.06.18 08:40:15.201502 [ 66787 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.201628 [ 66787 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.201798 [ 66718 ] {} test_1.location (fe9a037c-2945-4bab-9635-fd57d3424b39): Loaded data parts (1 items) 2025.06.18 08:40:15.202240 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.202289 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.202371 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table location to database test_1 2025.06.18 08:40:15.202530 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.location' with status OK 2025.06.18 08:40:15.202666 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.dictionary_decimal_source_table' in BackgroundLoad 2025.06.18 08:40:15.202721 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.dictionary_decimal_source_table 2025.06.18 08:40:15.203412 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.203465 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.203567 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table dictionary_decimal_source_table to database test_1 2025.06.18 08:40:15.203710 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.dictionary_decimal_source_table' with status OK 2025.06.18 08:40:15.203833 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_7.unit' in BackgroundLoad 2025.06.18 08:40:15.203912 [ 66718 ] {} DatabaseAtomic (test_7): Loading table test_7.unit 2025.06.18 08:40:15.204398 [ 66718 ] {} DatabaseAtomic (test_7): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.204444 [ 66718 ] {} DatabaseAtomic (test_7): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.204516 [ 66718 ] {} DatabaseAtomic (test_7): Counting attached table unit to database test_7 2025.06.18 08:40:15.204651 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_7.unit' with status OK 2025.06.18 08:40:15.204749 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.test1' in BackgroundLoad 2025.06.18 08:40:15.204815 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.test1 2025.06.18 08:40:15.208910 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/decimals_dictionary.xml'. 2025.06.18 08:40:15.209022 [ 66718 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): Loading data parts 2025.06.18 08:40:15.209368 [ 66718 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.209424 [ 66718 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.209665 [ 66772 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.212199 [ 66772 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.212283 [ 66772 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.212429 [ 66718 ] {} test_1.test1 (a10b48be-7545-4c99-9851-0c64decc84e2): Loaded data parts (1 items) 2025.06.18 08:40:15.212804 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.212852 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.212930 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table test1 to database test_1 2025.06.18 08:40:15.213036 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.test1' with status OK 2025.06.18 08:40:15.213107 [ 66718 ] {} AsyncLoader: Execute load job 'load table test.visits_null' in BackgroundLoad 2025.06.18 08:40:15.213180 [ 66718 ] {} DatabaseAtomic (test): Loading table test.visits_null 2025.06.18 08:40:15.213631 [ 66718 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.213674 [ 66718 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.213750 [ 66718 ] {} DatabaseAtomic (test): Counting attached table visits_null to database test 2025.06.18 08:40:15.213876 [ 66718 ] {} AsyncLoader: Finish load job 'load table test.visits_null' with status OK 2025.06.18 08:40:15.213937 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_qcf18570.realtimedistributed' in BackgroundLoad 2025.06.18 08:40:15.213982 [ 66718 ] {} DatabaseAtomic (test_qcf18570): Loading table test_qcf18570.realtimedistributed 2025.06.18 08:40:15.215325 [ 66738 ] {} DatabaseAtomic (test_7): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.215438 [ 66738 ] {} DatabaseAtomic (test_7): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.215573 [ 66738 ] {} DatabaseAtomic (test_7): Counting attached table parsing_with_names to database test_7 2025.06.18 08:40:15.215611 [ 66732 ] {} DatabaseAtomic (test_15): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.215633 [ 66776 ] {} StorageDistributed (realtimedistributed): Removing /var/lib/clickhouse/store/8e6/8e612685-9b8b-433b-88aa-75aaf2289a96/shard2_replica1 (used for async INSERT into Distributed) 2025.06.18 08:40:15.215725 [ 66732 ] {} DatabaseAtomic (test_15): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.215775 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_7.parsing_with_names' with status OK 2025.06.18 08:40:15.215804 [ 66732 ] {} DatabaseAtomic (test_15): Counting attached table parsing_with_names to database test_15 2025.06.18 08:40:15.215915 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.test' in BackgroundLoad 2025.06.18 08:40:15.215965 [ 66747 ] {} DatabaseAtomic (test_13): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.216045 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.test 2025.06.18 08:40:15.216094 [ 66747 ] {} DatabaseAtomic (test_13): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.216222 [ 66732 ] {} AsyncLoader: Finish load job 'load table test_15.parsing_with_names' with status OK 2025.06.18 08:40:15.216237 [ 66747 ] {} DatabaseAtomic (test_13): Counting attached table parsing_with_names to database test_13 2025.06.18 08:40:15.216343 [ 66732 ] {} AsyncLoader: Execute load job 'load table test_1.data' in BackgroundLoad 2025.06.18 08:40:15.216349 [ 66734 ] {} DatabaseAtomic (test_13): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.216447 [ 66734 ] {} DatabaseAtomic (test_13): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.216493 [ 66732 ] {} DatabaseAtomic (test_1): Loading table test_1.data 2025.06.18 08:40:15.216504 [ 66734 ] {} DatabaseAtomic (test_13): Counting attached table 00163_column_oriented to database test_13 2025.06.18 08:40:15.216572 [ 66718 ] {} StorageDistributed (realtimedistributed): Auto-increment is 0 2025.06.18 08:40:15.216598 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/decimals_dictionary.xml'. 2025.06.18 08:40:15.216711 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_13.parsing_with_names' with status OK 2025.06.18 08:40:15.216818 [ 66718 ] {} DatabaseAtomic (test_qcf18570): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.216838 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_1.02500_nested' in BackgroundLoad 2025.06.18 08:40:15.216884 [ 66718 ] {} DatabaseAtomic (test_qcf18570): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.216983 [ 66747 ] {} DatabaseAtomic (test_1): Loading table test_1.02500_nested 2025.06.18 08:40:15.216990 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_13.00163_column_oriented' with status OK 2025.06.18 08:40:15.217014 [ 65992 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/executable_dictionary.xml'. 2025.06.18 08:40:15.216995 [ 66718 ] {} DatabaseAtomic (test_qcf18570): Counting attached table realtimedistributed to database test_qcf18570 2025.06.18 08:40:15.217170 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.concurrent_kill_5' in BackgroundLoad 2025.06.18 08:40:15.217230 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.concurrent_kill_5 2025.06.18 08:40:15.217340 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_qcf18570.realtimedistributed' with status OK 2025.06.18 08:40:15.217535 [ 66718 ] {} AsyncLoader: Execute load job 'load table test.basic' in BackgroundLoad 2025.06.18 08:40:15.217620 [ 66718 ] {} DatabaseAtomic (test): Loading table test.basic 2025.06.18 08:40:15.219638 [ 66718 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.219691 [ 66718 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.219787 [ 66718 ] {} DatabaseAtomic (test): Counting attached table basic to database test 2025.06.18 08:40:15.220060 [ 66718 ] {} AsyncLoader: Finish load job 'load table test.basic' with status OK 2025.06.18 08:40:15.220728 [ 66718 ] {} AsyncLoader: Execute load job 'load table test.partitions' in BackgroundLoad 2025.06.18 08:40:15.220787 [ 66718 ] {} DatabaseAtomic (test): Loading table test.partitions 2025.06.18 08:40:15.221229 [ 66730 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Loading data parts 2025.06.18 08:40:15.221433 [ 66738 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Loading data parts 2025.06.18 08:40:15.221590 [ 66730 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.221664 [ 66730 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.221786 [ 66738 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.221796 [ 66685 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.221869 [ 66738 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.221886 [ 66768 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Loading Active part all_2_2_0 from disk default 2025.06.18 08:40:15.222054 [ 66780 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.222116 [ 66750 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Loading Active part all_2_2_0 from disk default 2025.06.18 08:40:15.222163 [ 66785 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Loading Active part all_3_3_0 from disk default 2025.06.18 08:40:15.222874 [ 66732 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rdk/uncwjrxoxdgvpczgydmahnzsxdeol (store/eff/effb371c-2343-4843-ab53-795fba018263/format_version.txt) 2025.06.18 08:40:15.223237 [ 66722 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): Loading data parts 2025.06.18 08:40:15.223507 [ 66722 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.223582 [ 66722 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.223739 [ 66737 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): Loading Active part 20190602_1_1_0 from disk default 2025.06.18 08:40:15.224328 [ 66685 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.224390 [ 66685 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.224433 [ 66785 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): loadDataPart: inserting all_3_3_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.224490 [ 66785 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Finished loading Active part all_3_3_0 on disk default 2025.06.18 08:40:15.224655 [ 66750 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.224724 [ 66750 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Finished loading Active part all_2_2_0 on disk default 2025.06.18 08:40:15.224737 [ 66768 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.224777 [ 66780 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.224803 [ 66768 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Finished loading Active part all_2_2_0 on disk default 2025.06.18 08:40:15.224850 [ 66780 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.224924 [ 66730 ] {} test_1.src_table (255add75-15b3-4d49-8d4e-c73af33f6aa6): Loaded data parts (2 items) 2025.06.18 08:40:15.225281 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.225334 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.225396 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table src_table to database test_1 2025.06.18 08:40:15.225504 [ 66710 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Loading data parts 2025.06.18 08:40:15.225576 [ 66738 ] {} test_1.test (b01fa1ed-4d28-4829-9171-2d754f378bdf): Loaded data parts (3 items) 2025.06.18 08:40:15.225605 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.src_table' with status OK 2025.06.18 08:40:15.225857 [ 66710 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.225882 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.d' in BackgroundLoad 2025.06.18 08:40:15.225914 [ 66710 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.225963 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.d 2025.06.18 08:40:15.226070 [ 66767 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Loading Active part 20250618_20250618_1_1_0 from disk default 2025.06.18 08:40:15.226086 [ 66770 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Loading Active part 20250618_20250618_2_2_0 from disk default 2025.06.18 08:40:15.226277 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.226340 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.226408 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table test to database test_1 2025.06.18 08:40:15.226633 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.test' with status OK 2025.06.18 08:40:15.226715 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.mt' in BackgroundLoad 2025.06.18 08:40:15.226786 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.mt 2025.06.18 08:40:15.227089 [ 66737 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): loadDataPart: inserting 20190602_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.227168 [ 66730 ] {} StorageDistributed (d): Auto-increment is 0 2025.06.18 08:40:15.227216 [ 66737 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): Finished loading Active part 20190602_1_1_0 on disk default 2025.06.18 08:40:15.227321 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.227376 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.227367 [ 66722 ] {} test_1.t02176 (f6c23156-e02a-41b5-a32e-2f917adba84f): Loaded data parts (1 items) 2025.06.18 08:40:15.227496 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table d to database test_1 2025.06.18 08:40:15.227787 [ 66732 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): Loading data parts 2025.06.18 08:40:15.227847 [ 66733 ] {} test_1.video_log_result__fuzz_0 (5ad70645-6dc2-4aa8-ac7f-b836044be0a6): Loading data parts 2025.06.18 08:40:15.227927 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.d' with status OK 2025.06.18 08:40:15.228041 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.copied_table' in BackgroundLoad 2025.06.18 08:40:15.228126 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.copied_table 2025.06.18 08:40:15.228445 [ 66684 ] {} test_1.video_log (8786645b-080c-460c-86fd-083fbbde17dd): Loading data parts 2025.06.18 08:40:15.228515 [ 66722 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.228576 [ 66767 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): loadDataPart: inserting 20250618_20250618_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.228584 [ 66722 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.228607 [ 66733 ] {} test_1.video_log_result__fuzz_0 (5ad70645-6dc2-4aa8-ac7f-b836044be0a6): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.228672 [ 66722 ] {} DatabaseAtomic (test_1): Counting attached table t02176 to database test_1 2025.06.18 08:40:15.228695 [ 66684 ] {} test_1.video_log (8786645b-080c-460c-86fd-083fbbde17dd): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.228642 [ 66767 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Finished loading Active part 20250618_20250618_1_1_0 on disk default 2025.06.18 08:40:15.228758 [ 66684 ] {} test_1.video_log (8786645b-080c-460c-86fd-083fbbde17dd): There are no data parts 2025.06.18 08:40:15.228726 [ 66733 ] {} test_1.video_log_result__fuzz_0 (5ad70645-6dc2-4aa8-ac7f-b836044be0a6): There are no data parts 2025.06.18 08:40:15.228800 [ 66722 ] {} AsyncLoader: Finish load job 'load table test_1.t02176' with status OK 2025.06.18 08:40:15.228852 [ 66734 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Loading data parts 2025.06.18 08:40:15.228867 [ 66722 ] {} AsyncLoader: Execute load job 'load table test_1.src' in BackgroundLoad 2025.06.18 08:40:15.228910 [ 66722 ] {} DatabaseAtomic (test_1): Loading table test_1.src 2025.06.18 08:40:15.229210 [ 66696 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Loading data parts 2025.06.18 08:40:15.229353 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.229399 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.229444 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table video_log to database test_1 2025.06.18 08:40:15.229500 [ 66770 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): loadDataPart: inserting 20250618_20250618_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.229515 [ 66733 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.229592 [ 66770 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Finished loading Active part 20250618_20250618_2_2_0 on disk default 2025.06.18 08:40:15.229668 [ 66696 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.229681 [ 66733 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.229670 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.video_log' with status OK 2025.06.18 08:40:15.229746 [ 66696 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.229784 [ 66733 ] {} DatabaseAtomic (test_1): Counting attached table video_log_result__fuzz_0 to database test_1 2025.06.18 08:40:15.229794 [ 66710 ] {} test_3.test_a (61f68d38-357d-4b93-a45c-e8a7047ae6d5): Loaded data parts (2 items) 2025.06.18 08:40:15.229977 [ 66684 ] {} AsyncLoader: Execute load job 'load table test_1.tab_00481' in BackgroundLoad 2025.06.18 08:40:15.229981 [ 66777 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Loading Active part 20250618_20250618_2_2_0 from disk default 2025.06.18 08:40:15.230021 [ 66779 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Loading Active part 20250618_20250618_1_1_0 from disk default 2025.06.18 08:40:15.230074 [ 66684 ] {} DatabaseAtomic (test_1): Loading table test_1.tab_00481 2025.06.18 08:40:15.230227 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_1.video_log_result__fuzz_0' with status OK 2025.06.18 08:40:15.230361 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_1.concurrent_kill_4' in BackgroundLoad 2025.06.18 08:40:15.230417 [ 66733 ] {} DatabaseAtomic (test_1): Loading table test_1.concurrent_kill_4 2025.06.18 08:40:15.230420 [ 66718 ] {} test.partitions (a6b10c09-5feb-4428-a981-7969cef123bf): Loading data parts 2025.06.18 08:40:15.230501 [ 66710 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.230625 [ 66710 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.230697 [ 66710 ] {} DatabaseAtomic (test_3): Counting attached table test_a to database test_3 2025.06.18 08:40:15.230706 [ 66747 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): Loading data parts 2025.06.18 08:40:15.230786 [ 66718 ] {} test.partitions (a6b10c09-5feb-4428-a981-7969cef123bf): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.230888 [ 66718 ] {} test.partitions (a6b10c09-5feb-4428-a981-7969cef123bf): There are no data parts 2025.06.18 08:40:15.230925 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_3.test_a' with status OK 2025.06.18 08:40:15.231011 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.bug' in BackgroundLoad 2025.06.18 08:40:15.231142 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.bug 2025.06.18 08:40:15.231407 [ 66718 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.231476 [ 66718 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.231567 [ 66718 ] {} DatabaseAtomic (test): Counting attached table partitions to database test 2025.06.18 08:40:15.232260 [ 66703 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Loading data parts 2025.06.18 08:40:15.232460 [ 66718 ] {} AsyncLoader: Finish load job 'load table test.partitions' with status OK 2025.06.18 08:40:15.232524 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.232661 [ 66777 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): loadDataPart: inserting 20250618_20250618_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.232714 [ 66777 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Finished loading Active part 20250618_20250618_2_2_0 on disk default 2025.06.18 08:40:15.232731 [ 66703 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.232801 [ 66703 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): There are no data parts 2025.06.18 08:40:15.232890 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.232960 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table bug to database test_1 2025.06.18 08:40:15.233048 [ 66730 ] {} test_1.copied_table (c1e0de9e-b693-4b35-a800-db3030128725): Loading data parts 2025.06.18 08:40:15.232939 [ 66703 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.233255 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.test_grouping_sets_predicate' in BackgroundLoad 2025.06.18 08:40:15.233356 [ 66730 ] {} test_1.copied_table (c1e0de9e-b693-4b35-a800-db3030128725): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.233362 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.test_grouping_sets_predicate 2025.06.18 08:40:15.233409 [ 66738 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Loading data parts 2025.06.18 08:40:15.233422 [ 66730 ] {} test_1.copied_table (c1e0de9e-b693-4b35-a800-db3030128725): There are no data parts 2025.06.18 08:40:15.233486 [ 66703 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.233467 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.bug' with status OK 2025.06.18 08:40:15.233611 [ 66703 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.233685 [ 66703 ] {} DatabaseAtomic (test_3): Counting attached table test_table_replicated to database test_3 2025.06.18 08:40:15.233691 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.concurrent_kill_1' in BackgroundLoad 2025.06.18 08:40:15.233836 [ 66738 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.233870 [ 66747 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.233899 [ 66734 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.233927 [ 66738 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.233849 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.concurrent_kill_1 2025.06.18 08:40:15.233910 [ 66703 ] {} AsyncLoader: Finish load job 'load table test_3.test_table_replicated' with status OK 2025.06.18 08:40:15.234006 [ 66734 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.234099 [ 66779 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): loadDataPart: inserting 20250618_20250618_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.234126 [ 66703 ] {} AsyncLoader: Execute load job 'load table test_1.quorum1' in BackgroundLoad 2025.06.18 08:40:15.234144 [ 66765 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Loading Active part all_101_128_1 from disk default 2025.06.18 08:40:15.234183 [ 66703 ] {} DatabaseAtomic (test_1): Loading table test_1.quorum1 2025.06.18 08:40:15.234194 [ 66787 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Loading Active part all_1_100_1 from disk default 2025.06.18 08:40:15.234181 [ 66779 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Finished loading Active part 20250618_20250618_1_1_0 on disk default 2025.06.18 08:40:15.234245 [ 66730 ] {} test_1.copied_table (c1e0de9e-b693-4b35-a800-db3030128725): Loading mutation: mutation_1.txt entry, commands size: 1 2025.06.18 08:40:15.234337 [ 66778 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Loading Active part all_0_0_0_18 from disk default 2025.06.18 08:40:15.234356 [ 66722 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): Loading data parts 2025.06.18 08:40:15.234489 [ 66696 ] {} test_3.test_b (4a845077-608d-4813-9917-fd444605a67b): Loaded data parts (2 items) 2025.06.18 08:40:15.234510 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.234609 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.234661 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table copied_table to database test_1 2025.06.18 08:40:15.234690 [ 66722 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.234746 [ 66722 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.234833 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.copied_table' with status OK 2025.06.18 08:40:15.234944 [ 66776 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.234978 [ 66730 ] {} AsyncLoader: Execute load job 'load table test_1.data_01882' in BackgroundLoad 2025.06.18 08:40:15.235062 [ 66730 ] {} DatabaseAtomic (test_1): Loading table test_1.data_01882 2025.06.18 08:40:15.235116 [ 66729 ] {} test.hits_snippet (67a6c458-6b9c-449b-8e5e-92b8e6921bf9): Loading data parts 2025.06.18 08:40:15.235198 [ 66696 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.235259 [ 66696 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.235328 [ 66696 ] {} DatabaseAtomic (test_3): Counting attached table test_b to database test_3 2025.06.18 08:40:15.233960 [ 66747 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.235438 [ 66729 ] {} test.hits_snippet (67a6c458-6b9c-449b-8e5e-92b8e6921bf9): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.235496 [ 66729 ] {} test.hits_snippet (67a6c458-6b9c-449b-8e5e-92b8e6921bf9): There are no data parts 2025.06.18 08:40:15.235744 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_3.test_b' with status OK 2025.06.18 08:40:15.235887 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_1.clickhouse_alias_issue_2' in BackgroundLoad 2025.06.18 08:40:15.235945 [ 66696 ] {} DatabaseAtomic (test_1): Loading table test_1.clickhouse_alias_issue_2 2025.06.18 08:40:15.236034 [ 66729 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.236085 [ 66729 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.236290 [ 66729 ] {} DatabaseAtomic (test): Counting attached table hits_snippet to database test 2025.06.18 08:40:15.236422 [ 66765 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): loadDataPart: inserting all_101_128_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.236451 [ 66729 ] {} AsyncLoader: Finish load job 'load table test.hits_snippet' with status OK 2025.06.18 08:40:15.236482 [ 66765 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Finished loading Active part all_101_128_1 on disk default 2025.06.18 08:40:15.236497 [ 66787 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): loadDataPart: inserting all_1_100_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.236522 [ 66729 ] {} AsyncLoader: Execute load job 'load table test.basic_00040' in BackgroundLoad 2025.06.18 08:40:15.236578 [ 66729 ] {} DatabaseAtomic (test): Loading table test.basic_00040 2025.06.18 08:40:15.236584 [ 66787 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Finished loading Active part all_1_100_1 on disk default 2025.06.18 08:40:15.236623 [ 66720 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Loading data parts 2025.06.18 08:40:15.236666 [ 66696 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.236738 [ 66696 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.236816 [ 66696 ] {} DatabaseAtomic (test_1): Counting attached table clickhouse_alias_issue_2 to database test_1 2025.06.18 08:40:15.237042 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_1.clickhouse_alias_issue_2' with status OK 2025.06.18 08:40:15.237115 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_3.left' in BackgroundLoad 2025.06.18 08:40:15.237183 [ 66696 ] {} DatabaseAtomic (test_3): Loading table test_3.left 2025.06.18 08:40:15.237397 [ 66778 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): loadDataPart: inserting all_0_0_0_18 (state Active) into data_parts_indexes 2025.06.18 08:40:15.237403 [ 66684 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): Loading data parts 2025.06.18 08:40:15.237478 [ 66776 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.237489 [ 66778 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Finished loading Active part all_0_0_0_18 on disk default 2025.06.18 08:40:15.237596 [ 66738 ] {} test_1.mt (9529eec7-581a-439e-ac89-1f42b03eda79): Loaded data parts (2 items) 2025.06.18 08:40:15.237574 [ 66776 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.237746 [ 66734 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Loaded data parts (1 items) 2025.06.18 08:40:15.237857 [ 66722 ] {} test_1.src (a1f3331f-fa03-49af-bc08-4af0bbb93403): Loaded data parts (1 items) 2025.06.18 08:40:15.237863 [ 66734 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.237959 [ 66729 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.238006 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.238011 [ 66729 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.238128 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.238147 [ 66729 ] {} DatabaseAtomic (test): Counting attached table basic_00040 to database test 2025.06.18 08:40:15.238197 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table mt to database test_1 2025.06.18 08:40:15.238268 [ 66722 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.238321 [ 66722 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.238365 [ 66722 ] {} DatabaseAtomic (test_1): Counting attached table src to database test_1 2025.06.18 08:40:15.238420 [ 66729 ] {} AsyncLoader: Finish load job 'load table test.basic_00040' with status OK 2025.06.18 08:40:15.238428 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.238554 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.238618 [ 66729 ] {} AsyncLoader: Execute load job 'load table test.hits_tinylog' in BackgroundLoad 2025.06.18 08:40:15.238619 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table concurrent_kill_5 to database test_1 2025.06.18 08:40:15.238681 [ 66729 ] {} DatabaseAtomic (test): Loading table test.hits_tinylog 2025.06.18 08:40:15.238762 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.mt' with status OK 2025.06.18 08:40:15.238845 [ 66733 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Loading data parts 2025.06.18 08:40:15.238902 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.t_nested_with_dots' in BackgroundLoad 2025.06.18 08:40:15.238969 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.t_nested_with_dots 2025.06.18 08:40:15.239058 [ 66722 ] {} AsyncLoader: Finish load job 'load table test_1.src' with status OK 2025.06.18 08:40:15.239185 [ 66722 ] {} AsyncLoader: Execute load job 'load table test.hits_stripelog' in BackgroundLoad 2025.06.18 08:40:15.239254 [ 66722 ] {} DatabaseAtomic (test): Loading table test.hits_stripelog 2025.06.18 08:40:15.239339 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.concurrent_kill_5' with status OK 2025.06.18 08:40:15.239416 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.m' in BackgroundLoad 2025.06.18 08:40:15.239470 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.m 2025.06.18 08:40:15.239472 [ 66729 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.239580 [ 66729 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.239639 [ 66729 ] {} DatabaseAtomic (test): Counting attached table hits_tinylog to database test 2025.06.18 08:40:15.239728 [ 66729 ] {} AsyncLoader: Finish load job 'load table test.hits_tinylog' with status OK 2025.06.18 08:40:15.239776 [ 66722 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.239819 [ 66722 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.239831 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.rdb' in BackgroundLoad 2025.06.18 08:40:15.239860 [ 66722 ] {} DatabaseAtomic (test): Counting attached table hits_stripelog to database test 2025.06.18 08:40:15.239895 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.rdb 2025.06.18 08:40:15.240029 [ 66722 ] {} AsyncLoader: Finish load job 'load table test.hits_stripelog' with status OK 2025.06.18 08:40:15.240117 [ 66722 ] {} AsyncLoader: Execute load job 'load table test_1.tMM' in BackgroundLoad 2025.06.18 08:40:15.240113 [ 66685 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.240177 [ 66722 ] {} DatabaseAtomic (test_1): Loading table test_1.tMM 2025.06.18 08:40:15.240378 [ 66718 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): Loading data parts 2025.06.18 08:40:15.240461 [ 66720 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.240482 [ 66684 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.240521 [ 66733 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.240584 [ 66684 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.240561 [ 66720 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.240559 [ 66732 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.240746 [ 66780 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): Loading Active part 20250618_20250618_1_1_0 from disk default 2025.06.18 08:40:15.240734 [ 66733 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.240741 [ 66718 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.240780 [ 66732 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.240897 [ 66764 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Loading Active part all_0_31_4_27 from disk default 2025.06.18 08:40:15.240911 [ 66718 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.241083 [ 66737 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): Loading Active part all_1_1_0 from disk s3_disk 2025.06.18 08:40:15.241133 [ 66782 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.241055 [ 66728 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Loading Active part all_0_0_0_18 from disk default 2025.06.18 08:40:15.241573 [ 66710 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Loading data parts 2025.06.18 08:40:15.241777 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/hsz/sozmcxqqxqirqrccacneulvogzgbv (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/columns.txt) 2025.06.18 08:40:15.241938 [ 66710 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.242011 [ 66710 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.242028 [ 66696 ] {} test_3.left (ea6622f5-2ef9-41a4-a94b-84bcd0c9490d): Loading data parts 2025.06.18 08:40:15.242179 [ 66767 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Loading Active part all_0_0_0_18 from disk default 2025.06.18 08:40:15.242354 [ 66696 ] {} test_3.left (ea6622f5-2ef9-41a4-a94b-84bcd0c9490d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.242419 [ 66696 ] {} test_3.left (ea6622f5-2ef9-41a4-a94b-84bcd0c9490d): There are no data parts 2025.06.18 08:40:15.242438 [ 66685 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.242500 [ 66685 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.242648 [ 66747 ] {} test_1.`02500_nested` (5bcdc9e7-92d0-4d79-8473-c4d015f99cd1): Loaded data parts (1 items) 2025.06.18 08:40:15.242690 [ 66696 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.242771 [ 66780 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): loadDataPart: inserting 20250618_20250618_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.242826 [ 66780 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): Finished loading Active part 20250618_20250618_1_1_0 on disk default 2025.06.18 08:40:15.243149 [ 66696 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.243219 [ 66684 ] {} test_1.tab_00481 (004e6f91-9a6f-4a4d-976d-793e9b26e69e): Loaded data parts (1 items) 2025.06.18 08:40:15.243229 [ 66696 ] {} DatabaseAtomic (test_3): Counting attached table left to database test_3 2025.06.18 08:40:15.243363 [ 66747 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.243379 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_3.left' with status OK 2025.06.18 08:40:15.243423 [ 66747 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.243510 [ 66696 ] {} AsyncLoader: Execute load job 'load table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd' in BackgroundLoad 2025.06.18 08:40:15.243673 [ 66782 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.243506 [ 66747 ] {} DatabaseAtomic (test_1): Counting attached table 02500_nested to database test_1 2025.06.18 08:40:15.243602 [ 66696 ] {} DatabaseAtomic (test_1): Loading table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd 2025.06.18 08:40:15.243728 [ 66782 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.243798 [ 66684 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.243816 [ 66738 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): Loading data parts 2025.06.18 08:40:15.243902 [ 66684 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.243907 [ 66718 ] {} test_1.test_grouping_sets_predicate (df0abbd0-5879-481d-9780-c13021774ece): Loaded data parts (1 items) 2025.06.18 08:40:15.243973 [ 66684 ] {} DatabaseAtomic (test_1): Counting attached table tab_00481 to database test_1 2025.06.18 08:40:15.243971 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_1.02500_nested' with status OK 2025.06.18 08:40:15.243992 [ 66730 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading data parts 2025.06.18 08:40:15.244074 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_1.mv' in BackgroundLoad 2025.06.18 08:40:15.244140 [ 66747 ] {} DatabaseAtomic (test_1): Loading table test_1.mv 2025.06.18 08:40:15.244156 [ 66738 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.244240 [ 66684 ] {} AsyncLoader: Finish load job 'load table test_1.tab_00481' with status OK 2025.06.18 08:40:15.244276 [ 66738 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.244323 [ 66684 ] {} AsyncLoader: Execute load job 'load table test.hits_s3' in BackgroundLoad 2025.06.18 08:40:15.244418 [ 66684 ] {} DatabaseAtomic (test): Loading table test.hits_s3 2025.06.18 08:40:15.244441 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.244461 [ 66690 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.244529 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.244556 [ 66767 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): loadDataPart: inserting all_0_0_0_18 (state Active) into data_parts_indexes 2025.06.18 08:40:15.244570 [ 66730 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.244635 [ 66767 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Finished loading Active part all_0_0_0_18 on disk default 2025.06.18 08:40:15.244650 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table test_grouping_sets_predicate to database test_1 2025.06.18 08:40:15.244572 [ 66734 ] {} test_1.m (ce1008d3-89d6-4b6c-b9d7-de2226a0d08e): Loading data parts 2025.06.18 08:40:15.244736 [ 66730 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Will load 10 parts using up to 64 threads 2025.06.18 08:40:15.244796 [ 66710 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Loaded data parts (1 items) 2025.06.18 08:40:15.244817 [ 66728 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): loadDataPart: inserting all_0_0_0_18 (state Active) into data_parts_indexes 2025.06.18 08:40:15.244910 [ 66710 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.244935 [ 66728 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Finished loading Active part all_0_0_0_18 on disk default 2025.06.18 08:40:15.244952 [ 66777 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 5_6_6_0 from disk default 2025.06.18 08:40:15.244988 [ 66734 ] {} test_1.m (ce1008d3-89d6-4b6c-b9d7-de2226a0d08e): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.244912 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.test_grouping_sets_predicate' with status OK 2025.06.18 08:40:15.245042 [ 66734 ] {} test_1.m (ce1008d3-89d6-4b6c-b9d7-de2226a0d08e): There are no data parts 2025.06.18 08:40:15.245068 [ 66786 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 9_10_10_0 from disk default 2025.06.18 08:40:15.245106 [ 66784 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 3_4_4_0 from disk default 2025.06.18 08:40:15.245111 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.03006_test' in BackgroundLoad 2025.06.18 08:40:15.245148 [ 66781 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 2_3_3_0 from disk default 2025.06.18 08:40:15.245191 [ 66728 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 8_9_9_0 from disk default 2025.06.18 08:40:15.245239 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.03006_test 2025.06.18 08:40:15.245253 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.245295 [ 66772 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 6_7_7_0 from disk default 2025.06.18 08:40:15.245351 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.245412 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table concurrent_kill_1 to database test_1 2025.06.18 08:40:15.245509 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.245559 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.concurrent_kill_1' with status OK 2025.06.18 08:40:15.245595 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.245654 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.four_rows_per_granule' in BackgroundLoad 2025.06.18 08:40:15.245706 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.four_rows_per_granule 2025.06.18 08:40:15.245711 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table m to database test_1 2025.06.18 08:40:15.245976 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.m' with status OK 2025.06.18 08:40:15.246077 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_3.t' in BackgroundLoad 2025.06.18 08:40:15.246125 [ 66734 ] {} DatabaseAtomic (test_3): Loading table test_3.t 2025.06.18 08:40:15.246338 [ 66733 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Loaded data parts (1 items) 2025.06.18 08:40:15.246364 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/bqx/inwjbnodbvygpapfzdlbrttszaevw (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/serialization.json) 2025.06.18 08:40:15.246425 [ 66733 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.246853 [ 66734 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.246924 [ 66734 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.246963 [ 66734 ] {} DatabaseAtomic (test_3): Counting attached table t to database test_3 2025.06.18 08:40:15.247064 [ 66733 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.247506 [ 66733 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.247535 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_3.t' with status OK 2025.06.18 08:40:15.247653 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_13.unit' in BackgroundLoad 2025.06.18 08:40:15.247694 [ 66734 ] {} DatabaseAtomic (test_13): Loading table test_13.unit 2025.06.18 08:40:15.247706 [ 66777 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 5_6_6_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.247757 [ 66777 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 5_6_6_0 on disk default 2025.06.18 08:40:15.247822 [ 66703 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Loading data parts 2025.06.18 08:40:15.247949 [ 66733 ] {} DatabaseAtomic (test_1): Counting attached table concurrent_kill_4 to database test_1 2025.06.18 08:40:15.248119 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_1.concurrent_kill_4' with status OK 2025.06.18 08:40:15.248222 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_3.test_mv' in BackgroundLoad 2025.06.18 08:40:15.248259 [ 66703 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.248269 [ 66733 ] {} DatabaseAtomic (test_3): Loading table test_3.test_mv 2025.06.18 08:40:15.248320 [ 66703 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Will load 4 parts using up to 64 threads 2025.06.18 08:40:15.248417 [ 66787 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 4_5_5_0 from disk default 2025.06.18 08:40:15.248527 [ 66728 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 8_9_9_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.248595 [ 66728 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 8_9_9_0 on disk default 2025.06.18 08:40:15.248714 [ 66772 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 6_7_7_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.248771 [ 66690 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.248786 [ 66772 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 6_7_7_0 on disk default 2025.06.18 08:40:15.248854 [ 66786 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 9_10_10_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.248864 [ 66690 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.248920 [ 66786 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 9_10_10_0 on disk default 2025.06.18 08:40:15.249029 [ 66784 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 3_4_4_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.249071 [ 66738 ] {} test_1.t_nested_with_dots (6e8a2cf4-90e5-4597-8e30-98babccb371b): Loaded data parts (1 items) 2025.06.18 08:40:15.249098 [ 66784 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 3_4_4_0 on disk default 2025.06.18 08:40:15.249115 [ 66781 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 2_3_3_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.249179 [ 66781 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 2_3_3_0 on disk default 2025.06.18 08:40:15.249302 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.249358 [ 66718 ] {} test_1.`03006_test` (2f95b18d-9a39-48ee-81a5-521b4c4e5a67): Loading data parts 2025.06.18 08:40:15.249466 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dwi/rcgxdskpkqfehprfaeugmypqlcrgk (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/metadata_version.txt) 2025.06.18 08:40:15.250548 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.250617 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table t_nested_with_dots to database test_1 2025.06.18 08:40:15.250692 [ 66734 ] {} DatabaseAtomic (test_13): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.250703 [ 66733 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.250750 [ 66734 ] {} DatabaseAtomic (test_13): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.250762 [ 66733 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.250773 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.t_nested_with_dots' with status OK 2025.06.18 08:40:15.250836 [ 66734 ] {} DatabaseAtomic (test_13): Counting attached table unit to database test_13 2025.06.18 08:40:15.250862 [ 66733 ] {} DatabaseAtomic (test_3): Counting attached table test_mv to database test_3 2025.06.18 08:40:15.250872 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.B1' in BackgroundLoad 2025.06.18 08:40:15.250926 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.B1 2025.06.18 08:40:15.251070 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_13.unit' with status OK 2025.06.18 08:40:15.251131 [ 66688 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 1_2_2_0 from disk default 2025.06.18 08:40:15.251170 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.table_for_concurrent_alter' in BackgroundLoad 2025.06.18 08:40:15.251182 [ 66776 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Loading Active part 19901115_0_0_0 from disk default 2025.06.18 08:40:15.251231 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.table_for_concurrent_alter 2025.06.18 08:40:15.251361 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_3.test_mv' with status OK 2025.06.18 08:40:15.251508 [ 66718 ] {} test_1.`03006_test` (2f95b18d-9a39-48ee-81a5-521b4c4e5a67): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.251502 [ 66771 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Loading Active part 19901115_1_1_0 from disk default 2025.06.18 08:40:15.251590 [ 66718 ] {} test_1.`03006_test` (2f95b18d-9a39-48ee-81a5-521b4c4e5a67): There are no data parts 2025.06.18 08:40:15.251604 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_1.t1' in BackgroundLoad 2025.06.18 08:40:15.251534 [ 66785 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Loading Active part 20201216_1_1_0 from disk default 2025.06.18 08:40:15.251669 [ 66733 ] {} DatabaseAtomic (test_1): Loading table test_1.t1 2025.06.18 08:40:15.251878 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.251931 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.251972 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qle/bwgxrylqxomuztdptjqcexagjmcdw (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/checksums.txt) 2025.06.18 08:40:15.251988 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table 03006_test to database test_1 2025.06.18 08:40:15.252052 [ 66787 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 4_5_5_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.252122 [ 66787 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 4_5_5_0 on disk default 2025.06.18 08:40:15.252178 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.03006_test' with status OK 2025.06.18 08:40:15.252234 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_3.pipe_01019' in BackgroundLoad 2025.06.18 08:40:15.252300 [ 66718 ] {} DatabaseAtomic (test_3): Loading table test_3.pipe_01019 2025.06.18 08:40:15.252500 [ 66750 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Loading Active part 20201216_0_0_0 from disk default 2025.06.18 08:40:15.252889 [ 66718 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.252935 [ 66718 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.252979 [ 66718 ] {} DatabaseAtomic (test_3): Counting attached table pipe_01019 to database test_3 2025.06.18 08:40:15.253488 [ 66688 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 1_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.253574 [ 66688 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 1_2_2_0 on disk default 2025.06.18 08:40:15.253647 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_3.pipe_01019' with status OK 2025.06.18 08:40:15.253738 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_1.country_polygons' in BackgroundLoad 2025.06.18 08:40:15.253788 [ 66718 ] {} DatabaseAtomic (test_1): Loading table test_1.country_polygons 2025.06.18 08:40:15.254109 [ 66785 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): loadDataPart: inserting 20201216_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.254167 [ 66785 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Finished loading Active part 20201216_1_1_0 on disk default 2025.06.18 08:40:15.254224 [ 66776 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): loadDataPart: inserting 19901115_0_0_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.254292 [ 66776 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Finished loading Active part 19901115_0_0_0 on disk default 2025.06.18 08:40:15.254369 [ 66710 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): Loading data parts 2025.06.18 08:40:15.254648 [ 66710 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.254712 [ 66710 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.254797 [ 66771 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): loadDataPart: inserting 19901115_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.254864 [ 66771 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Finished loading Active part 19901115_1_1_0 on disk default 2025.06.18 08:40:15.254856 [ 66711 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): Loading Active part 201805_1_5_2 from disk default 2025.06.18 08:40:15.255079 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ceu/kunrwnuiuekawqvisfpbkaqdeonqj (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/data.cmrk3) 2025.06.18 08:40:15.255484 [ 66750 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): loadDataPart: inserting 20201216_0_0_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.255604 [ 66750 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Finished loading Active part 20201216_0_0_0 on disk default 2025.06.18 08:40:15.255806 [ 66703 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Loaded data parts (4 items) 2025.06.18 08:40:15.255900 [ 66703 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.256276 [ 66703 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.256321 [ 66703 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.256373 [ 66703 ] {} DatabaseAtomic (test_1): Counting attached table quorum1 to database test_1 2025.06.18 08:40:15.256456 [ 66778 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 7_8_8_0 from disk default 2025.06.18 08:40:15.256468 [ 66769 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loading Active part 0_1_1_0 from disk default 2025.06.18 08:40:15.256526 [ 66703 ] {} AsyncLoader: Finish load job 'load table test_1.quorum1' with status OK 2025.06.18 08:40:15.256848 [ 66738 ] {} test_1.B1 (3277ed1e-eee9-42d1-ba5f-f56281894824): Loading data parts 2025.06.18 08:40:15.256905 [ 66703 ] {} AsyncLoader: Execute load job 'load table test.visits' in BackgroundLoad 2025.06.18 08:40:15.257031 [ 66703 ] {} DatabaseAtomic (test): Loading table test.visits 2025.06.18 08:40:15.257145 [ 66734 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): Loading data parts 2025.06.18 08:40:15.257170 [ 66738 ] {} test_1.B1 (3277ed1e-eee9-42d1-ba5f-f56281894824): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.257223 [ 66738 ] {} test_1.B1 (3277ed1e-eee9-42d1-ba5f-f56281894824): There are no data parts 2025.06.18 08:40:15.257382 [ 66734 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.257438 [ 66734 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.257551 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.257566 [ 66782 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): Loading Active part all_1_49_43 from disk default 2025.06.18 08:40:15.257665 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.257726 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table B1 to database test_1 2025.06.18 08:40:15.257827 [ 66733 ] {} test_1.t1 (94f83ce1-6134-4a4c-8825-6bac0c248bd2): Loading data parts 2025.06.18 08:40:15.257862 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.B1' with status OK 2025.06.18 08:40:15.257938 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_3.t1' in BackgroundLoad 2025.06.18 08:40:15.258013 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ufb/saopapepwxnotzekaooszmxjpnugy (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/count.txt) 2025.06.18 08:40:15.258384 [ 66733 ] {} test_1.t1 (94f83ce1-6134-4a4c-8825-6bac0c248bd2): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.258444 [ 66733 ] {} test_1.t1 (94f83ce1-6134-4a4c-8825-6bac0c248bd2): There are no data parts 2025.06.18 08:40:15.258618 [ 66738 ] {} DatabaseAtomic (test_3): Loading table test_3.t1 2025.06.18 08:40:15.258821 [ 66733 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.258891 [ 66733 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.258939 [ 66733 ] {} DatabaseAtomic (test_1): Counting attached table t1 to database test_1 2025.06.18 08:40:15.259038 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_1.t1' with status OK 2025.06.18 08:40:15.259404 [ 66769 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 0_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.259465 [ 66769 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 0_1_1_0 on disk default 2025.06.18 08:40:15.259571 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_1.data2015' in BackgroundLoad 2025.06.18 08:40:15.259605 [ 66711 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): loadDataPart: inserting 201805_1_5_2 (state Active) into data_parts_indexes 2025.06.18 08:40:15.259627 [ 66733 ] {} DatabaseAtomic (test_1): Loading table test_1.data2015 2025.06.18 08:40:15.259665 [ 66711 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): Finished loading Active part 201805_1_5_2 on disk default 2025.06.18 08:40:15.259774 [ 66710 ] {} test_1.four_rows_per_granule (e44e784f-be91-4d21-b5f1-b555ee3d9a1b): Loaded data parts (1 items) 2025.06.18 08:40:15.259798 [ 66718 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): Loading data parts 2025.06.18 08:40:15.259846 [ 66733 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.259898 [ 66733 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.259943 [ 66733 ] {} DatabaseAtomic (test_1): Counting attached table data2015 to database test_1 2025.06.18 08:40:15.260054 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_1.data2015' with status OK 2025.06.18 08:40:15.260102 [ 66718 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.260114 [ 66733 ] {} AsyncLoader: Execute load job 'load table test_3.stored_aggregates' in BackgroundLoad 2025.06.18 08:40:15.260175 [ 66718 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.260176 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.260302 [ 66733 ] {} DatabaseAtomic (test_3): Loading table test_3.stored_aggregates 2025.06.18 08:40:15.260331 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.260417 [ 66767 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.260432 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table four_rows_per_granule to database test_1 2025.06.18 08:40:15.260631 [ 66778 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): loadDataPart: inserting 7_8_8_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.260687 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.four_rows_per_granule' with status OK 2025.06.18 08:40:15.260701 [ 66778 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Finished loading Active part 7_8_8_0 on disk default 2025.06.18 08:40:15.260755 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.products' in BackgroundLoad 2025.06.18 08:40:15.260805 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.products 2025.06.18 08:40:15.260900 [ 66730 ] {} test_1.data_01882 (c7b032ac-c02f-4b10-b655-9460dc5cf23b): Loaded data parts (10 items) 2025.06.18 08:40:15.260942 [ 66782 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): loadDataPart: inserting all_1_49_43 (state Active) into data_parts_indexes 2025.06.18 08:40:15.261029 [ 66782 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): Finished loading Active part all_1_49_43 on disk default 2025.06.18 08:40:15.261052 [ 66737 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ukl/lxotiualzfhsjzwwvrqshrckibuan (store/eff/effb371c-2343-4843-ab53-795fba018263/all_1_1_0/default_compression_codec.txt) 2025.06.18 08:40:15.261087 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.261127 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.261162 [ 66734 ] {} test_1.table_for_concurrent_alter (2391dc3c-9059-4593-b53f-c04891b8b833): Loaded data parts (1 items) 2025.06.18 08:40:15.261178 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table products to database test_1 2025.06.18 08:40:15.261301 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.products' with status OK 2025.06.18 08:40:15.261358 [ 66730 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.261391 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.testJoinTable' in BackgroundLoad 2025.06.18 08:40:15.261411 [ 66730 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.261442 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.testJoinTable 2025.06.18 08:40:15.261482 [ 66730 ] {} DatabaseAtomic (test_1): Counting attached table data_01882 to database test_1 2025.06.18 08:40:15.261569 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.261644 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.261657 [ 66730 ] {} AsyncLoader: Finish load job 'load table test_1.data_01882' with status OK 2025.06.18 08:40:15.261708 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table table_for_concurrent_alter to database test_1 2025.06.18 08:40:15.261754 [ 66710 ] {} HashJoin: Keys: [() = (number)], datatype: EMPTY, kind: Inner, strictness: RightAny, right header: number UInt64 UInt64(size = 0), data String String(size = 0) 2025.06.18 08:40:15.261764 [ 66730 ] {} AsyncLoader: Execute load job 'load table test.merge_hits' in BackgroundLoad 2025.06.18 08:40:15.261880 [ 66730 ] {} DatabaseAtomic (test): Loading table test.merge_hits 2025.06.18 08:40:15.261976 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.table_for_concurrent_alter' with status OK 2025.06.18 08:40:15.262051 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.test_table_comment' in BackgroundLoad 2025.06.18 08:40:15.262096 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.test_table_comment 2025.06.18 08:40:15.262373 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.262421 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.262500 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table test_table_comment to database test_1 2025.06.18 08:40:15.262507 [ 66710 ] {} StorageSetOrJoinBase: Loaded from backup file store/644/64450d95-ea2e-439f-859c-8fe0cc22fe8d/1.bin. 3 rows, 54.00 B. State has 3 unique rows. 2025.06.18 08:40:15.262628 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.test_table_comment' with status OK 2025.06.18 08:40:15.262666 [ 66710 ] {} HashJoin: Shrinking stored blocks, memory consumption is 14.25 KiB calculated by join, 0.00 B by memory tracker 2025.06.18 08:40:15.262705 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.clickhouse_alias_issue_1' in BackgroundLoad 2025.06.18 08:40:15.262772 [ 66710 ] {} HashJoin: Shrunk stored blocks 7.97 KiB freed (0.00 B by memory tracker), new memory consumption is 6.28 KiB (1.53 GiB by memory tracker) 2025.06.18 08:40:15.262780 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.clickhouse_alias_issue_1 2025.06.18 08:40:15.262908 [ 66710 ] {} StorageJoin: Optimized Join storage from 14592 to 6429 bytes 2025.06.18 08:40:15.263010 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.263066 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.263068 [ 66738 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): Loading data parts 2025.06.18 08:40:15.263163 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table testJoinTable to database test_1 2025.06.18 08:40:15.263276 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.263341 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.263348 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.testJoinTable' with status OK 2025.06.18 08:40:15.263409 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table clickhouse_alias_issue_1 to database test_1 2025.06.18 08:40:15.263434 [ 66710 ] {} AsyncLoader: Execute load job 'load table test_1.regexp_dict3' in BackgroundLoad 2025.06.18 08:40:15.263409 [ 66738 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.263454 [ 66737 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.263523 [ 66710 ] {} DatabaseAtomic (test_1): Loading table test_1.regexp_dict3 2025.06.18 08:40:15.263556 [ 66738 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.263578 [ 66737 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): Finished loading Active part all_1_1_0 on disk s3_disk 2025.06.18 08:40:15.263618 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.clickhouse_alias_issue_1' with status OK 2025.06.18 08:40:15.263587 [ 66767 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.263698 [ 66734 ] {} AsyncLoader: Execute load job 'load table test_1.broken_table' in BackgroundLoad 2025.06.18 08:40:15.263724 [ 66767 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.263752 [ 66779 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.263760 [ 66732 ] {} test_1.data (effb371c-2343-4843-ab53-795fba018263): Loaded data parts (1 items) 2025.06.18 08:40:15.263778 [ 66734 ] {} DatabaseAtomic (test_1): Loading table test_1.broken_table 2025.06.18 08:40:15.263879 [ 66718 ] {} test_1.country_polygons (3379a19b-368b-41d4-ba40-91d7bb41c30d): Loaded data parts (1 items) 2025.06.18 08:40:15.264282 [ 66732 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.264353 [ 66732 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.264431 [ 66732 ] {} DatabaseAtomic (test_1): Counting attached table data to database test_1 2025.06.18 08:40:15.264508 [ 66718 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.264571 [ 66718 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.264584 [ 66732 ] {} AsyncLoader: Finish load job 'load table test_1.data' with status OK 2025.06.18 08:40:15.264665 [ 66718 ] {} DatabaseAtomic (test_1): Counting attached table country_polygons to database test_1 2025.06.18 08:40:15.264732 [ 66732 ] {} AsyncLoader: Execute load job 'load table test.avro' in BackgroundLoad 2025.06.18 08:40:15.264826 [ 66732 ] {} DatabaseAtomic (test): Loading table test.avro 2025.06.18 08:40:15.264900 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_1.country_polygons' with status OK 2025.06.18 08:40:15.265028 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_3.vt' in BackgroundLoad 2025.06.18 08:40:15.265087 [ 66718 ] {} DatabaseAtomic (test_3): Loading table test_3.vt 2025.06.18 08:40:15.266221 [ 66779 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.266329 [ 66779 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.266504 [ 66738 ] {} test_3.t1 (21f74c84-92ec-444f-bda8-61babf9794c4): Loaded data parts (1 items) 2025.06.18 08:40:15.266830 [ 66738 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.266896 [ 66738 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.266958 [ 66738 ] {} DatabaseAtomic (test_3): Counting attached table t1 to database test_3 2025.06.18 08:40:15.267122 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_3.t1' with status OK 2025.06.18 08:40:15.267258 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_i227bf47.test_table' in BackgroundLoad 2025.06.18 08:40:15.267313 [ 66738 ] {} DatabaseAtomic (test_i227bf47): Loading table test_i227bf47.test_table 2025.06.18 08:40:15.267690 [ 66733 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): Loading data parts 2025.06.18 08:40:15.267879 [ 66738 ] {} DatabaseAtomic (test_i227bf47): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.267936 [ 66738 ] {} DatabaseAtomic (test_i227bf47): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.268017 [ 66738 ] {} DatabaseAtomic (test_i227bf47): Counting attached table test_table to database test_i227bf47 2025.06.18 08:40:15.268063 [ 66733 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.268121 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_i227bf47.test_table' with status OK 2025.06.18 08:40:15.268134 [ 66733 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): Will load 1 parts using up to 64 threads 2025.06.18 08:40:15.268220 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.rmt1' in BackgroundLoad 2025.06.18 08:40:15.268289 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.rmt1 2025.06.18 08:40:15.268308 [ 66765 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): Loading Active part 20140601_20140601_1_1_0 from disk default 2025.06.18 08:40:15.273458 [ 66765 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): loadDataPart: inserting 20140601_20140601_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.273505 [ 66738 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gxm/drffklaobijwxbsywiieenttzzwyy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/format_version.txt) 2025.06.18 08:40:15.273535 [ 66765 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): Finished loading Active part 20140601_20140601_1_1_0 on disk default 2025.06.18 08:40:15.273660 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Reset state for seek to position 0 2025.06.18 08:40:15.273721 [ 66733 ] {} test_3.stored_aggregates (523f6e1a-5a58-467a-b89f-5591ee9326cc): Loaded data parts (1 items) 2025.06.18 08:40:15.273864 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.273915 [ 66738 ] {} FileSegment(8271fc1f0c2104c56aea21c05ff68a92) : [0, 0]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.274053 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 8271fc1f0c2104c56aea21c05ff68a92, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:BackgroundLoad:66738, current write offset: 0, caller id: None:BackgroundLoad:66738, kind: Regular, unbound: 0 2025.06.18 08:40:15.274148 [ 66733 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.274163 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 8271fc1f0c2104c56aea21c05ff68a92, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:BackgroundLoad:66738, current write offset: 0, caller id: None:BackgroundLoad:66738, kind: Regular, unbound: 0 2025.06.18 08:40:15.274205 [ 66733 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.274248 [ 66738 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/gxm/drffklaobijwxbsywiieenttzzwyy, Version: Latest, Range: 0-0 2025.06.18 08:40:15.274268 [ 66733 ] {} DatabaseAtomic (test_3): Counting attached table stored_aggregates to database test_3 2025.06.18 08:40:15.274487 [ 66733 ] {} AsyncLoader: Finish load job 'load table test_3.stored_aggregates' with status OK 2025.06.18 08:40:15.274703 [ 66733 ] {} AsyncLoader: Execute load job 'load table test.hits' in BackgroundLoad 2025.06.18 08:40:15.274826 [ 66733 ] {} DatabaseAtomic (test): Loading table test.hits 2025.06.18 08:40:15.276985 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Read 1 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.277076 [ 66738 ] {} FileCache(s3_cache): Trying to reserve space (1 bytes) for 8271fc1f0c2104c56aea21c05ff68a92:0, current usage: size: 1618/104857600, elements: 23/10000000 (description: s3_cache) 2025.06.18 08:40:15.277276 [ 66738 ] {} LRUFileCachePriority(s3_cache): Updating size with 1, current is 1618 2025.06.18 08:40:15.277338 [ 66738 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 8271fc1f0c2104c56aea21c05ff68a92, offset: 0, size: 1 2025.06.18 08:40:15.277474 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Successfully written 1 bytes 2025.06.18 08:40:15.277526 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.277614 [ 66738 ] {} FileSegment(8271fc1f0c2104c56aea21c05ff68a92) : [0, 0]: Resetting downloader from None:BackgroundLoad:66738 2025.06.18 08:40:15.277683 [ 66738 ] {} FileSegment(8271fc1f0c2104c56aea21c05ff68a92) : [0, 0]: Complete batch. (File segment: [0, 0], key: 8271fc1f0c2104c56aea21c05ff68a92, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:BackgroundLoad:66738, kind: Regular, unbound: 0) 2025.06.18 08:40:15.277770 [ 66738 ] {} CachedOnDiskReadBufferFromFile(8271fc1f0c2104c56aea21c05ff68a92): Key: 8271fc1f0c2104c56aea21c05ff68a92. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.280958 [ 66738 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loading data parts 2025.06.18 08:40:15.285792 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/executable_dictionary.xml'. 2025.06.18 08:40:15.287786 [ 66738 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.287862 [ 66738 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.288058 [ 66772 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loading Active part all_2_2_0 from disk s3_disk 2025.06.18 08:40:15.288120 [ 66690 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loading Active part all_1_1_0 from disk s3_disk 2025.06.18 08:40:15.288709 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/columns.txt) 2025.06.18 08:40:15.288816 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:15.288923 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.288967 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/columns.txt) 2025.06.18 08:40:15.289562 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:15.289608 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.289721 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.289775 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.289909 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.289939 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.289959 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.290054 [ 66772 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.290081 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.290188 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.290240 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.290335 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.290509 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/serialization.json) 2025.06.18 08:40:15.290769 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:15.290845 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.290992 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.291086 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.291153 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.291192 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.291236 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/serialization.json) 2025.06.18 08:40:15.291260 [ 66772 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.291366 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:15.291490 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.291694 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.291834 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.291879 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/metadata_version.txt) 2025.06.18 08:40:15.291956 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.292001 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:15.292019 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.292091 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.292128 [ 66690 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.292294 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.292405 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.292472 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.292508 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.292589 [ 66772 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.292844 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/metadata_version.txt) 2025.06.18 08:40:15.293006 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vdm/cmsvqepzepitvzeybuvfswesbwerj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/checksums.txt) 2025.06.18 08:40:15.293097 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/executable_dictionary.xml'. 2025.06.18 08:40:15.293139 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:15.293154 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Reset state for seek to position 0 2025.06.18 08:40:15.293247 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.293310 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.293388 [ 66772 ] {} FileSegment(0a5f6e97d869a55ee23d05ce99d3ba48) : [0, 275]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.293440 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.293528 [ 65992 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/executable_pool_dictionary.xml'. 2025.06.18 08:40:15.293554 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0a5f6e97d869a55ee23d05ce99d3ba48, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66772, current write offset: 0, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.293592 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.293667 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0a5f6e97d869a55ee23d05ce99d3ba48, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66772, current write offset: 0, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.293753 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.293774 [ 66772 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/vdm/cmsvqepzepitvzeybuvfswesbwerj, Version: Latest, Range: 0-275 2025.06.18 08:40:15.293898 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.294038 [ 66690 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.295084 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/mnz/ugvpbhbbqoaybfpvtrhegkajmksvc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/checksums.txt) 2025.06.18 08:40:15.295254 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Reset state for seek to position 0 2025.06.18 08:40:15.295615 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.295745 [ 66690 ] {} FileSegment(0edfebc1f412dec964d991b0ea77bbf0) : [0, 275]: Updated state from EMPTY to DOWNLOADING 2025.06.18 08:40:15.295995 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0edfebc1f412dec964d991b0ea77bbf0, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66690, current write offset: 0, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.296220 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Current read type: REMOTE_FS_READ_AND_PUT_IN_CACHE, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0edfebc1f412dec964d991b0ea77bbf0, state: DOWNLOADING, downloaded size: 0, reserved size: 0, downloader id: None:ActiveParts:66690, current write offset: 0, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.296393 [ 66690 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/mnz/ugvpbhbbqoaybfpvtrhegkajmksvc, Version: Latest, Range: 0-275 2025.06.18 08:40:15.297199 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Read 276 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.297321 [ 66772 ] {} FileCache(s3_cache): Trying to reserve space (276 bytes) for 0a5f6e97d869a55ee23d05ce99d3ba48:0, current usage: size: 1619/104857600, elements: 24/10000000 (description: s3_cache) 2025.06.18 08:40:15.297572 [ 66772 ] {} LRUFileCachePriority(s3_cache): Updating size with 276, current is 1619 2025.06.18 08:40:15.297644 [ 66772 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 0a5f6e97d869a55ee23d05ce99d3ba48, offset: 0, size: 276 2025.06.18 08:40:15.297860 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Successfully written 276 bytes 2025.06.18 08:40:15.297919 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.298095 [ 66772 ] {} FileSegment(0a5f6e97d869a55ee23d05ce99d3ba48) : [0, 275]: Resetting downloader from None:ActiveParts:66772 2025.06.18 08:40:15.298194 [ 66772 ] {} FileSegment(0a5f6e97d869a55ee23d05ce99d3ba48) : [0, 275]: Complete batch. (File segment: [0, 275], key: 0a5f6e97d869a55ee23d05ce99d3ba48, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0) 2025.06.18 08:40:15.298346 [ 66772 ] {} CachedOnDiskReadBufferFromFile(0a5f6e97d869a55ee23d05ce99d3ba48): Key: 0a5f6e97d869a55ee23d05ce99d3ba48. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.299172 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/n.cmrk2) 2025.06.18 08:40:15.299631 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:15.299735 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.299945 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.300078 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.300187 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.300242 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.300391 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.301061 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Read 276 bytes, read type REMOTE_FS_READ_AND_PUT_IN_CACHE, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.301206 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/count.txt) 2025.06.18 08:40:15.301228 [ 66690 ] {} FileCache(s3_cache): Trying to reserve space (276 bytes) for 0edfebc1f412dec964d991b0ea77bbf0:0, current usage: size: 1895/104857600, elements: 25/10000000 (description: s3_cache) 2025.06.18 08:40:15.301300 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:15.301414 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.301590 [ 66690 ] {} LRUFileCachePriority(s3_cache): Updating size with 276, current is 1895 2025.06.18 08:40:15.301612 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.301678 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.301724 [ 66690 ] {} LRUFileCachePriority(s3_cache): Added entry into LRU queue, key: 0edfebc1f412dec964d991b0ea77bbf0, offset: 0, size: 276 2025.06.18 08:40:15.301756 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.301808 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.301877 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table rdb to database test_1 2025.06.18 08:40:15.301960 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.302015 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.rdb' with status OK 2025.06.18 08:40:15.302039 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.302093 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.bad_arrays' in BackgroundLoad 2025.06.18 08:40:15.302096 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Successfully written 276 bytes 2025.06.18 08:40:15.302142 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.bad_arrays 2025.06.18 08:40:15.302162 [ 66772 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.302202 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.302346 [ 66690 ] {} FileSegment(0edfebc1f412dec964d991b0ea77bbf0) : [0, 275]: Resetting downloader from None:ActiveParts:66690 2025.06.18 08:40:15.302473 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.302473 [ 66690 ] {} FileSegment(0edfebc1f412dec964d991b0ea77bbf0) : [0, 275]: Complete batch. (File segment: [0, 275], key: 0edfebc1f412dec964d991b0ea77bbf0, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0) 2025.06.18 08:40:15.302557 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.302620 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table bad_arrays to database test_1 2025.06.18 08:40:15.302689 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0edfebc1f412dec964d991b0ea77bbf0): Key: 0edfebc1f412dec964d991b0ea77bbf0. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.302770 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.bad_arrays' with status OK 2025.06.18 08:40:15.302843 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.table_default_protobuf_00825' in BackgroundLoad 2025.06.18 08:40:15.302886 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.table_default_protobuf_00825 2025.06.18 08:40:15.303766 [ 66772 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0/default_compression_codec.txt) 2025.06.18 08:40:15.303880 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:15.304004 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.304002 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/n.cmrk2) 2025.06.18 08:40:15.304162 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.304287 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:15.304380 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66772, kind: Regular, unbound: 0 2025.06.18 08:40:15.304444 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.304469 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.304577 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.304653 [ 66772 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.304779 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.304936 [ 66772 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.305003 [ 66772 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Finished loading Active part all_2_2_0 on disk s3_disk 2025.06.18 08:40:15.305004 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.305168 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.305379 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.305531 [ 66690 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.306851 [ 66729 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Loading data parts 2025.06.18 08:40:15.306942 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/count.txt) 2025.06.18 08:40:15.307112 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:15.307209 [ 66729 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.307285 [ 66729 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Will load 2 parts using up to 64 threads 2025.06.18 08:40:15.307286 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.307514 [ 66784 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Loading Active part all_2_2_0 from disk default 2025.06.18 08:40:15.307535 [ 66781 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.307571 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.307773 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.307912 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.307993 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.308126 [ 66690 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.310307 [ 66690 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0/default_compression_codec.txt) 2025.06.18 08:40:15.310508 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:15.310691 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.310984 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.311088 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:ActiveParts:66690, kind: Regular, unbound: 0 2025.06.18 08:40:15.311171 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.311214 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.311282 [ 66690 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.311562 [ 66690 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.311619 [ 66690 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Finished loading Active part all_1_1_0 on disk s3_disk 2025.06.18 08:40:15.311642 [ 66784 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.311733 [ 66784 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Finished loading Active part all_2_2_0 on disk default 2025.06.18 08:40:15.311793 [ 66738 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 2 unexpected data parts. They will be loaded asynchronously 2025.06.18 08:40:15.311909 [ 66738 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loaded data parts (2 items) 2025.06.18 08:40:15.312011 [ 66738 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.312316 [ 66781 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.312403 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.312418 [ 66781 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.312491 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.312594 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table rmt1 to database test_1 2025.06.18 08:40:15.312637 [ 66729 ] {} test_1.table_default_protobuf_00825 (9cdd08ff-aca7-4824-b191-fd9674545e38): Loaded data parts (2 items) 2025.06.18 08:40:15.312800 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.rmt1' with status OK 2025.06.18 08:40:15.312904 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_qcf18570.realtimedrep' in BackgroundLoad 2025.06.18 08:40:15.312986 [ 66738 ] {} DatabaseAtomic (test_qcf18570): Loading table test_qcf18570.realtimedrep 2025.06.18 08:40:15.313126 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.313185 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.313253 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table table_default_protobuf_00825 to database test_1 2025.06.18 08:40:15.313481 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.table_default_protobuf_00825' with status OK 2025.06.18 08:40:15.313597 [ 66729 ] {} AsyncLoader: Execute load job 'load table test_1.regexp_dict1' in BackgroundLoad 2025.06.18 08:40:15.313650 [ 66729 ] {} DatabaseAtomic (test_1): Loading table test_1.regexp_dict1 2025.06.18 08:40:15.317190 [ 66738 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Loading data parts 2025.06.18 08:40:15.317684 [ 66738 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.317777 [ 66738 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.318107 [ 66688 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Loading Active part all_2_2_0 from disk default 2025.06.18 08:40:15.318107 [ 66787 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Loading Active part all_3_3_0 from disk default 2025.06.18 08:40:15.318370 [ 66785 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Loading Active part all_1_1_0 from disk default 2025.06.18 08:40:15.320482 [ 66688 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): loadDataPart: inserting all_2_2_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.320604 [ 66688 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Finished loading Active part all_2_2_0 on disk default 2025.06.18 08:40:15.320629 [ 66787 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): loadDataPart: inserting all_3_3_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.320746 [ 66787 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Finished loading Active part all_3_3_0 on disk default 2025.06.18 08:40:15.320804 [ 66785 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): loadDataPart: inserting all_1_1_0 (state Active) into data_parts_indexes 2025.06.18 08:40:15.320967 [ 66785 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Finished loading Active part all_1_1_0 on disk default 2025.06.18 08:40:15.321183 [ 66738 ] {} test_qcf18570.realtimedrep (0e8b7932-03f1-4c7a-953c-c1974545a896): Loaded data parts (3 items) 2025.06.18 08:40:15.321572 [ 66738 ] {} DatabaseAtomic (test_qcf18570): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.321624 [ 66738 ] {} DatabaseAtomic (test_qcf18570): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.321686 [ 66738 ] {} DatabaseAtomic (test_qcf18570): Counting attached table realtimedrep to database test_qcf18570 2025.06.18 08:40:15.321802 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_qcf18570.realtimedrep' with status OK 2025.06.18 08:40:15.321930 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.rng' in BackgroundLoad 2025.06.18 08:40:15.322046 [ 66718 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.322078 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.rng 2025.06.18 08:40:15.322134 [ 66718 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.322223 [ 66718 ] {} DatabaseAtomic (test_3): Counting attached table vt to database test_3 2025.06.18 08:40:15.322327 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_3.vt' with status OK 2025.06.18 08:40:15.322409 [ 66718 ] {} AsyncLoader: Execute load job 'load table test_3.dict' in BackgroundLoad 2025.06.18 08:40:15.322649 [ 66718 ] {} DatabaseAtomic (test_3): Loading table test_3.dict 2025.06.18 08:40:15.322793 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.322868 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.322928 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table rng to database test_1 2025.06.18 08:40:15.322999 [ 66747 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.323068 [ 66747 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.323109 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.rng' with status OK 2025.06.18 08:40:15.323174 [ 66747 ] {} DatabaseAtomic (test_1): Counting attached table mv to database test_1 2025.06.18 08:40:15.323189 [ 66738 ] {} AsyncLoader: Execute load job 'load table test_1.ssd_cache_dictionary' in BackgroundLoad 2025.06.18 08:40:15.323285 [ 66738 ] {} DatabaseAtomic (test_1): Loading table test_1.ssd_cache_dictionary 2025.06.18 08:40:15.323417 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_1.mv' with status OK 2025.06.18 08:40:15.323503 [ 66747 ] {} AsyncLoader: Execute load job 'load table test_1.dict' in BackgroundLoad 2025.06.18 08:40:15.323600 [ 66747 ] {} DatabaseAtomic (test_1): Loading table test_1.dict 2025.06.18 08:40:15.325570 [ 66722 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Loading data parts 2025.06.18 08:40:15.325922 [ 66722 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.325976 [ 66722 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Will load 3 parts using up to 64 threads 2025.06.18 08:40:15.326149 [ 66776 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Loading Active part 202008_1_2_1 from disk default 2025.06.18 08:40:15.326287 [ 66750 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Loading Active part 202009_3_4_1 from disk default 2025.06.18 08:40:15.326305 [ 66771 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Loading Active part 202010_5_6_1 from disk default 2025.06.18 08:40:15.327176 [ 66764 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): loadDataPart: inserting all_0_31_4_27 (state Active) into data_parts_indexes 2025.06.18 08:40:15.327259 [ 66764 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Finished loading Active part all_0_31_4_27 on disk default 2025.06.18 08:40:15.327421 [ 66720 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Loaded data parts (1 items) 2025.06.18 08:40:15.327517 [ 66720 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Table will be in readonly mode until initialization is finished 2025.06.18 08:40:15.327650 [ 66696 ] {} test_1.`.inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd` (2fcf08ac-fb11-4ff5-b164-0aa0f97fae3d): Loading data parts 2025.06.18 08:40:15.327964 [ 66720 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.327993 [ 66696 ] {} test_1.`.inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd` (2fcf08ac-fb11-4ff5-b164-0aa0f97fae3d): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.328029 [ 66720 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.328063 [ 66696 ] {} test_1.`.inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd` (2fcf08ac-fb11-4ff5-b164-0aa0f97fae3d): There are no data parts 2025.06.18 08:40:15.328090 [ 66720 ] {} DatabaseAtomic (test_1): Counting attached table t_rename_alter to database test_1 2025.06.18 08:40:15.328275 [ 66720 ] {} AsyncLoader: Finish load job 'load table test_1.t_rename_alter' with status OK 2025.06.18 08:40:15.328382 [ 66720 ] {} AsyncLoader: Execute load job 'load table test_i227bf47.test_dictionary' in BackgroundLoad 2025.06.18 08:40:15.328409 [ 66696 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.328434 [ 66720 ] {} DatabaseAtomic (test_i227bf47): Loading table test_i227bf47.test_dictionary 2025.06.18 08:40:15.328474 [ 66696 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.328561 [ 66696 ] {} DatabaseAtomic (test_1): Counting attached table .inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd to database test_1 2025.06.18 08:40:15.328731 [ 66696 ] {} AsyncLoader: Finish load job 'load table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd' with status OK 2025.06.18 08:40:15.328758 [ 66732 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.328912 [ 66732 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.328971 [ 66732 ] {} DatabaseAtomic (test): Counting attached table avro to database test 2025.06.18 08:40:15.329053 [ 66734 ] {} test_1.broken_table (bae2a5f3-7da9-457d-bd1b-0204be00a5a2): Loading data parts 2025.06.18 08:40:15.329107 [ 66750 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): loadDataPart: inserting 202009_3_4_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.329141 [ 66696 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.329183 [ 66750 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Finished loading Active part 202009_3_4_1 on disk default 2025.06.18 08:40:15.329217 [ 66776 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): loadDataPart: inserting 202008_1_2_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.329296 [ 66776 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Finished loading Active part 202008_1_2_1 on disk default 2025.06.18 08:40:15.329419 [ 66734 ] {} test_1.broken_table (bae2a5f3-7da9-457d-bd1b-0204be00a5a2): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.329512 [ 66734 ] {} test_1.broken_table (bae2a5f3-7da9-457d-bd1b-0204be00a5a2): There are no data parts 2025.06.18 08:40:15.329632 [ 66730 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.329705 [ 66730 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.329724 [ 66732 ] {} AsyncLoader: Finish load job 'load table test.avro' with status OK 2025.06.18 08:40:15.329787 [ 66730 ] {} DatabaseAtomic (test): Counting attached table merge_hits to database test 2025.06.18 08:40:15.329843 [ 66732 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.329978 [ 66734 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.330063 [ 66734 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.330153 [ 66734 ] {} DatabaseAtomic (test_1): Counting attached table broken_table to database test_1 2025.06.18 08:40:15.330582 [ 66730 ] {} AsyncLoader: Finish load job 'load table test.merge_hits' with status OK 2025.06.18 08:40:15.330683 [ 66730 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.331013 [ 66734 ] {} AsyncLoader: Finish load job 'load table test_1.broken_table' with status OK 2025.06.18 08:40:15.331127 [ 66734 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.331177 [ 66771 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): loadDataPart: inserting 202010_5_6_1 (state Active) into data_parts_indexes 2025.06.18 08:40:15.331323 [ 66771 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Finished loading Active part 202010_5_6_1 on disk default 2025.06.18 08:40:15.331548 [ 66722 ] {} test_1.tMM (7ae99d38-2451-4638-9a4b-ee1c1df29677): Loaded data parts (3 items) 2025.06.18 08:40:15.331892 [ 66722 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.331966 [ 66722 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.332023 [ 66722 ] {} DatabaseAtomic (test_1): Counting attached table tMM to database test_1 2025.06.18 08:40:15.332123 [ 66722 ] {} AsyncLoader: Finish load job 'load table test_1.tMM' with status OK 2025.06.18 08:40:15.332176 [ 66722 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.335400 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/executable_pool_dictionary.xml'. 2025.06.18 08:40:15.339092 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/executable_pool_dictionary.xml'. 2025.06.18 08:40:15.339380 [ 65992 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/ints_dictionary.xml'. 2025.06.18 08:40:15.341789 [ 66684 ] {} test.hits_s3 (8bde374e-b6de-4b56-aed1-505114fff278): Loading data parts 2025.06.18 08:40:15.342174 [ 66684 ] {} test.hits_s3 (8bde374e-b6de-4b56-aed1-505114fff278): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.342243 [ 66684 ] {} test.hits_s3 (8bde374e-b6de-4b56-aed1-505114fff278): There are no data parts 2025.06.18 08:40:15.342886 [ 66684 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.342938 [ 66684 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.343019 [ 66684 ] {} DatabaseAtomic (test): Counting attached table hits_s3 to database test 2025.06.18 08:40:15.343617 [ 66684 ] {} AsyncLoader: Finish load job 'load table test.hits_s3' with status OK 2025.06.18 08:40:15.343684 [ 66684 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.352285 [ 66733 ] {} test.hits (09d4a45e-c04d-4ec3-9037-2dba9f62337f): Loading data parts 2025.06.18 08:40:15.352667 [ 66733 ] {} test.hits (09d4a45e-c04d-4ec3-9037-2dba9f62337f): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.352746 [ 66733 ] {} test.hits (09d4a45e-c04d-4ec3-9037-2dba9f62337f): There are no data parts 2025.06.18 08:40:15.353547 [ 66733 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.353627 [ 66733 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.353702 [ 66733 ] {} DatabaseAtomic (test): Counting attached table hits to database test 2025.06.18 08:40:15.354484 [ 66733 ] {} AsyncLoader: Finish load job 'load table test.hits' with status OK 2025.06.18 08:40:15.354559 [ 66703 ] {} test.visits (7f24c2b9-8555-4076-b0de-86a4f3489569): Loading data parts 2025.06.18 08:40:15.354584 [ 66733 ] {} AsyncLoader: Spawn loader worker #11 in BackgroundLoad 2025.06.18 08:40:15.354770 [ 66733 ] {} AsyncLoader: Execute load job 'load table db_dict.cache_hits' in BackgroundLoad 2025.06.18 08:40:15.354872 [ 66733 ] {} DatabaseAtomic (db_dict): Loading table db_dict.cache_hits 2025.06.18 08:40:15.354885 [ 66711 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.354939 [ 66703 ] {} test.visits (7f24c2b9-8555-4076-b0de-86a4f3489569): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.355049 [ 66703 ] {} test.visits (7f24c2b9-8555-4076-b0de-86a4f3489569): There are no data parts 2025.06.18 08:40:15.356337 [ 66703 ] {} DatabaseAtomic (test): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.356408 [ 66703 ] {} DatabaseAtomic (test): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.356515 [ 66703 ] {} DatabaseAtomic (test): Counting attached table visits to database test 2025.06.18 08:40:15.357760 [ 66703 ] {} AsyncLoader: Finish load job 'load table test.visits' with status OK 2025.06.18 08:40:15.357900 [ 66703 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.361864 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/ints_dictionary.xml'. 2025.06.18 08:40:15.374694 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/ints_dictionary.xml'. 2025.06.18 08:40:15.375243 [ 65992 ] {} ExternalDictionariesLoader: Loading config file '/etc/clickhouse-server/strings_dictionary.xml'. 2025.06.18 08:40:15.384970 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/strings_dictionary.xml'. 2025.06.18 08:40:15.389774 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/strings_dictionary.xml'. 2025.06.18 08:40:15.390358 [ 66735 ] {} ExternalDictionariesLoader: Loading config file 'ca6c80f1-19f3-4439-a167-d35e1034a955'. 2025.06.18 08:40:15.391091 [ 66735 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.391154 [ 66735 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.391248 [ 66735 ] {} DatabaseAtomic (test_1): Counting attached table regexp_dict2 to database test_1 2025.06.18 08:40:15.391338 [ 66741 ] {} ExternalDictionariesLoader: Loading config file '4dce4414-6450-4b6d-8815-2b49a84277a8'. 2025.06.18 08:40:15.391484 [ 66735 ] {} AsyncLoader: Finish load job 'load table test_1.regexp_dict2' with status OK 2025.06.18 08:40:15.391578 [ 66735 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.391645 [ 66747 ] {} ExternalDictionariesLoader: Loading config file 'b5d9905a-1085-4ef9-bfe3-4bc2bb365e0d'. 2025.06.18 08:40:15.391757 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Loading config file '/etc/clickhouse-server/test_function.xml'. 2025.06.18 08:40:15.391826 [ 66741 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.391879 [ 66741 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.391928 [ 66741 ] {} DatabaseAtomic (test_1): Counting attached table regexp_dict4 to database test_1 2025.06.18 08:40:15.392007 [ 66738 ] {} ExternalDictionariesLoader: Loading config file '46a318ed-df43-4956-92c9-94303284b22a'. 2025.06.18 08:40:15.392102 [ 66741 ] {} AsyncLoader: Finish load job 'load table test_1.regexp_dict4' with status OK 2025.06.18 08:40:15.392173 [ 66747 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.392189 [ 66741 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.392234 [ 66747 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.392298 [ 66747 ] {} DatabaseAtomic (test_1): Counting attached table dict to database test_1 2025.06.18 08:40:15.392368 [ 66720 ] {} ExternalDictionariesLoader: Loading config file 'ef54eaf2-08ca-4239-b643-d291c9d47053'. 2025.06.18 08:40:15.392442 [ 66747 ] {} AsyncLoader: Finish load job 'load table test_1.dict' with status OK 2025.06.18 08:40:15.392528 [ 66738 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.392560 [ 66747 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.392612 [ 66738 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.392687 [ 66738 ] {} DatabaseAtomic (test_1): Counting attached table ssd_cache_dictionary to database test_1 2025.06.18 08:40:15.392832 [ 66738 ] {} AsyncLoader: Finish load job 'load table test_1.ssd_cache_dictionary' with status OK 2025.06.18 08:40:15.392853 [ 66729 ] {} ExternalDictionariesLoader: Loading config file 'ad76396a-306a-47b4-b440-4bd762b5dfda'. 2025.06.18 08:40:15.392982 [ 66738 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.393212 [ 66720 ] {} DatabaseAtomic (test_i227bf47): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.393290 [ 66720 ] {} DatabaseAtomic (test_i227bf47): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.393289 [ 66710 ] {} ExternalDictionariesLoader: Loading config file '18c89ff0-5a12-4b30-a585-ecab531d37f5'. 2025.06.18 08:40:15.393370 [ 66720 ] {} DatabaseAtomic (test_i227bf47): Counting attached table test_dictionary to database test_i227bf47 2025.06.18 08:40:15.393520 [ 66720 ] {} AsyncLoader: Finish load job 'load table test_i227bf47.test_dictionary' with status OK 2025.06.18 08:40:15.393596 [ 66729 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.393640 [ 66720 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.393676 [ 66729 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.393766 [ 66729 ] {} DatabaseAtomic (test_1): Counting attached table regexp_dict1 to database test_1 2025.06.18 08:40:15.393791 [ 66733 ] {} ExternalDictionariesLoader: Loading config file '063a9953-6b5e-4e5c-9dcd-4aeb7b2d7622'. 2025.06.18 08:40:15.394053 [ 66729 ] {} AsyncLoader: Finish load job 'load table test_1.regexp_dict1' with status OK 2025.06.18 08:40:15.394105 [ 66710 ] {} DatabaseAtomic (test_1): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.394188 [ 66729 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.394196 [ 66710 ] {} DatabaseAtomic (test_1): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.394320 [ 66710 ] {} DatabaseAtomic (test_1): Counting attached table regexp_dict3 to database test_1 2025.06.18 08:40:15.394478 [ 66710 ] {} AsyncLoader: Finish load job 'load table test_1.regexp_dict3' with status OK 2025.06.18 08:40:15.394491 [ 66718 ] {} ExternalDictionariesLoader: Loading config file '16940c08-1716-4469-8db3-c96f596592a5'. 2025.06.18 08:40:15.394575 [ 66710 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.394731 [ 66733 ] {} DatabaseAtomic (db_dict): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.394814 [ 66733 ] {} DatabaseAtomic (db_dict): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.394927 [ 66733 ] {} DatabaseAtomic (db_dict): Counting attached table cache_hits to database db_dict 2025.06.18 08:40:15.395144 [ 66733 ] {} AsyncLoader: Finish load job 'load table db_dict.cache_hits' with status OK 2025.06.18 08:40:15.395238 [ 66733 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.396503 [ 66718 ] {} DatabaseAtomic (test_3): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.396701 [ 66718 ] {} DatabaseAtomic (test_3): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.396961 [ 66718 ] {} DatabaseAtomic (test_3): Counting attached table dict to database test_3 2025.06.18 08:40:15.397800 [ 66718 ] {} AsyncLoader: Finish load job 'load table test_3.dict' with status OK 2025.06.18 08:40:15.398217 [ 66718 ] {} AsyncLoader: Stop worker in BackgroundLoad 2025.06.18 08:40:15.398490 [ 66718 ] {} AsyncLoader: Change current priority: 1 -> 2 2025.06.18 08:40:15.398776 [ 66718 ] {} AsyncLoader: Spawn loader worker #1 in BackgrndStartup 2025.06.18 08:40:15.399081 [ 66718 ] {} AsyncLoader: Spawn loader worker #2 in BackgrndStartup 2025.06.18 08:40:15.399326 [ 66718 ] {} AsyncLoader: Spawn loader worker #3 in BackgrndStartup 2025.06.18 08:40:15.399516 [ 66718 ] {} AsyncLoader: Spawn loader worker #4 in BackgrndStartup 2025.06.18 08:40:15.399733 [ 66718 ] {} AsyncLoader: Spawn loader worker #5 in BackgrndStartup 2025.06.18 08:40:15.399992 [ 66718 ] {} AsyncLoader: Spawn loader worker #6 in BackgrndStartup 2025.06.18 08:40:15.400179 [ 66718 ] {} AsyncLoader: Spawn loader worker #7 in BackgrndStartup 2025.06.18 08:40:15.400365 [ 66718 ] {} AsyncLoader: Spawn loader worker #8 in BackgrndStartup 2025.06.18 08:40:15.400555 [ 66718 ] {} AsyncLoader: Spawn loader worker #9 in BackgrndStartup 2025.06.18 08:40:15.400726 [ 66718 ] {} AsyncLoader: Spawn loader worker #10 in BackgrndStartup 2025.06.18 08:40:15.400962 [ 66718 ] {} AsyncLoader: Spawn loader worker #11 in BackgrndStartup 2025.06.18 08:40:15.401148 [ 66718 ] {} AsyncLoader: Spawn loader worker #12 in BackgrndStartup 2025.06.18 08:40:15.401335 [ 66718 ] {} AsyncLoader: Spawn loader worker #13 in BackgrndStartup 2025.06.18 08:40:15.401504 [ 66718 ] {} AsyncLoader: Spawn loader worker #14 in BackgrndStartup 2025.06.18 08:40:15.401688 [ 66718 ] {} AsyncLoader: Spawn loader worker #15 in BackgrndStartup 2025.06.18 08:40:15.401972 [ 66718 ] {} AsyncLoader: Spawn loader worker #16 in BackgrndStartup 2025.06.18 08:40:15.402297 [ 66778 ] {} AsyncLoader: Execute load job 'startup Ordinary database default' in BackgrndStartup 2025.06.18 08:40:15.402468 [ 66782 ] {} AsyncLoader: Execute load job 'startup Ordinary database empty_db_01036' in BackgrndStartup 2025.06.18 08:40:15.402625 [ 66783 ] {} AsyncLoader: Execute load job 'startup Ordinary database datasets' in BackgrndStartup 2025.06.18 08:40:15.402755 [ 66783 ] {} AsyncLoader: Finish load job 'startup Ordinary database datasets' with status OK 2025.06.18 08:40:15.402903 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_1.t2__fuzz_0' in BackgrndStartup 2025.06.18 08:40:15.403113 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.nested_nested_table' in BackgrndStartup 2025.06.18 08:40:15.403389 [ 66779 ] {} AsyncLoader: Execute load job 'startup table test_1_db.test_mv3' in BackgrndStartup 2025.06.18 08:40:15.403611 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_qcf18570.realtimebuff__fuzz_19' in BackgrndStartup 2025.06.18 08:40:15.403795 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_5ri8lnpr.mv4' in BackgrndStartup 2025.06.18 08:40:15.404131 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_1.group_by_all' in BackgrndStartup 2025.06.18 08:40:15.404381 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test_5ri8lnpr.mv5' in BackgrndStartup 2025.06.18 08:40:15.404512 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_1.group_by_all' with status OK 2025.06.18 08:40:15.404814 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_1.A' in BackgrndStartup 2025.06.18 08:40:15.405115 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_3.table1' in BackgrndStartup 2025.06.18 08:40:15.405446 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.t0' in BackgrndStartup 2025.06.18 08:40:15.405578 [ 66781 ] {} AsyncLoader: Execute load job 'startup table test_3.test_table' in BackgrndStartup 2025.06.18 08:40:15.405714 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.a' in BackgrndStartup 2025.06.18 08:40:15.405856 [ 66688 ] {} AsyncLoader: Execute load job 'startup table test_13.hits_none' in BackgrndStartup 2025.06.18 08:40:15.406023 [ 66778 ] {} AsyncLoader: Finish load job 'startup Ordinary database default' with status OK 2025.06.18 08:40:15.406219 [ 66778 ] {} AsyncLoader: Execute load job 'startup table 02911_support_alias_column_in_indices.test1' in BackgrndStartup 2025.06.18 08:40:15.406352 [ 66782 ] {} AsyncLoader: Finish load job 'startup Ordinary database empty_db_01036' with status OK 2025.06.18 08:40:15.406589 [ 66782 ] {} AsyncLoader: Execute load job 'startup table test_qcf18570.realtimebuff__fuzz_20' in BackgrndStartup 2025.06.18 08:40:15.406714 [ 66737 ] {} AsyncLoader: Execute load job 'startup table test_1.partition_id' in BackgrndStartup 2025.06.18 08:40:15.406879 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_1.t2__fuzz_0' with status OK 2025.06.18 08:40:15.406999 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0' in BackgrndStartup 2025.06.18 08:40:15.407180 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.nested_nested_table' with status OK 2025.06.18 08:40:15.407360 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.product_groups' in BackgrndStartup 2025.06.18 08:40:15.407512 [ 66779 ] {} AsyncLoader: Finish load job 'startup table test_1_db.test_mv3' with status OK 2025.06.18 08:40:15.407718 [ 66779 ] {} AsyncLoader: Execute load job 'startup table test_1.tokenbf_tab' in BackgrndStartup 2025.06.18 08:40:15.407834 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_qcf18570.realtimebuff__fuzz_19' with status OK 2025.06.18 08:40:15.407998 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_7.distinct_in_order' in BackgrndStartup 2025.06.18 08:40:15.408103 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_5ri8lnpr.mv4' with status OK 2025.06.18 08:40:15.408248 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_1.sample_prewhere' in BackgrndStartup 2025.06.18 08:40:15.408408 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_1.zero_rows_per_granule' in BackgrndStartup 2025.06.18 08:40:15.408561 [ 66779 ] {} AsyncLoader: Finish load job 'startup table test_1.tokenbf_tab' with status OK 2025.06.18 08:40:15.408687 [ 66779 ] {} AsyncLoader: Execute load job 'startup table test_3.t_uncompressed_cache' in BackgrndStartup 2025.06.18 08:40:15.408868 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_3.table1' with status OK 2025.06.18 08:40:15.409038 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.country_rings' in BackgrndStartup 2025.06.18 08:40:15.409232 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.a' with status OK 2025.06.18 08:40:15.409368 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_15.ordinary_distinct' in BackgrndStartup 2025.06.18 08:40:15.409517 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_1.A' with status OK 2025.06.18 08:40:15.409736 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_15.unit' in BackgrndStartup 2025.06.18 08:40:15.409916 [ 66781 ] {} AsyncLoader: Finish load job 'startup table test_3.test_table' with status OK 2025.06.18 08:40:15.410040 [ 66781 ] {} AsyncLoader: Execute load job 'startup table test_3.defaults' in BackgrndStartup 2025.06.18 08:40:15.410136 [ 66782 ] {} AsyncLoader: Finish load job 'startup table test_qcf18570.realtimebuff__fuzz_20' with status OK 2025.06.18 08:40:15.410231 [ 66782 ] {} AsyncLoader: Execute load job 'startup table test_3.ay' in BackgrndStartup 2025.06.18 08:40:15.410345 [ 66688 ] {} AsyncLoader: Finish load job 'startup table test_13.hits_none' with status OK 2025.06.18 08:40:15.410482 [ 66688 ] {} AsyncLoader: Execute load job 'startup table test_1.error_win_func' in BackgrndStartup 2025.06.18 08:40:15.410642 [ 66778 ] {} AsyncLoader: Finish load job 'startup table 02911_support_alias_column_in_indices.test1' with status OK 2025.06.18 08:40:15.410757 [ 66778 ] {} AsyncLoader: Execute load job 'startup table test_3.dict_data' in BackgrndStartup 2025.06.18 08:40:15.410847 [ 66782 ] {} AsyncLoader: Finish load job 'startup table test_3.ay' with status OK 2025.06.18 08:40:15.410951 [ 66782 ] {} AsyncLoader: Execute load job 'startup table test_1.t_local' in BackgrndStartup 2025.06.18 08:40:15.411098 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.product_groups' with status OK 2025.06.18 08:40:15.411369 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_3.right' in BackgrndStartup 2025.06.18 08:40:15.411562 [ 66737 ] {} AsyncLoader: Finish load job 'startup table test_1.partition_id' with status OK 2025.06.18 08:40:15.411641 [ 66665 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Found 1 old parts to remove. Parts: [202506_1_206_41] 2025.06.18 08:40:15.411679 [ 66737 ] {} AsyncLoader: Execute load job 'startup table test_1.mytable' in BackgrndStartup 2025.06.18 08:40:15.411785 [ 66665 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 1 parts from filesystem (serially): Parts: [202506_1_206_41] 2025.06.18 08:40:15.411856 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test..inner_id.fd34062c-6078-4ffa-b8bc-10628cc353f0' with status OK 2025.06.18 08:40:15.411954 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_3.src_01019' in BackgrndStartup 2025.06.18 08:40:15.412055 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_3.src_01019' with status OK 2025.06.18 08:40:15.412131 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_sgwu2ec2.view_nulls' in BackgrndStartup 2025.06.18 08:40:15.412219 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_7.distinct_in_order' with status OK 2025.06.18 08:40:15.412349 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_3.test_input' in BackgrndStartup 2025.06.18 08:40:15.412755 [ 66665 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_1_206_41 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.412791 [ 66779 ] {} AsyncLoader: Finish load job 'startup table test_3.t_uncompressed_cache' with status OK 2025.06.18 08:40:15.412849 [ 66665 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 1 parts from memory: Parts: [202506_1_206_41] 2025.06.18 08:40:15.412883 [ 66779 ] {} AsyncLoader: Execute load job 'startup table test_3.r_prop_table1' in BackgrndStartup 2025.06.18 08:40:15.413004 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_1.zero_rows_per_granule' with status OK 2025.06.18 08:40:15.413035 [ 66779 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Starting up table 2025.06.18 08:40:15.413125 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_1.t2' in BackgrndStartup 2025.06.18 08:40:15.413282 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_1.sample_prewhere' with status OK 2025.06.18 08:40:15.413395 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_1.j' in BackgrndStartup 2025.06.18 08:40:15.413580 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_15.unit' with status OK 2025.06.18 08:40:15.413865 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_1_db.test_mv2' in BackgrndStartup 2025.06.18 08:40:15.414044 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_15.ordinary_distinct' with status OK 2025.06.18 08:40:15.414147 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_3.table_src' in BackgrndStartup 2025.06.18 08:40:15.414256 [ 66781 ] {} AsyncLoader: Finish load job 'startup table test_3.defaults' with status OK 2025.06.18 08:40:15.414382 [ 66781 ] {} AsyncLoader: Execute load job 'startup table test_1.data_r1' in BackgrndStartup 2025.06.18 08:40:15.414473 [ 66781 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Starting up table 2025.06.18 08:40:15.414554 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.country_rings' with status OK 2025.06.18 08:40:15.414746 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b' in BackgrndStartup 2025.06.18 08:40:15.414878 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.t0' with status OK 2025.06.18 08:40:15.415021 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.LOG_T' in BackgrndStartup 2025.06.18 08:40:15.415117 [ 66778 ] {} AsyncLoader: Finish load job 'startup table test_3.dict_data' with status OK 2025.06.18 08:40:15.415235 [ 66778 ] {} AsyncLoader: Execute load job 'startup table test_1.ngrambf_tab' in BackgrndStartup 2025.06.18 08:40:15.415332 [ 66782 ] {} AsyncLoader: Finish load job 'startup table test_1.t_local' with status OK 2025.06.18 08:40:15.415413 [ 66782 ] {} AsyncLoader: Execute load job 'startup table test_1.concurrent_kill_2' in BackgrndStartup 2025.06.18 08:40:15.415513 [ 66782 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Starting up table 2025.06.18 08:40:15.415575 [ 66688 ] {} AsyncLoader: Finish load job 'startup table test_1.error_win_func' with status OK 2025.06.18 08:40:15.415684 [ 66688 ] {} AsyncLoader: Execute load job 'startup table test_1.with_fill_date' in BackgrndStartup 2025.06.18 08:40:15.415842 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test_5ri8lnpr.mv5' with status OK 2025.06.18 08:40:15.416049 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test_3.userid_set' in BackgrndStartup 2025.06.18 08:40:15.416233 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_sgwu2ec2.view_nulls' with status OK 2025.06.18 08:40:15.416380 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_1.mass_table_117' in BackgrndStartup 2025.06.18 08:40:15.416347 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 86 2025.06.18 08:40:15.416516 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_3.right' with status OK 2025.06.18 08:40:15.416726 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_v4ezwkrr.mv' in BackgrndStartup 2025.06.18 08:40:15.416897 [ 66737 ] {} AsyncLoader: Finish load job 'startup table test_1.mytable' with status OK 2025.06.18 08:40:15.416992 [ 66737 ] {} AsyncLoader: Execute load job 'startup table test_3.r_prop_table2' in BackgrndStartup 2025.06.18 08:40:15.417088 [ 66737 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Starting up table 2025.06.18 08:40:15.417101 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_3.test_input' with status OK 2025.06.18 08:40:15.417199 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd' in BackgrndStartup 2025.06.18 08:40:15.417330 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_1.t2' with status OK 2025.06.18 08:40:15.417415 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_1.test_table' in BackgrndStartup 2025.06.18 08:40:15.417413 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.417492 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_1.mass_table_117' with status OK 2025.06.18 08:40:15.417587 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_1.defaults' in BackgrndStartup 2025.06.18 08:40:15.417704 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_1_db.test_mv2' with status OK 2025.06.18 08:40:15.417878 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_3.test1' in BackgrndStartup 2025.06.18 08:40:15.418018 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_3.table_src' with status OK 2025.06.18 08:40:15.418118 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_v4ezwkrr.null' in BackgrndStartup 2025.06.18 08:40:15.418288 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test..inner_id.727d3f8a-e47e-4bd1-ac03-b995f764561b' with status OK 2025.06.18 08:40:15.418492 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_3.test2' in BackgrndStartup 2025.06.18 08:40:15.418718 [ 66688 ] {} AsyncLoader: Finish load job 'startup table test_1.with_fill_date' with status OK 2025.06.18 08:40:15.418848 [ 66688 ] {} AsyncLoader: Execute load job 'startup table test.join' in BackgrndStartup 2025.06.18 08:40:15.418959 [ 66778 ] {} AsyncLoader: Finish load job 'startup table test_1.ngrambf_tab' with status OK 2025.06.18 08:40:15.419043 [ 66778 ] {} AsyncLoader: Execute load job 'startup table test_15.distinct_in_order' in BackgrndStartup 2025.06.18 08:40:15.419138 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.LOG_T' with status OK 2025.06.18 08:40:15.419245 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.data_native_copy' in BackgrndStartup 2025.06.18 08:40:15.419399 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test_3.userid_set' with status OK 2025.06.18 08:40:15.419531 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 69 2025.06.18 08:40:15.419758 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test_13.distinct_in_order' in BackgrndStartup 2025.06.18 08:40:15.419965 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_v4ezwkrr.mv' with status OK 2025.06.18 08:40:15.420096 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.test_move_partition_src' in BackgrndStartup 2025.06.18 08:40:15.420175 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.420195 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_1.j' with status OK 2025.06.18 08:40:15.420329 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_1.test_lookup_table' in BackgrndStartup 2025.06.18 08:40:15.420429 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_1.defaults' with status OK 2025.06.18 08:40:15.420505 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_3.mv_b_even' in BackgrndStartup 2025.06.18 08:40:15.420629 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd' with status OK 2025.06.18 08:40:15.420715 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.t1__fuzz_17' in BackgrndStartup 2025.06.18 08:40:15.420815 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_3.test1' with status OK 2025.06.18 08:40:15.420921 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_3.tab' in BackgrndStartup 2025.06.18 08:40:15.421011 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_1.test_table' with status OK 2025.06.18 08:40:15.421092 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 131 2025.06.18 08:40:15.421362 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_01516.primary_key_test' in BackgrndStartup 2025.06.18 08:40:15.421467 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_v4ezwkrr.null' with status OK 2025.06.18 08:40:15.421567 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1_db.test_mv' in BackgrndStartup 2025.06.18 08:40:15.421701 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_3.test2' with status OK 2025.06.18 08:40:15.421708 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.421832 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.t_github_json' in BackgrndStartup 2025.06.18 08:40:15.421982 [ 66688 ] {} AsyncLoader: Finish load job 'startup table test.join' with status OK 2025.06.18 08:40:15.422077 [ 66688 ] {} AsyncLoader: Execute load job 'startup table test_1.rmt2' in BackgrndStartup 2025.06.18 08:40:15.422166 [ 66778 ] {} AsyncLoader: Finish load job 'startup table test_15.distinct_in_order' with status OK 2025.06.18 08:40:15.422190 [ 66688 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Starting up table 2025.06.18 08:40:15.422269 [ 66778 ] {} AsyncLoader: Execute load job 'startup table test_1.r2' in BackgrndStartup 2025.06.18 08:40:15.422347 [ 66778 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Starting up table 2025.06.18 08:40:15.422407 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.t_github_json' with status OK 2025.06.18 08:40:15.422498 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.tab_00717' in BackgrndStartup 2025.06.18 08:40:15.422654 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 86 2025.06.18 08:40:15.422850 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.data_native_copy' with status OK 2025.06.18 08:40:15.422989 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.423031 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.distinct' in BackgrndStartup 2025.06.18 08:40:15.423211 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_1.test_lookup_table' with status OK 2025.06.18 08:40:15.423313 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_1.t_02559' in BackgrndStartup 2025.06.18 08:40:15.423442 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_3.mv_b_even' with status OK 2025.06.18 08:40:15.423525 [ 66783 ] {} AsyncLoader: Execute load job 'startup table test_1.data_r2' in BackgrndStartup 2025.06.18 08:40:15.423609 [ 66783 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Starting up table 2025.06.18 08:40:15.423621 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.t1__fuzz_17' with status OK 2025.06.18 08:40:15.423612 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Creating shared ID for table test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d) 2025.06.18 08:40:15.423684 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 112 2025.06.18 08:40:15.423707 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.location' in BackgrndStartup 2025.06.18 08:40:15.423894 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test_13.distinct_in_order' with status OK 2025.06.18 08:40:15.424039 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.424054 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test_1.dictionary_decimal_source_table' in BackgrndStartup 2025.06.18 08:40:15.424146 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 4, bytes: 483 2025.06.18 08:40:15.424232 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.test_move_partition_src' with status OK 2025.06.18 08:40:15.424484 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_7.unit' in BackgrndStartup 2025.06.18 08:40:15.424591 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_3.tab' with status OK 2025.06.18 08:40:15.424679 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_1.test1' in BackgrndStartup 2025.06.18 08:40:15.424667 [ 66662 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Found 3 old parts to remove. Parts: [202506_1_171_34, 202506_172_172_0, 202506_173_173_0] 2025.06.18 08:40:15.424765 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1_db.test_mv' with status OK 2025.06.18 08:40:15.424855 [ 66585 ] {} KeeperLogStore: Flushing 4 logs 2025.06.18 08:40:15.424929 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test.visits_null' in BackgrndStartup 2025.06.18 08:40:15.424969 [ 66662 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Removing 3 parts from filesystem (serially): Parts: [202506_1_171_34, 202506_172_172_0, 202506_173_173_0] 2025.06.18 08:40:15.425078 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_01516.primary_key_test' with status OK 2025.06.18 08:40:15.425261 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_7.parsing_with_names' in BackgrndStartup 2025.06.18 08:40:15.425346 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Creating shared ID for table test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7) 2025.06.18 08:40:15.425439 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.tab_00717' with status OK 2025.06.18 08:40:15.425521 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_15.parsing_with_names' in BackgrndStartup 2025.06.18 08:40:15.425631 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_15.parsing_with_names' with status OK 2025.06.18 08:40:15.425727 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 290 2025.06.18 08:40:15.425917 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_13.parsing_with_names' in BackgrndStartup 2025.06.18 08:40:15.426014 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_1.t_02559' with status OK 2025.06.18 08:40:15.426027 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Initializing table shared ID with 69c94d68-13dd-40b1-ae3d-b14cdb36815d 2025.06.18 08:40:15.426100 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_13.00163_column_oriented' in BackgrndStartup 2025.06.18 08:40:15.426211 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test_1.dictionary_decimal_source_table' with status OK 2025.06.18 08:40:15.426244 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.426293 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 190 2025.06.18 08:40:15.426341 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test_qcf18570.realtimedistributed' in BackgrndStartup 2025.06.18 08:40:15.426441 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.location' with status OK 2025.06.18 08:40:15.426524 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test.basic' in BackgrndStartup 2025.06.18 08:40:15.426631 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_7.unit' with status OK 2025.06.18 08:40:15.426650 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.426769 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.src_table' in BackgrndStartup 2025.06.18 08:40:15.426864 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test.visits_null' with status OK 2025.06.18 08:40:15.426935 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.test' in BackgrndStartup 2025.06.18 08:40:15.427004 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_1.test1' with status OK 2025.06.18 08:40:15.427081 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_1.d' in BackgrndStartup 2025.06.18 08:40:15.427206 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_7.parsing_with_names' with status OK 2025.06.18 08:40:15.427311 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_1.t02176' in BackgrndStartup 2025.06.18 08:40:15.427388 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.src_table' with status OK 2025.06.18 08:40:15.427410 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Initializing table shared ID with cd0456b0-6c04-4385-9a38-0cbbbb1496e7 2025.06.18 08:40:15.427465 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.video_log' in BackgrndStartup 2025.06.18 08:40:15.427596 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.test' with status OK 2025.06.18 08:40:15.427606 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 9, bytes: 1122 2025.06.18 08:40:15.427713 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.video_log_result__fuzz_0' in BackgrndStartup 2025.06.18 08:40:15.427787 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_1.t02176' with status OK 2025.06.18 08:40:15.427908 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_3.test_a' in BackgrndStartup 2025.06.18 08:40:15.428002 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test_qcf18570.realtimedistributed' with status OK 2025.06.18 08:40:15.428095 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test.partitions' in BackgrndStartup 2025.06.18 08:40:15.428191 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test.basic' with status OK 2025.06.18 08:40:15.428260 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.bug' in BackgrndStartup 2025.06.18 08:40:15.428363 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_1.d' with status OK 2025.06.18 08:40:15.428437 [ 66728 ] {} AsyncLoader: Execute load job 'startup table test_3.test_table_replicated' in BackgrndStartup 2025.06.18 08:40:15.428510 [ 66728 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Starting up table 2025.06.18 08:40:15.428532 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.distinct' with status OK 2025.06.18 08:40:15.428627 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.copied_table' in BackgrndStartup 2025.06.18 08:40:15.428802 [ 66585 ] {} KeeperLogStore: Flushing 9 logs 2025.06.18 08:40:15.428805 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_13.parsing_with_names' with status OK 2025.06.18 08:40:15.428932 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_3.test_b' in BackgrndStartup 2025.06.18 08:40:15.429018 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 9, bytes: 915 2025.06.18 08:40:15.429054 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_13.00163_column_oriented' with status OK 2025.06.18 08:40:15.429219 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test.hits_snippet' in BackgrndStartup 2025.06.18 08:40:15.429384 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.video_log' with status OK 2025.06.18 08:40:15.429484 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.clickhouse_alias_issue_2' in BackgrndStartup 2025.06.18 08:40:15.429575 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.video_log_result__fuzz_0' with status OK 2025.06.18 08:40:15.429647 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test.basic_00040' in BackgrndStartup 2025.06.18 08:40:15.429711 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.bug' with status OK 2025.06.18 08:40:15.429809 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.mt' in BackgrndStartup 2025.06.18 08:40:15.429901 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_3.test_a' with status OK 2025.06.18 08:40:15.429978 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_1.src' in BackgrndStartup 2025.06.18 08:40:15.430067 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test.partitions' with status OK 2025.06.18 08:40:15.430074 [ 66662 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): removePartsFinally: removing 202506_1_171_34 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.430157 [ 66772 ] {} AsyncLoader: Execute load job 'startup table test_1.concurrent_kill_5' in BackgrndStartup 2025.06.18 08:40:15.430208 [ 66585 ] {} KeeperLogStore: Flushing 9 logs 2025.06.18 08:40:15.430243 [ 66662 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): removePartsFinally: removing 202506_172_172_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.430277 [ 66772 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Starting up table 2025.06.18 08:40:15.430281 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.copied_table' with status OK 2025.06.18 08:40:15.430404 [ 66662 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): removePartsFinally: removing 202506_173_173_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.430435 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test.hits_tinylog' in BackgrndStartup 2025.06.18 08:40:15.430532 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_3.test_b' with status OK 2025.06.18 08:40:15.430521 [ 66662 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Removing 3 parts from memory: Parts: [202506_1_171_34, 202506_172_172_0, 202506_173_173_0] 2025.06.18 08:40:15.430644 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test.hits_stripelog' in BackgrndStartup 2025.06.18 08:40:15.430824 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.clickhouse_alias_issue_2' with status OK 2025.06.18 08:40:15.430909 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_3.left' in BackgrndStartup 2025.06.18 08:40:15.430999 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test.basic_00040' with status OK 2025.06.18 08:40:15.431113 [ 66766 ] {} AsyncLoader: Processed: 71.5% 2025.06.18 08:40:15.431204 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.02500_nested' in BackgrndStartup 2025.06.18 08:40:15.431315 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test.hits_snippet' with status OK 2025.06.18 08:40:15.431464 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_1.tab_00481' in BackgrndStartup 2025.06.18 08:40:15.431587 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.mt' with status OK 2025.06.18 08:40:15.431667 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.test_grouping_sets_predicate' in BackgrndStartup 2025.06.18 08:40:15.431792 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_1.src' with status OK 2025.06.18 08:40:15.431858 [ 66786 ] {} AsyncLoader: Execute load job 'startup table test_1.concurrent_kill_1' in BackgrndStartup 2025.06.18 08:40:15.431924 [ 66786 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Starting up table 2025.06.18 08:40:15.431935 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test.hits_tinylog' with status OK 2025.06.18 08:40:15.432012 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 4, bytes: 488 2025.06.18 08:40:15.432038 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.m' in BackgrndStartup 2025.06.18 08:40:15.432185 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test.hits_stripelog' with status OK 2025.06.18 08:40:15.432312 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_3.t' in BackgrndStartup 2025.06.18 08:40:15.432403 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_3.left' with status OK 2025.06.18 08:40:15.432475 [ 66585 ] {} KeeperLogStore: Flushing 4 logs 2025.06.18 08:40:15.432518 [ 66767 ] {} AsyncLoader: Execute load job 'startup table test_1.concurrent_kill_4' in BackgrndStartup 2025.06.18 08:40:15.432584 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 68 2025.06.18 08:40:15.432656 [ 66767 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Starting up table 2025.06.18 08:40:15.432656 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.02500_nested' with status OK 2025.06.18 08:40:15.432770 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.t_nested_with_dots' in BackgrndStartup 2025.06.18 08:40:15.432882 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_1.tab_00481' with status OK 2025.06.18 08:40:15.432933 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.433005 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_13.unit' in BackgrndStartup 2025.06.18 08:40:15.433080 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.test_grouping_sets_predicate' with status OK 2025.06.18 08:40:15.433144 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_3.test_mv' in BackgrndStartup 2025.06.18 08:40:15.433220 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_3.t' with status OK 2025.06.18 08:40:15.433301 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.03006_test' in BackgrndStartup 2025.06.18 08:40:15.433396 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 300 2025.06.18 08:40:15.433422 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Creating shared ID for table test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0) 2025.06.18 08:40:15.433380 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Creating shared ID for table test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd) 2025.06.18 08:40:15.433455 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.m' with status OK 2025.06.18 08:40:15.433617 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_3.pipe_01019' in BackgrndStartup 2025.06.18 08:40:15.433697 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_13.unit' with status OK 2025.06.18 08:40:15.433767 [ 66765 ] {} AsyncLoader: Execute load job 'startup table test_1.quorum1' in BackgrndStartup 2025.06.18 08:40:15.433843 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.433875 [ 66765 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Starting up table 2025.06.18 08:40:15.433877 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_3.test_mv' with status OK 2025.06.18 08:40:15.433931 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 395 2025.06.18 08:40:15.434008 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.B1' in BackgrndStartup 2025.06.18 08:40:15.434113 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.t_nested_with_dots' with status OK 2025.06.18 08:40:15.434205 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.t1' in BackgrndStartup 2025.06.18 08:40:15.434298 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_3.pipe_01019' with status OK 2025.06.18 08:40:15.434413 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.data2015' in BackgrndStartup 2025.06.18 08:40:15.434502 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.03006_test' with status OK 2025.06.18 08:40:15.434582 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.four_rows_per_granule' in BackgrndStartup 2025.06.18 08:40:15.434650 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.434662 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.B1' with status OK 2025.06.18 08:40:15.434733 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 5, bytes: 776 2025.06.18 08:40:15.434745 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.products' in BackgrndStartup 2025.06.18 08:40:15.434882 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.data2015' with status OK 2025.06.18 08:40:15.434958 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.data_01882' in BackgrndStartup 2025.06.18 08:40:15.435042 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.t1' with status OK 2025.06.18 08:40:15.435171 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.table_for_concurrent_alter' in BackgrndStartup 2025.06.18 08:40:15.435343 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.products' with status OK 2025.06.18 08:40:15.435438 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.test_table_comment' in BackgrndStartup 2025.06.18 08:40:15.435446 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Creating shared ID for table test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d) 2025.06.18 08:40:15.435511 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.data_01882' with status OK 2025.06.18 08:40:15.435519 [ 66585 ] {} KeeperLogStore: Flushing 5 logs 2025.06.18 08:40:15.435573 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Shared ID already set to 69c94d68-13dd-40b1-ae3d-b14cdb36815d 2025.06.18 08:40:15.435630 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.testJoinTable' in BackgrndStartup 2025.06.18 08:40:15.435780 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.four_rows_per_granule' with status OK 2025.06.18 08:40:15.435870 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.clickhouse_alias_issue_1' in BackgrndStartup 2025.06.18 08:40:15.436030 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.test_table_comment' with status OK 2025.06.18 08:40:15.436106 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.data' in BackgrndStartup 2025.06.18 08:40:15.436220 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.testJoinTable' with status OK 2025.06.18 08:40:15.436284 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.country_polygons' in BackgrndStartup 2025.06.18 08:40:15.436380 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.table_for_concurrent_alter' with status OK 2025.06.18 08:40:15.436461 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_3.t1' in BackgrndStartup 2025.06.18 08:40:15.436564 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.clickhouse_alias_issue_1' with status OK 2025.06.18 08:40:15.436697 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_i227bf47.test_table' in BackgrndStartup 2025.06.18 08:40:15.436935 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.data' with status OK 2025.06.18 08:40:15.436954 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Initializing table shared ID with 69c94d68-13dd-40b1-ae3d-b14cdb36815d 2025.06.18 08:40:15.436950 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Initializing table shared ID with 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.437029 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Creating shared ID for table test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7) 2025.06.18 08:40:15.437045 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_3.stored_aggregates' in BackgrndStartup 2025.06.18 08:40:15.437064 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 69 2025.06.18 08:40:15.437257 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Shared ID already set to cd0456b0-6c04-4385-9a38-0cbbbb1496e7 2025.06.18 08:40:15.437293 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_i227bf47.test_table' with status OK 2025.06.18 08:40:15.437379 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.rdb' in BackgrndStartup 2025.06.18 08:40:15.437408 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.437525 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.country_polygons' with status OK 2025.06.18 08:40:15.437615 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.bad_arrays' in BackgrndStartup 2025.06.18 08:40:15.437700 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_3.stored_aggregates' with status OK 2025.06.18 08:40:15.437777 [ 66777 ] {} AsyncLoader: Execute load job 'startup table test_1.rmt1' in BackgrndStartup 2025.06.18 08:40:15.437877 [ 66777 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Starting up table 2025.06.18 08:40:15.437885 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.rdb' with status OK 2025.06.18 08:40:15.438008 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 12, bytes: 1663 2025.06.18 08:40:15.438019 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.table_default_protobuf_00825' in BackgrndStartup 2025.06.18 08:40:15.438376 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_3.t1' with status OK 2025.06.18 08:40:15.438470 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_qcf18570.realtimedrep' in BackgrndStartup 2025.06.18 08:40:15.438812 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Became leader 2025.06.18 08:40:15.438863 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.bad_arrays' with status OK 2025.06.18 08:40:15.438810 [ 66234 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loading 2 unexpected data parts 2025.06.18 08:40:15.438947 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.438967 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_3.vt' in BackgrndStartup 2025.06.18 08:40:15.439092 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Trying to startup table from right now 2025.06.18 08:40:15.439091 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.table_default_protobuf_00825' with status OK 2025.06.18 08:40:15.439149 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.439387 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.rng' in BackgrndStartup 2025.06.18 08:40:15.439397 [ 66585 ] {} KeeperLogStore: Flushing 12 logs 2025.06.18 08:40:15.439365 [ 66696 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loading unexpected part all_2_2_0_3 from disk s3_disk 2025.06.18 08:40:15.439365 [ 66764 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loading unexpected part all_1_1_0_3 from disk s3_disk 2025.06.18 08:40:15.439420 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.439525 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_3.vt' with status OK 2025.06.18 08:40:15.439581 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 968 2025.06.18 08:40:15.439615 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.mv' in BackgrndStartup 2025.06.18 08:40:15.439739 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_qcf18570.realtimedrep' with status OK 2025.06.18 08:40:15.439822 [ 66766 ] {} AsyncLoader: Execute load job 'startup table test_1.t_rename_alter' in BackgrndStartup 2025.06.18 08:40:15.439900 [ 66766 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Starting up table 2025.06.18 08:40:15.439906 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.rng' with status OK 2025.06.18 08:40:15.440017 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd' in BackgrndStartup 2025.06.18 08:40:15.440101 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.mv' with status OK 2025.06.18 08:40:15.440170 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test.avro' in BackgrndStartup 2025.06.18 08:40:15.440270 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test.avro' with status OK 2025.06.18 08:40:15.440273 [ 66696 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/count.txt) 2025.06.18 08:40:15.440268 [ 66764 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/count.txt) 2025.06.18 08:40:15.440334 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test.merge_hits' in BackgrndStartup 2025.06.18 08:40:15.440474 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1..inner_id.fbfd7dac-5550-4950-9291-aa3371e90cbd' with status OK 2025.06.18 08:40:15.440557 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.broken_table' in BackgrndStartup 2025.06.18 08:40:15.440640 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test.merge_hits' with status OK 2025.06.18 08:40:15.440704 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.tMM' in BackgrndStartup 2025.06.18 08:40:15.440756 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.440975 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.broken_table' with status OK 2025.06.18 08:40:15.440992 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:15.441014 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:15.441103 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test.hits_s3' in BackgrndStartup 2025.06.18 08:40:15.441130 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.441156 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.441175 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.tMM' with status OK 2025.06.18 08:40:15.441247 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test.hits' in BackgrndStartup 2025.06.18 08:40:15.441336 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:UnexpectedParts:66696, kind: Regular, unbound: 0 2025.06.18 08:40:15.441346 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:UnexpectedParts:66764, kind: Regular, unbound: 0 2025.06.18 08:40:15.441492 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:UnexpectedParts:66696, kind: Regular, unbound: 0 2025.06.18 08:40:15.441514 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test.hits_s3' with status OK 2025.06.18 08:40:15.441548 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:UnexpectedParts:66764, kind: Regular, unbound: 0 2025.06.18 08:40:15.441598 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test.visits' in BackgrndStartup 2025.06.18 08:40:15.441611 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.441662 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Became leader 2025.06.18 08:40:15.441631 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.441755 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.441805 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.441895 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.441897 [ 66696 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.441936 [ 66764 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.442014 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Trying to startup table from right now 2025.06.18 08:40:15.442060 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.442060 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 366 2025.06.18 08:40:15.442138 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.442195 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test.hits' with status OK 2025.06.18 08:40:15.442247 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.regexp_dict2' in BackgrndStartup 2025.06.18 08:40:15.442341 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test.visits' with status OK 2025.06.18 08:40:15.442464 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.regexp_dict4' in BackgrndStartup 2025.06.18 08:40:15.442594 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.regexp_dict2' with status OK 2025.06.18 08:40:15.442633 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.442671 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.dict' in BackgrndStartup 2025.06.18 08:40:15.442622 [ 66234 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Loaded 2 unexpected data parts 2025.06.18 08:40:15.442749 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 353 2025.06.18 08:40:15.442756 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.regexp_dict4' with status OK 2025.06.18 08:40:15.442902 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.ssd_cache_dictionary' in BackgrndStartup 2025.06.18 08:40:15.442993 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.dict' with status OK 2025.06.18 08:40:15.443060 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_i227bf47.test_dictionary' in BackgrndStartup 2025.06.18 08:40:15.443148 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.443151 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.ssd_cache_dictionary' with status OK 2025.06.18 08:40:15.443210 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 131 2025.06.18 08:40:15.443287 [ 66690 ] {} AsyncLoader: Execute load job 'startup table test_1.regexp_dict1' in BackgrndStartup 2025.06.18 08:40:15.443371 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_i227bf47.test_dictionary' with status OK 2025.06.18 08:40:15.443437 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_1.regexp_dict3' in BackgrndStartup 2025.06.18 08:40:15.443508 [ 66690 ] {} AsyncLoader: Finish load job 'startup table test_1.regexp_dict1' with status OK 2025.06.18 08:40:15.443586 [ 66690 ] {} AsyncLoader: Execute load job 'startup table db_dict.cache_hits' in BackgrndStartup 2025.06.18 08:40:15.443611 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.443682 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_1.regexp_dict3' with status OK 2025.06.18 08:40:15.443761 [ 66784 ] {} AsyncLoader: Execute load job 'startup table test_3.dict' in BackgrndStartup 2025.06.18 08:40:15.443826 [ 66690 ] {} AsyncLoader: Finish load job 'startup table db_dict.cache_hits' with status OK 2025.06.18 08:40:15.443895 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database datasets' in BackgrndStartup 2025.06.18 08:40:15.443958 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database datasets' with status OK 2025.06.18 08:40:15.444033 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database default' in BackgrndStartup 2025.06.18 08:40:15.444094 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database default' with status OK 2025.06.18 08:40:15.444149 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database empty_db_01036' in BackgrndStartup 2025.06.18 08:40:15.444217 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database empty_db_01036' with status OK 2025.06.18 08:40:15.444279 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database 02911_support_alias_column_in_indices' in BackgrndStartup 2025.06.18 08:40:15.444371 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database 02911_support_alias_column_in_indices' with status OK 2025.06.18 08:40:15.444437 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_5ri8lnpr' in BackgrndStartup 2025.06.18 08:40:15.444482 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_5ri8lnpr' with status OK 2025.06.18 08:40:15.444552 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_sgwu2ec2' in BackgrndStartup 2025.06.18 08:40:15.444633 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_sgwu2ec2' with status OK 2025.06.18 08:40:15.444700 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_v4ezwkrr' in BackgrndStartup 2025.06.18 08:40:15.444756 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 131 2025.06.18 08:40:15.444761 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_v4ezwkrr' with status OK 2025.06.18 08:40:15.444842 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Creating shared ID for table test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd) 2025.06.18 08:40:15.444864 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_1_db' in BackgrndStartup 2025.06.18 08:40:15.444925 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Creating shared ID for table test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0) 2025.06.18 08:40:15.444964 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_1_db' with status OK 2025.06.18 08:40:15.444975 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.445013 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Shared ID already set to 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.445034 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_01516' in BackgrndStartup 2025.06.18 08:40:15.445040 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Shared ID already set to 69c94d68-13dd-40b1-ae3d-b14cdb36815d 2025.06.18 08:40:15.445138 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_01516' with status OK 2025.06.18 08:40:15.445216 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_15' in BackgrndStartup 2025.06.18 08:40:15.445264 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_15' with status OK 2025.06.18 08:40:15.445296 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 131 2025.06.18 08:40:15.445326 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_7' in BackgrndStartup 2025.06.18 08:40:15.445444 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_7' with status OK 2025.06.18 08:40:15.445504 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_13' in BackgrndStartup 2025.06.18 08:40:15.445576 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_13' with status OK 2025.06.18 08:40:15.445644 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_qcf18570' in BackgrndStartup 2025.06.18 08:40:15.445687 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.445728 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_qcf18570' with status OK 2025.06.18 08:40:15.445785 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test' in BackgrndStartup 2025.06.18 08:40:15.445870 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test' with status OK 2025.06.18 08:40:15.445901 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Creating shared ID for table test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb) 2025.06.18 08:40:15.445939 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_i227bf47' in BackgrndStartup 2025.06.18 08:40:15.446037 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_i227bf47' with status OK 2025.06.18 08:40:15.446094 [ 66690 ] {} AsyncLoader: Execute load job 'startup Ordinary database db_dict' in BackgrndStartup 2025.06.18 08:40:15.446114 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 336 2025.06.18 08:40:15.446153 [ 66690 ] {} AsyncLoader: Finish load job 'startup Ordinary database db_dict' with status OK 2025.06.18 08:40:15.446178 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Creating shared ID for table test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) 2025.06.18 08:40:15.446214 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database 02911_support_alias_column_in_indices' in BackgrndStartup 2025.06.18 08:40:15.446332 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database 02911_support_alias_column_in_indices' with status OK 2025.06.18 08:40:15.446391 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_5ri8lnpr' in BackgrndStartup 2025.06.18 08:40:15.446447 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_5ri8lnpr' with status OK 2025.06.18 08:40:15.446506 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_sgwu2ec2' in BackgrndStartup 2025.06.18 08:40:15.446523 [ 65992 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/test_function.xml'. 2025.06.18 08:40:15.446602 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_sgwu2ec2' with status OK 2025.06.18 08:40:15.446647 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_v4ezwkrr' in BackgrndStartup 2025.06.18 08:40:15.446694 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_v4ezwkrr' with status OK 2025.06.18 08:40:15.446744 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_1_db' in BackgrndStartup 2025.06.18 08:40:15.446804 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.446821 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_1_db' with status OK 2025.06.18 08:40:15.446942 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 5, bytes: 702 2025.06.18 08:40:15.446946 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_15' in BackgrndStartup 2025.06.18 08:40:15.447046 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_15' with status OK 2025.06.18 08:40:15.447101 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_7' in BackgrndStartup 2025.06.18 08:40:15.447187 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_7' with status OK 2025.06.18 08:40:15.447230 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_13' in BackgrndStartup 2025.06.18 08:40:15.447277 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_13' with status OK 2025.06.18 08:40:15.447316 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_qcf18570' in BackgrndStartup 2025.06.18 08:40:15.447359 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_qcf18570' with status OK 2025.06.18 08:40:15.447428 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test' in BackgrndStartup 2025.06.18 08:40:15.447482 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test' with status OK 2025.06.18 08:40:15.447521 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database test_i227bf47' in BackgrndStartup 2025.06.18 08:40:15.447580 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database test_i227bf47' with status OK 2025.06.18 08:40:15.447624 [ 66690 ] {} AsyncLoader: Execute load job 'startup Atomic database db_dict' in BackgrndStartup 2025.06.18 08:40:15.447702 [ 66690 ] {} AsyncLoader: Finish load job 'startup Atomic database db_dict' with status OK 2025.06.18 08:40:15.447747 [ 66690 ] {} AsyncLoader: Execute load job 'startup Replicated database test_1_db' in BackgrndStartup 2025.06.18 08:40:15.447816 [ 66784 ] {} AsyncLoader: Finish load job 'startup table test_3.dict' with status OK 2025.06.18 08:40:15.447880 [ 66784 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.447885 [ 65992 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/test_function.xml'. 2025.06.18 08:40:15.447938 [ 66690 ] {} DatabaseReplicated (test_1_db): Calculated metadata digest of 4 tables: 7303574483820389215 2025.06.18 08:40:15.447957 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Became leader 2025.06.18 08:40:15.447992 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Became leader 2025.06.18 08:40:15.448028 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.448057 [ 66585 ] {} KeeperLogStore: Flushing 5 logs 2025.06.18 08:40:15.448064 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.448117 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Trying to startup table from right now 2025.06.18 08:40:15.448162 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Trying to startup table from right now 2025.06.18 08:40:15.448167 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.448210 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.448204 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 7, bytes: 695 2025.06.18 08:40:15.448180 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Will load 'test_function' because always_load_everything flag is set. 2025.06.18 08:40:15.448346 [ 66690 ] {} AsyncLoader: Finish load job 'startup Replicated database test_1_db' with status OK 2025.06.18 08:40:15.448286 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.448376 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.448429 [ 66690 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.448423 [ 66750 ] {} DDLWorker(test_1_db): Starting DDLWorker thread 2025.06.18 08:40:15.448476 [ 66780 ] {} DDLWorker(test_1_db): Started DDLWorker cleanup thread 2025.06.18 08:40:15.448479 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Will load the object 'test_function' immediately, force = false, loading_id = 1 2025.06.18 08:40:15.448664 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Start loading object 'test_function' 2025.06.18 08:40:15.449223 [ 66585 ] {} KeeperLogStore: Flushing 7 logs 2025.06.18 08:40:15.449513 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Creating shared ID for table test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8) 2025.06.18 08:40:15.449577 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Supposed update time for 'test_function' is never (loaded, lifetime 0) 2025.06.18 08:40:15.449982 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Initializing table shared ID with b745176e-a2c0-4636-82c5-00a2bcdacd65 2025.06.18 08:40:15.450033 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Next update time for 'test_function' was set to 294247-01-10 05:00:54 2025.06.18 08:40:15.450310 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Initializing table shared ID with 2e0243fc-9bfd-44af-a800-63263ec63efe 2025.06.18 08:40:15.450337 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 554 2025.06.18 08:40:15.450797 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.451049 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.451230 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.451373 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 7, bytes: 733 2025.06.18 08:40:15.452139 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Initializing table shared ID with cd0456b0-6c04-4385-9a38-0cbbbb1496e7 2025.06.18 08:40:15.452306 [ 66585 ] {} KeeperLogStore: Flushing 7 logs 2025.06.18 08:40:15.452534 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 9, bytes: 863 2025.06.18 08:40:15.452823 [ 65992 ] {} AsyncLoader: Schedule load job 'startup ddl worker' into BackgrndStartup 2025.06.18 08:40:15.453340 [ 66585 ] {} KeeperLogStore: Flushing 9 logs 2025.06.18 08:40:15.453472 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 7, bytes: 730 2025.06.18 08:40:15.454073 [ 65992 ] {} Application: Listening for http://[::]:8123 2025.06.18 08:40:15.454440 [ 66585 ] {} KeeperLogStore: Flushing 7 logs 2025.06.18 08:40:15.454560 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 4, bytes: 430 2025.06.18 08:40:15.455173 [ 65992 ] {} Application: Listening for https://[::]:8443 2025.06.18 08:40:15.455411 [ 66585 ] {} KeeperLogStore: Flushing 4 logs 2025.06.18 08:40:15.456106 [ 65992 ] {} Application: Listening for native protocol (tcp): [::]:9000 2025.06.18 08:40:15.456600 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 9, bytes: 915 2025.06.18 08:40:15.456826 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Adding part all_0_2_1 to current and virtual parts 2025.06.18 08:40:15.456593 [ 66808 ] {} Poco: Queue size: 0, current threads: 0, threads in pool: 3, current connections: 0 2025.06.18 08:40:15.457048 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.457073 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Adding part all_50_93_2 to current and virtual parts 2025.06.18 08:40:15.457143 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Adding part all_0_49_3 to current and virtual parts 2025.06.18 08:40:15.457183 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Adding part all_94_101_1 to current and virtual parts 2025.06.18 08:40:15.457218 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.457394 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/test_3/test_01493/r_prop_table/replicas/1/queue 2025.06.18 08:40:15.457409 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Loading queue from /tables/test_1/data/replicas/data_r1/queue 2025.06.18 08:40:15.457454 [ 65992 ] {} Application: Listening for native protocol (tcp) with PROXY: [::]:9010 2025.06.18 08:40:15.457621 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Creating shared ID for table test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e) 2025.06.18 08:40:15.457637 [ 66585 ] {} KeeperLogStore: Flushing 9 logs 2025.06.18 08:40:15.457851 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Creating shared ID for table test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60) 2025.06.18 08:40:15.458460 [ 65992 ] {} Application: Listening for secure native protocol (tcp_secure): [::]:9440 2025.06.18 08:40:15.458371 [ 66000 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:40718 2025.06.18 08:40:15.458701 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 10, bytes: 1233 2025.06.18 08:40:15.459608 [ 65992 ] {} Application: Listening for MySQL compatibility protocol: [::]:9004 2025.06.18 08:40:15.459848 [ 66585 ] {} KeeperLogStore: Flushing 10 logs 2025.06.18 08:40:15.460282 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Creating shared ID for table test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab) 2025.06.18 08:40:15.460979 [ 65992 ] {} Application: Listening for PostgreSQL compatibility protocol: [::]:9005 2025.06.18 08:40:15.460972 [ 66000 ] {} TCPHandler: Connected ClickHouse client version 24.8.0, revision: 54472, user: default. 2025.06.18 08:40:15.461557 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 13, bytes: 2452 2025.06.18 08:40:15.461584 [ 66000 ] {} TCP-Session-81f7a8d1-e0a0-4195-b847-4d2979936fab: Authenticating user 'default' from [::1]:40718 2025.06.18 08:40:15.461592 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.461798 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.462747 [ 66000 ] {} TCP-Session-81f7a8d1-e0a0-4195-b847-4d2979936fab: 81f7a8d1-e0a0-4195-b847-4d2979936fab Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:15.462913 [ 66000 ] {} TCP-Session-81f7a8d1-e0a0-4195-b847-4d2979936fab: Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:15.463366 [ 66585 ] {} KeeperLogStore: Flushing 13 logs 2025.06.18 08:40:15.463378 [ 65992 ] {} grpc: gRPC EXPERIMENT block_excessive_requests_before_settings_ack ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.463558 [ 65992 ] {} grpc: gRPC EXPERIMENT canary_client_privacy OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.463668 [ 65992 ] {} grpc: gRPC EXPERIMENT chttp2_batch_requests ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.463767 [ 65992 ] {} grpc: gRPC EXPERIMENT chttp2_offload_on_rst_stream ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.463872 [ 65992 ] {} grpc: gRPC EXPERIMENT client_privacy OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.463978 [ 65992 ] {} grpc: gRPC EXPERIMENT combiner_offload_to_event_engine ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464033 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Initializing table shared ID with 2505889b-5cfd-4987-8ccf-6fbac334529e 2025.06.18 08:40:15.464063 [ 65992 ] {} grpc: gRPC EXPERIMENT event_engine_client OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464230 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Initializing table shared ID with 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.464249 [ 65992 ] {} grpc: gRPC EXPERIMENT event_engine_dns OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464365 [ 65992 ] {} grpc: gRPC EXPERIMENT event_engine_listener OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464445 [ 65992 ] {} grpc: gRPC EXPERIMENT free_large_allocator OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464495 [ 65992 ] {} grpc: gRPC EXPERIMENT jitter_max_idle ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464551 [ 65992 ] {} grpc: gRPC EXPERIMENT keepalive_fix OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464599 [ 65992 ] {} grpc: gRPC EXPERIMENT keepalive_server_fix OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464639 [ 65992 ] {} grpc: gRPC EXPERIMENT lazier_stream_updates ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464714 [ 65992 ] {} grpc: gRPC EXPERIMENT memory_pressure_controller OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464784 [ 65992 ] {} grpc: gRPC EXPERIMENT monitoring_experiment ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464853 [ 65992 ] {} grpc: gRPC EXPERIMENT multiping OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464898 [ 65992 ] {} grpc: gRPC EXPERIMENT overload_protection ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.464945 [ 65992 ] {} grpc: gRPC EXPERIMENT peer_state_based_framing OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465029 [ 65992 ] {} grpc: gRPC EXPERIMENT ping_on_rst_stream ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465081 [ 65992 ] {} grpc: gRPC EXPERIMENT promise_based_client_call OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465129 [ 65992 ] {} grpc: gRPC EXPERIMENT promise_based_server_call OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465171 [ 65992 ] {} grpc: gRPC EXPERIMENT red_max_concurrent_streams OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465183 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 784 2025.06.18 08:40:15.465217 [ 65992 ] {} grpc: gRPC EXPERIMENT registered_method_lookup_in_transport ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465313 [ 65992 ] {} grpc: gRPC EXPERIMENT round_robin_delegate_to_pick_first ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465409 [ 65992 ] {} grpc: gRPC EXPERIMENT rstpit OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465484 [ 65992 ] {} grpc: gRPC EXPERIMENT schedule_cancellation_over_write OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465579 [ 65992 ] {} grpc: gRPC EXPERIMENT separate_ping_from_keepalive ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465551 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Initializing table shared ID with 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.465667 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Creating shared ID for table test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb) 2025.06.18 08:40:15.465696 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Creating shared ID for table test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) 2025.06.18 08:40:15.465676 [ 65992 ] {} grpc: gRPC EXPERIMENT server_privacy OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.465773 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Shared ID already set to b745176e-a2c0-4636-82c5-00a2bcdacd65 2025.06.18 08:40:15.465850 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Shared ID already set to 2e0243fc-9bfd-44af-a800-63263ec63efe 2025.06.18 08:40:15.465923 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Updating strategy picker state 2025.06.18 08:40:15.465925 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Creating shared ID for table test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6) 2025.06.18 08:40:15.465982 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.465978 [ 66175 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Updating strategy picker state 2025.06.18 08:40:15.466134 [ 65992 ] {} grpc: gRPC EXPERIMENT settings_timeout ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.466190 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 875 2025.06.18 08:40:15.466314 [ 65992 ] {} grpc: gRPC EXPERIMENT tarpit ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.466582 [ 65992 ] {} grpc: gRPC EXPERIMENT tcp_frame_size_tuning OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.466813 [ 65992 ] {} grpc: gRPC EXPERIMENT tcp_rcv_lowat OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.466972 [ 65992 ] {} grpc: gRPC EXPERIMENT trace_record_callops OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.466982 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Creating shared ID for table test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b) 2025.06.18 08:40:15.466987 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.467145 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 1017 2025.06.18 08:40:15.467158 [ 65992 ] {} grpc: gRPC EXPERIMENT unconstrained_max_quota_buffer_size OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.467165 [ 66000 ] {} ContextAccess (default): Settings: readonly = 0, allow_ddl = true, allow_introspection_functions = true 2025.06.18 08:40:15.467284 [ 65992 ] {} grpc: gRPC EXPERIMENT work_serializer_dispatch OFF (default:OFF) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.467440 [ 65992 ] {} grpc: gRPC EXPERIMENT write_size_cap ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.467551 [ 66000 ] {} ContextAccess (default): List of all grants: GRANT ALL ON *.* WITH GRANT OPTION 2025.06.18 08:40:15.467570 [ 65992 ] {} grpc: gRPC EXPERIMENT write_size_policy ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.467645 [ 66000 ] {} ContextAccess (default): List of all grants including implicit: GRANT ALL ON *.* WITH GRANT OPTION 2025.06.18 08:40:15.467653 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Creating shared ID for table test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8) 2025.06.18 08:40:15.467705 [ 65992 ] {} grpc: gRPC EXPERIMENT wrr_delegate_to_pick_first ON (default:ON) (contrib/grpc/src/core/lib/experiments/config.cc:183) 2025.06.18 08:40:15.467826 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Shared ID already set to cd0456b0-6c04-4385-9a38-0cbbbb1496e7 2025.06.18 08:40:15.467851 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.468997 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 11, bytes: 1822 2025.06.18 08:40:15.469151 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.469196 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.470507 [ 66585 ] {} KeeperLogStore: Flushing 11 logs 2025.06.18 08:40:15.470716 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 9, bytes: 1306 2025.06.18 08:40:15.471956 [ 66750 ] {} DDLWorker(test_1_db): Trying to initialize replication: our_log_ptr=5, max_log_ptr=5, local_digest=7303574483820389215, zk_digest=15600503427515196043 2025.06.18 08:40:15.472059 [ 66585 ] {} KeeperLogStore: Flushing 9 logs 2025.06.18 08:40:15.472035 [ 66750 ] {} DDLWorker(test_1_db): Replica seems to be lost: our_log_ptr=5, max_log_ptr=5, local_digest=7303574483820389215, zk_digest=15600503427515196043 2025.06.18 08:40:15.472167 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup Replicated database test_1_db': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472217 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 491 2025.06.18 08:40:15.472228 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup Atomic database test_1_db': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472335 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup Ordinary database test_1_db': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472398 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup table test_1_db.test_mv2': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472460 [ 66750 ] {} AsyncLoader: Prioritize load job 'load table test_1_db.test_mv2': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:15.472533 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472623 [ 66750 ] {} AsyncLoader: Prioritize load job 'load table test_1_db..inner_id.aab9558b-a4de-43d9-95b0-9362c9cbb8dd': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:15.472634 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Became leader 2025.06.18 08:40:15.472668 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup table test_1_db.test_mv': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472699 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.472725 [ 66750 ] {} AsyncLoader: Prioritize load job 'load table test_1_db.test_mv': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:15.472762 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Became leader 2025.06.18 08:40:15.472799 [ 66750 ] {} AsyncLoader: Prioritize load job 'startup table test_1_db.test_mv3': BackgrndStartup -> ForegroundLoad 2025.06.18 08:40:15.472822 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Trying to startup table from right now 2025.06.18 08:40:15.472850 [ 66750 ] {} AsyncLoader: Prioritize load job 'load table test_1_db.test_mv3': BackgroundLoad -> ForegroundLoad 2025.06.18 08:40:15.472824 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.472815 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Initializing table shared ID with 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.472913 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.473000 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Trying to startup table from right now 2025.06.18 08:40:15.473027 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.473057 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.473005 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.473008 [ 66750 ] {} DatabaseReplicated (test_1_db): Will recover replica with staled log pointer 5 from log pointer 5 2025.06.18 08:40:15.473114 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 353 2025.06.18 08:40:15.473148 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.473236 [ 66750 ] {} DatabaseReplicated (test_1_db): Trying to get consistent metadata snapshot for log pointer 5 2025.06.18 08:40:15.473257 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Initializing table shared ID with 2158dbeb-c487-43d9-8cc4-d3b0d6e2245b 2025.06.18 08:40:15.473324 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Became leader 2025.06.18 08:40:15.473303 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Uncovered unexpected parts: . Restorable unexpected parts: all_1_1_0_3, all_2_2_0_3. Missing parts: . Covered unexpected parts: . Expected parts: all_1_1_0, all_2_2_0. 2025.06.18 08:40:15.473392 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.473443 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Trying to startup table from right now 2025.06.18 08:40:15.473513 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.473495 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): The local set of parts of table test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) doesn't look like the set of parts in ZooKeeper: 0.00 rows of 4.00 total rows in filesystem are suspicious. There are 0 uncovered unexpected parts with 0 rows (0 of them is not just-written with 0 rows), 0 missing parts (with 0 blocks), 0 covered unexpected parts (with 2 rows). 2025.06.18 08:40:15.473570 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.473656 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.473870 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Adding part all_0_0_0_18 to current and virtual parts 2025.06.18 08:40:15.473918 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.473923 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Adding part all_0_2_1 to current and virtual parts 2025.06.18 08:40:15.473968 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.473980 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/replicas/r12/queue 2025.06.18 08:40:15.474046 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/test_3/test_01493/r_prop_table/replicas/2/queue 2025.06.18 08:40:15.474045 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 9, bytes: 1509 2025.06.18 08:40:15.474406 [ 65992 ] {} grpc: grpc epoll fd: 80 (contrib/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:123) 2025.06.18 08:40:15.474649 [ 65992 ] {} grpc: Using polling engine: epoll1 (contrib/grpc/src/core/lib/iomgr/ev_posix.cc:113) 2025.06.18 08:40:15.474782 [ 66585 ] {} KeeperLogStore: Flushing 9 logs 2025.06.18 08:40:15.474853 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Creating shared ID for table test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e) 2025.06.18 08:40:15.475162 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Creating shared ID for table test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) 2025.06.18 08:40:15.475638 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 15, bytes: 1934 2025.06.18 08:40:15.476783 [ 66585 ] {} KeeperLogStore: Flushing 15 logs 2025.06.18 08:40:15.476904 [ 65992 ] {} grpc: registering LB policy factory for "priority_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.476952 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 756 2025.06.18 08:40:15.477112 [ 65992 ] {} grpc: registering LB policy factory for "outlier_detection_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.477309 [ 65992 ] {} grpc: registering LB policy factory for "weighted_target_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.477419 [ 65992 ] {} grpc: registering LB policy factory for "pick_first" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.477552 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Creating shared ID for table test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e) 2025.06.18 08:40:15.477579 [ 65992 ] {} grpc: registering LB policy factory for "round_robin" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.477649 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Shared ID already set to 2505889b-5cfd-4987-8ccf-6fbac334529e 2025.06.18 08:40:15.477746 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Creating shared ID for table test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60) 2025.06.18 08:40:15.477850 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Shared ID already set to 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.477908 [ 65992 ] {} grpc: registering LB policy factory for "weighted_round_robin" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.478006 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.478095 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.478108 [ 65992 ] {} grpc: registering LB policy factory for "grpclb" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.478212 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.478214 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Creating shared ID for table test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab) 2025.06.18 08:40:15.478282 [ 66171 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Strategy picker state updated, current replica: 0, active replicas: [1, 2] 2025.06.18 08:40:15.478330 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Shared ID already set to 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.478338 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.478358 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.478428 [ 65992 ] {} grpc: Using ares dns resolver (contrib/grpc/src/core/ext/filters/client_channel/resolver/dns/dns_resolver_plugin.cc:50) 2025.06.18 08:40:15.478700 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Initializing table shared ID with 4e11015e-c5c0-4326-ab61-54b8bd356a9e 2025.06.18 08:40:15.478706 [ 65992 ] {} grpc: registering LB policy factory for "rls_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.478944 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Initializing table shared ID with 2e0243fc-9bfd-44af-a800-63263ec63efe 2025.06.18 08:40:15.479171 [ 65992 ] {} grpc: registering LB policy factory for "xds_cluster_manager_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.479329 [ 65992 ] {} grpc: registering LB policy factory for "xds_cluster_impl_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.479483 [ 65992 ] {} grpc: registering LB policy factory for "cds_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.479638 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 13, bytes: 1977 2025.06.18 08:40:15.479658 [ 65992 ] {} grpc: registering LB policy factory for "xds_cluster_resolver_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.479799 [ 65992 ] {} grpc: registering LB policy factory for "xds_override_host_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.479939 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Became leader 2025.06.18 08:40:15.479965 [ 65992 ] {} grpc: registering LB policy factory for "xds_wrr_locality_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.480005 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.480101 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Trying to startup table from right now 2025.06.18 08:40:15.480129 [ 65992 ] {} grpc: registering LB policy factory for "ring_hash_experimental" (contrib/grpc/src/core/lib/load_balancing/lb_policy_registry.cc:47) 2025.06.18 08:40:15.480166 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.480245 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.480302 [ 65992 ] {} grpc: registering certificate provider factory for "file_watcher" (contrib/grpc/src/core/lib/security/certificate_provider/certificate_provider_registry.cc:33) 2025.06.18 08:40:15.481258 [ 66585 ] {} KeeperLogStore: Flushing 13 logs 2025.06.18 08:40:15.481875 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Became leader 2025.06.18 08:40:15.481941 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Updating strategy picker state 2025.06.18 08:40:15.481943 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.482005 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Updating strategy picker state 2025.06.18 08:40:15.482035 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Trying to startup table from right now 2025.06.18 08:40:15.482237 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.482419 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Became leader 2025.06.18 08:40:15.482559 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.482489 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.482641 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Trying to startup table from right now 2025.06.18 08:40:15.482660 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 14, bytes: 1627 2025.06.18 08:40:15.482783 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.482989 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.484158 [ 66585 ] {} KeeperLogStore: Flushing 14 logs 2025.06.18 08:40:15.485124 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Creating shared ID for table test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6) 2025.06.18 08:40:15.485343 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Shared ID already set to 94171f7a-506b-42ba-82b6-6e867df1bcab 2025.06.18 08:40:15.485646 [ 66750 ] {} DatabaseReplicated (test_1_db): Got consistent metadata snapshot for log pointer 5 2025.06.18 08:40:15.485850 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 263 2025.06.18 08:40:15.486157 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.486241 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Creating shared ID for table test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b) 2025.06.18 08:40:15.486549 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 227 2025.06.18 08:40:15.486719 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Shared ID already set to 2158dbeb-c487-43d9-8cc4-d3b0d6e2245b 2025.06.18 08:40:15.486842 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.487016 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.487241 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.487430 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Became leader 2025.06.18 08:40:15.487488 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.487572 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Trying to startup table from right now 2025.06.18 08:40:15.487615 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.487851 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.488028 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.488298 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Became leader 2025.06.18 08:40:15.488414 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Adding part all_2_2_0_3 to current and virtual parts 2025.06.18 08:40:15.488437 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 370 2025.06.18 08:40:15.488464 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Adding part all_1_1_0_3 to current and virtual parts 2025.06.18 08:40:15.488511 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.488564 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Loading queue from /test/02485/test_1/rmt/replicas/2/queue 2025.06.18 08:40:15.488593 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Adding part all_0_0_0 to current and virtual parts 2025.06.18 08:40:15.488738 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.488695 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.488800 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Trying to startup table from right now 2025.06.18 08:40:15.488838 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Creating shared ID for table test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e) 2025.06.18 08:40:15.488855 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.488892 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Loading queue from /test/02922/test_1/table/replicas/2/queue 2025.06.18 08:40:15.488924 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.488954 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Creating shared ID for table test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) 2025.06.18 08:40:15.488977 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Shared ID already set to 4e11015e-c5c0-4326-ab61-54b8bd356a9e 2025.06.18 08:40:15.488963 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.489080 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Adding part all_94_101_1 to current and virtual parts 2025.06.18 08:40:15.489206 [ 66181 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Strategy picker state updated, current replica: 1, active replicas: [1, 2] 2025.06.18 08:40:15.489214 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Adding part all_50_93_2 to current and virtual parts 2025.06.18 08:40:15.489295 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.489265 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Shared ID already set to 2e0243fc-9bfd-44af-a800-63263ec63efe 2025.06.18 08:40:15.489448 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Adding part all_0_49_3 to current and virtual parts 2025.06.18 08:40:15.489607 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.489672 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Loading queue from /tables/test_1/data/replicas/data_r2/queue 2025.06.18 08:40:15.489884 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 860 2025.06.18 08:40:15.490503 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.491290 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.491530 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.491776 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Became leader 2025.06.18 08:40:15.492077 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Became leader 2025.06.18 08:40:15.492140 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.492194 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.492232 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.492319 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: false 2025.06.18 08:40:15.492468 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Trying to startup table from right now 2025.06.18 08:40:15.492582 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.492592 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to startup table from right now 2025.06.18 08:40:15.492630 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.492658 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.492815 [ 66750 ] {} DatabaseReplicated (test_1_db): Starting first stage of renaming process. Will rename tables to intermediate names 2025.06.18 08:40:15.492845 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.492755 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 430 2025.06.18 08:40:15.492756 [ 66177 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Strategy picker state updated, current replica: 0, active replicas: [r12, r15] 2025.06.18 08:40:15.492903 [ 66750 ] {} DatabaseReplicated (test_1_db): Starting second stage of renaming process. Will rename tables from intermediate to desired names 2025.06.18 08:40:15.492833 [ 66194 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Updating strategy picker state 2025.06.18 08:40:15.492834 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.492966 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.493186 [ 66750 ] {} DatabaseReplicated (test_1_db): Renames completed successfully 2025.06.18 08:40:15.492663 [ 66192 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Updating strategy picker state 2025.06.18 08:40:15.493024 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.493152 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Updating strategy picker state 2025.06.18 08:40:15.493317 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.494009 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 360 2025.06.18 08:40:15.494219 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.494321 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/test_3/test_table_replicated/replicas/1_replica/queue 2025.06.18 08:40:15.494631 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Adding part all_0_0_0_18 to current and virtual parts 2025.06.18 08:40:15.494935 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.495037 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.495133 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/replicas/r15/queue 2025.06.18 08:40:15.495614 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeQueue): Removing part all_0_2_1 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.495854 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Adding part all_0_0_0_18 to current and virtual parts 2025.06.18 08:40:15.495957 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.496197 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.496295 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.496289 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/replicas/r11/queue 2025.06.18 08:40:15.496477 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.496499 [ 65992 ] {} grpc: grpc epoll fd: 81 (contrib/grpc/src/core/lib/event_engine/posix_engine/ev_epoll1_linux.cc:360) 2025.06.18 08:40:15.496640 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.496759 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 333 2025.06.18 08:40:15.496843 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.497054 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Removing part all_0_49_3 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.497131 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Removing part all_50_93_2 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.497189 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.497219 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Adding part all_0_0_0_18 to current and virtual parts 2025.06.18 08:40:15.497188 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeQueue): Removing part all_94_101_1 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.497264 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.497282 [ 66207 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Updating strategy picker state 2025.06.18 08:40:15.497330 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.497336 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/replicas/r14/queue 2025.06.18 08:40:15.497391 [ 65992 ] {} grpc: TCP_USER_TIMEOUT is available. TCP_USER_TIMEOUT will be used thereafter (contrib/grpc/src/core/lib/iomgr/socket_utils_common_posix.cc:366) 2025.06.18 08:40:15.497869 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 287 2025.06.18 08:40:15.498036 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Updating strategy picker state 2025.06.18 08:40:15.498070 [ 65992 ] {} Application: Listening for gRPC protocol: [::]:9100 2025.06.18 08:40:15.498198 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Adding part 19901115_1_1_0 to current and virtual parts 2025.06.18 08:40:15.498262 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Adding part 20201216_1_1_0 to current and virtual parts 2025.06.18 08:40:15.498503 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Adding part 20201216_0_0_0 to current and virtual parts 2025.06.18 08:40:15.498526 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.499316 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Adding part 19901115_0_0_0 to current and virtual parts 2025.06.18 08:40:15.499385 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.499732 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/test_1/test_01513/sequence_consistency/replicas/1/queue 2025.06.18 08:40:15.500111 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.500305 [ 65992 ] {} Application: Listening for Prometheus: http://[::]:9988 2025.06.18 08:40:15.500324 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.500392 [ 66196 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Strategy picker state updated, current replica: 1, active replicas: [data_r1, data_r2] 2025.06.18 08:40:15.500436 [ 65992 ] {} ZooKeeperClient: ZK send fault: 0.002% 2025.06.18 08:40:15.500468 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.500510 [ 65992 ] {} ZooKeeperClient: ZK recv fault: 0.002% 2025.06.18 08:40:15.500566 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.500614 [ 65992 ] {} ZooKeeperClient: ZK send sleep: 0.001% -> 10000ms 2025.06.18 08:40:15.500670 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.500673 [ 65992 ] {} Application: Ready for connections. 2025.06.18 08:40:15.500637 [ 66249 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.500713 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Updating strategy picker state 2025.06.18 08:40:15.500915 [ 66171 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.500882 [ 66249 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.501068 [ 66779 ] {} AsyncLoader: Finish load job 'startup table test_3.r_prop_table1' with status OK 2025.06.18 08:40:15.501132 [ 66779 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.501142 [ 66249 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.501186 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.501272 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeQueue): Removing part all_0_2_1 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.501298 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.501719 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.501852 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Updating strategy picker state 2025.06.18 08:40:15.501982 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Adding part all_0_31_4_27 to current and virtual parts 2025.06.18 08:40:15.502102 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.502271 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/test_1/t_rename_alter/replicas/1/queue 2025.06.18 08:40:15.502843 [ 66222 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Updating strategy picker state 2025.06.18 08:40:15.502791 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.503061 [ 66260 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.503270 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Adding part all_2_2_0 to current and virtual parts 2025.06.18 08:40:15.503301 [ 66260 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.503341 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Adding part all_1_1_0 to current and virtual parts 2025.06.18 08:40:15.503330 [ 66175 ] {} test_1.data_r1 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.503405 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.503458 [ 66260 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.503493 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Loading queue from /test/02485/test_1/rmt/replicas/1/queue 2025.06.18 08:40:15.503679 [ 66781 ] {} AsyncLoader: Finish load job 'startup table test_1.data_r1' with status OK 2025.06.18 08:40:15.503680 [ 66250 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (3 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/test_3/test_01493/r_prop_table/blocks 2025.06.18 08:40:15.503795 [ 66781 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.503835 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.504294 [ 66750 ] {} DatabaseReplicated (test_1_db): Executing CREATE TABLE test_1_db.test UUID '11f42169-9eff-4b61-8e51-028670c5bb71' (`id` UInt64) ENGINE = MergeTree ORDER BY id SETTINGS index_granularity = 763, min_bytes_for_wide_part = 1073741824, ratio_of_defaults_for_sparse_serialization = 0., replace_long_file_name_to_hash = true, max_file_name_length = 5, min_bytes_for_full_part_storage = 0, compact_parts_max_bytes_to_buffer = 151093591, compact_parts_max_granules_to_buffer = 142, compact_parts_merge_max_bytes_to_prefetch_part = 16171687, merge_max_block_size = 21274, old_parts_lifetime = 134., prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 57, min_merge_bytes_to_use_direct_io = 5499818913, index_granularity_bytes = 4512365, concurrent_part_removal_threshold = 34, allow_vertical_merges_from_compact_to_wide_parts = false, cache_populated_by_fetch = false, marks_compress_block_size = 95360, primary_key_compress_block_size = 94096 2025.06.18 08:40:15.505350 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Having 2 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.505522 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeQueue): Removing part all_0_0_0_18 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.505704 [ 66271 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.505898 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.505960 [ 66271 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.506021 [ 66181 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.506190 [ 66271 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.506265 [ 66737 ] {} AsyncLoader: Finish load job 'startup table test_3.r_prop_table2' with status OK 2025.06.18 08:40:15.506276 [ 66238 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Updating strategy picker state 2025.06.18 08:40:15.506498 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.506530 [ 66737 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.506827 [ 66212 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Strategy picker state updated, current replica: 3, active replicas: [r11, r12, r14, r15] 2025.06.18 08:40:15.506901 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.507777 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Insert entry queue-0000000002 to queue with type MUTATE_PART with virtual parts [all_1_1_0_3] 2025.06.18 08:40:15.507907 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Adding part all_1_1_0_3 to mutations 2025.06.18 08:40:15.508117 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Insert entry queue-0000000003 to queue with type MUTATE_PART with virtual parts [all_2_2_0_3] 2025.06.18 08:40:15.508195 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Adding part all_2_2_0_3 to mutations 2025.06.18 08:40:15.508180 [ 66000 ] {} TCP-Session-81f7a8d1-e0a0-4195-b847-4d2979936fab: 81f7a8d1-e0a0-4195-b847-4d2979936fab Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2025.06.18 08:40:15.509268 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2025.06.18 08:40:15.509467 [ 66216 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Strategy picker state updated, current replica: 0, active replicas: [r11, r12, r14, r15] 2025.06.18 08:40:15.509750 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.509768 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Updating strategy picker state 2025.06.18 08:40:15.509918 [ 66000 ] {e2344871-c2fa-465e-b54a-3a9ebfa4967d} executeQuery: Query span trace_id for opentelemetry log: 97614677-eb6c-ef51-89c8-392123046a93 2025.06.18 08:40:15.510002 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.510416 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.510512 [ 66282 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Number of queued merges (0) and part mutations (0) is greater than max_replicated_merges_in_queue (0), so won't select new parts to merge or mutate. 2025.06.18 08:40:15.510875 [ 66000 ] {e2344871-c2fa-465e-b54a-3a9ebfa4967d} executeQuery: (from [::1]:40718) SELECT 1 (stage: Complete) 2025.06.18 08:40:15.510898 [ 66220 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Strategy picker state updated, current replica: 2, active replicas: [r11, r12, r14, r15] 2025.06.18 08:40:15.510896 [ 66177 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.511011 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeQueue): Removing part all_0_0_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.511046 [ 66282 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Scheduling next merge selecting task after 60000ms, current attempt status: Limited 2025.06.18 08:40:15.511118 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.511192 [ 66268 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeCleanupThread): Checking 3 blocks (3 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/test_3/test_01493/r_prop_table/blocks 2025.06.18 08:40:15.511248 [ 66782 ] {} AsyncLoader: Finish load job 'startup table test_1.concurrent_kill_2' with status OK 2025.06.18 08:40:15.511322 [ 66782 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.511691 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 1 partitions (data versions: all = 3; ) 2025.06.18 08:40:15.513132 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Removing part all_0_49_3 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.513214 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Removing part all_50_93_2 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.513269 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeQueue): Removing part all_94_101_1 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.513623 [ 66000 ] {e2344871-c2fa-465e-b54a-3a9ebfa4967d} Planner: Query to stage Complete 2025.06.18 08:40:15.514327 [ 66235 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Strategy picker state updated, current replica: 0, active replicas: [1, 2] 2025.06.18 08:40:15.514509 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.514579 [ 66279 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/blocks 2025.06.18 08:40:15.514747 [ 66000 ] {e2344871-c2fa-465e-b54a-3a9ebfa4967d} Planner: Query from stage FetchColumns to stage Complete 2025.06.18 08:40:15.514841 [ 66290 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.515093 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.515126 [ 66290 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.515373 [ 66290 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.515481 [ 66194 ] {} test_1.r2 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.515670 [ 66778 ] {} AsyncLoader: Finish load job 'startup table test_1.r2' with status OK 2025.06.18 08:40:15.515781 [ 66778 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.516472 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Removing part all_1_1_0_3 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.516647 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Removing part all_2_2_0_3 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.516743 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.516815 [ 66298 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.517455 [ 66207 ] {} test_3.test_table_replicated (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.517705 [ 66728 ] {} AsyncLoader: Finish load job 'startup table test_3.test_table_replicated' with status OK 2025.06.18 08:40:15.517804 [ 66728 ] {} AsyncLoader: Spawn loader worker #10 in BackgrndStartup 2025.06.18 08:40:15.517932 [ 66728 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_3' in BackgrndStartup 2025.06.18 08:40:15.517993 [ 66728 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_3' with status OK 2025.06.18 08:40:15.518000 [ 66750 ] {} test_1_db.test (11f42169-9eff-4b61-8e51-028670c5bb71): Loading data parts 2025.06.18 08:40:15.518061 [ 66728 ] {} AsyncLoader: Spawn loader worker #11 in BackgrndStartup 2025.06.18 08:40:15.518124 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeQueue): Removing part all_0_0_0_18 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.518263 [ 66728 ] {} AsyncLoader: Execute load job 'startup Atomic database test_3' in BackgrndStartup 2025.06.18 08:40:15.518341 [ 66728 ] {} AsyncLoader: Finish load job 'startup Atomic database test_3' with status OK 2025.06.18 08:40:15.518391 [ 66728 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.518462 [ 66730 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.518546 [ 66750 ] {} test_1_db.test (11f42169-9eff-4b61-8e51-028670c5bb71): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.518416 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.518589 [ 66734 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.518839 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Loading 2 mutation entries: 0000000000 - 0000000001 2025.06.18 08:40:15.518865 [ 66750 ] {} test_1_db.test (11f42169-9eff-4b61-8e51-028670c5bb71): There are no data parts 2025.06.18 08:40:15.518892 [ 66196 ] {} test_1.data_r2 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.519168 [ 66783 ] {} AsyncLoader: Finish load job 'startup table test_1.data_r2' with status OK 2025.06.18 08:40:15.519244 [ 66783 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.519266 [ 66308 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.519422 [ 66308 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.519469 [ 66287 ] {} test_1.r2 (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /test/02922/test_1/table/blocks 2025.06.18 08:40:15.519557 [ 66308 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.519618 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Removing part 19901115_0_0_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.519693 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Removing part 19901115_1_1_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.519743 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Removing part 20201216_0_0_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.519804 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeQueue): Removing part 20201216_1_1_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.520339 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeQueue): Removing part all_0_0_0_18 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.520597 [ 66750 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.520691 [ 66750 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.520848 [ 66750 ] {} DatabaseReplicated (test_1_db): Counting attached table test to database test_1_db 2025.06.18 08:40:15.521685 [ 66315 ] {} test_1.rmt2 (ReplicatedMergeTreeQueue): Marking mutation 0000000000 done because it is <= mutation_pointer (0000000000) 2025.06.18 08:40:15.521734 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.522101 [ 66192 ] {} test_1.rmt2 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.522296 [ 66313 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.522478 [ 66688 ] {} AsyncLoader: Finish load job 'startup table test_1.rmt2' with status OK 2025.06.18 08:40:15.522530 [ 66000 ] {e2344871-c2fa-465e-b54a-3a9ebfa4967d} executeQuery: Read 1 rows, 1.00 B in 0.01217 sec., 82.16926869350863 rows/sec., 82.17 B/sec. 2025.06.18 08:40:15.522565 [ 66688 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.522533 [ 66313 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.522662 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 1 partitions (data versions: all = 25; ) 2025.06.18 08:40:15.522789 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Adding mutation 0000000001 for 1 partitions (data versions: all = 27; ) 2025.06.18 08:40:15.522908 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeQueue): Removing part all_0_0_0_18 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.523142 [ 66000 ] {e2344871-c2fa-465e-b54a-3a9ebfa4967d} TCPHandler: Processed in 0.016413624 sec. 2025.06.18 08:40:15.523788 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.523936 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Loading 1 mutation entries: 0000000000 - 0000000000 2025.06.18 08:40:15.524010 [ 66324 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Number of queued merges (0) and part mutations (0) is greater than max_replicated_merges_in_queue (0), so won't select new parts to merge or mutate. 2025.06.18 08:40:15.524444 [ 66324 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Scheduling next merge selecting task after 60000ms, current attempt status: Limited 2025.06.18 08:40:15.524524 [ 66750 ] {} DatabaseReplicated (test_1_db): Executing CREATE TABLE test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` UUID '02fc079f-8864-4071-b4bb-fcd1b6184cae' (`id` UInt64) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{uuid}/{shard}', '{replica}') ORDER BY id SETTINGS index_granularity = 8192 2025.06.18 08:40:15.524575 [ 66212 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.524753 [ 66772 ] {} AsyncLoader: Finish load job 'startup table test_1.concurrent_kill_5' with status OK 2025.06.18 08:40:15.524842 [ 66772 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.526180 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Removing part all_0_31_4_27 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.526261 [ 66263 ] {} test_1.data_r1 (ReplicatedMergeTreeCleanupThread): Checking 100 blocks (100 are not cached) to clear old ones from ZooKeeper., path is /tables/test_1/data/blocks 2025.06.18 08:40:15.526232 [ 66339 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Number of queued merges (0) and part mutations (0) is greater than max_replicated_merges_in_queue (0), so won't select new parts to merge or mutate. 2025.06.18 08:40:15.526484 [ 66339 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Scheduling next merge selecting task after 60000ms, current attempt status: Limited 2025.06.18 08:40:15.526676 [ 66318 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /test/02485/test_1/rmt/blocks 2025.06.18 08:40:15.526862 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Adding mutation 0000000000 for 1 partitions (data versions: all = 3; ) 2025.06.18 08:40:15.527880 [ 66333 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Number of queued merges (0) and part mutations (0) is greater than max_replicated_merges_in_queue (0), so won't select new parts to merge or mutate. 2025.06.18 08:40:15.528237 [ 66333 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Scheduling next merge selecting task after 60000ms, current attempt status: Limited 2025.06.18 08:40:15.528570 [ 66346 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b) (MergerMutator): Nothing to merge in partition 19901115: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.528263 [ 66323 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/blocks 2025.06.18 08:40:15.528846 [ 66346 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b) (MergerMutator): Nothing to merge in partition 20201216: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.528868 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.529019 [ 66346 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b) (MergerMutator): Checked 2 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.529104 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.529300 [ 66346 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.529480 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.529635 [ 66222 ] {} test_1.quorum1 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.529776 [ 66765 ] {} AsyncLoader: Finish load job 'startup table test_1.quorum1' with status OK 2025.06.18 08:40:15.529741 [ 66216 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.529886 [ 66765 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.529964 [ 66786 ] {} AsyncLoader: Finish load job 'startup table test_1.concurrent_kill_1' with status OK 2025.06.18 08:40:15.530028 [ 66786 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.530107 [ 66220 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.530317 [ 66767 ] {} AsyncLoader: Finish load job 'startup table test_1.concurrent_kill_4' with status OK 2025.06.18 08:40:15.530411 [ 66767 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.535204 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Loading data parts 2025.06.18 08:40:15.535746 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.535821 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): There are no data parts 2025.06.18 08:40:15.536258 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.536432 [ 66238 ] {} test_1.t_rename_alter (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.536587 [ 66766 ] {} AsyncLoader: Finish load job 'startup table test_1.t_rename_alter' with status OK 2025.06.18 08:40:15.536640 [ 66766 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.536253 [ 66365 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Marking mutation 0000000000 done because it is <= mutation_pointer (0000000001) 2025.06.18 08:40:15.536825 [ 66365 ] {} test_1.t_rename_alter (ReplicatedMergeTreeQueue): Marking mutation 0000000001 done because it is <= mutation_pointer (0000000001) 2025.06.18 08:40:15.537013 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 278 2025.06.18 08:40:15.537364 [ 66366 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e) (MergerMutator): Nothing to merge in partition all: Did not find any parts to merge (with usual merge selectors) 2025.06.18 08:40:15.537456 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Removing part all_1_1_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.537492 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.537476 [ 66366 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e) (MergerMutator): Checked 1 partitions, found 0 partitions with parts that may be merged: [] (max_total_size_to_merge=161061273600, merge_with_ttl_allowed=true) 2025.06.18 08:40:15.537528 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Removing part all_2_2_0 from mutations (remove_part: false, remove_covered_parts: true) 2025.06.18 08:40:15.538750 [ 66345 ] {} test_1.quorum1 (ReplicatedMergeTreeCleanupThread): Checking 4 blocks (4 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/test_1/test_01513/sequence_consistency/blocks 2025.06.18 08:40:15.538836 [ 66351 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/blocks 2025.06.18 08:40:15.540382 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Creating table /clickhouse/tables/02fc079f-8864-4071-b4bb-fcd1b6184cae/s1 2025.06.18 08:40:15.540596 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.540530 [ 66370 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.540928 [ 66235 ] {} test_1.rmt1 (ReplicatedMergeTreeAttachThread): Table is initialized 2025.06.18 08:40:15.541089 [ 66777 ] {} AsyncLoader: Finish load job 'startup table test_1.rmt1' with status OK 2025.06.18 08:40:15.541139 [ 66777 ] {} AsyncLoader: Spawn loader worker #2 in BackgrndStartup 2025.06.18 08:40:15.541174 [ 66345 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Will drop empty part 20201216_1_1_0 2025.06.18 08:40:15.541182 [ 66370 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.541355 [ 66345 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Will try to insert a log entry to DROP_PART for part 20201216_1_1_0 2025.06.18 08:40:15.541386 [ 66777 ] {} AsyncLoader: Execute load job 'startup Ordinary database test_1' in BackgrndStartup 2025.06.18 08:40:15.541447 [ 66777 ] {} AsyncLoader: Finish load job 'startup Ordinary database test_1' with status OK 2025.06.18 08:40:15.541476 [ 66777 ] {} AsyncLoader: Spawn loader worker #3 in BackgrndStartup 2025.06.18 08:40:15.541557 [ 66777 ] {} AsyncLoader: Execute load job 'startup Atomic database test_1' in BackgrndStartup 2025.06.18 08:40:15.541623 [ 66722 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.541641 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:15.541726 [ 66777 ] {} AsyncLoader: Finish load job 'startup Atomic database test_1' with status OK 2025.06.18 08:40:15.541781 [ 66777 ] {} AsyncLoader: Spawn loader worker #3 in BackgrndStartup 2025.06.18 08:40:15.541873 [ 66777 ] {} AsyncLoader: Execute load job 'startup ddl worker' in BackgrndStartup 2025.06.18 08:40:15.541939 [ 66684 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.541972 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.542127 [ 66313 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.542125 [ 66785 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.542258 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 4957 2025.06.18 08:40:15.542273 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.542402 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.544792 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.549344 [ 66207 ] {} test_1.data_r2 (ReplicatedMergeTreeCleanupThread): Checking 100 blocks (100 are not cached) to clear old ones from ZooKeeper., path is /tables/test_1/data/blocks 2025.06.18 08:40:15.549332 [ 66374 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Checking 2 blocks (2 are not cached) to clear old ones from ZooKeeper., path is /test/02485/test_1/rmt/blocks 2025.06.18 08:40:15.549832 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.550108 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.556119 [ 66366 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.556785 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:15.556898 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:15.557418 [ 66375 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Scheduling next merge selecting task after 60000ms, current attempt status: CannotSelect 2025.06.18 08:40:15.557525 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 128 2025.06.18 08:40:15.557644 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Creating shared ID for table test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae) 2025.06.18 08:40:15.557808 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.557851 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:15.557898 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 410 2025.06.18 08:40:15.557915 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:15.557961 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:15.558083 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:15.558101 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:15.558272 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:15.558458 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.558574 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 137 2025.06.18 08:40:15.559025 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.559775 [ 66615 ] {} Poco: Queue size: 0, current threads: 0, threads in pool: 3, current connections: 0 2025.06.18 08:40:15.560019 [ 66615 ] {} Poco: Queue size: 1, current threads: 1, threads in pool: 3, current connections: 0 2025.06.18 08:40:15.560112 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Shared ID for table test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae) doesn't exist in ZooKeeper on path /clickhouse/tables/02fc079f-8864-4071-b4bb-fcd1b6184cae/s1/table_shared_id 2025.06.18 08:40:15.560370 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Got candidate ID 02fc079f-8864-4071-b4bb-fcd1b6184cae, will try to create it in ZooKeeper on path /clickhouse/tables/02fc079f-8864-4071-b4bb-fcd1b6184cae/s1/table_shared_id 2025.06.18 08:40:15.560806 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 173 2025.06.18 08:40:15.561128 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.561469 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:15.561481 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:15.562030 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Initializing table shared ID with 02fc079f-8864-4071-b4bb-fcd1b6184cae 2025.06.18 08:40:15.562174 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:15.562170 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:15.562335 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:15.562344 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:15.562481 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 134 2025.06.18 08:40:15.562794 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.562890 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 420 2025.06.18 08:40:15.563566 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.563678 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 5, bytes: 712 2025.06.18 08:40:15.564587 [ 66585 ] {} KeeperLogStore: Flushing 5 logs 2025.06.18 08:40:15.566125 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 150 2025.06.18 08:40:15.566293 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:15.566322 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:15.566388 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:15.566390 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.566474 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:15.566442 [ 66000 ] {} TCPHandler: Closing connection (open: true, cancelled: false, eof: true) 2025.06.18 08:40:15.566462 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:15.566605 [ 66000 ] {} TCPHandler: Done processing connection. 2025.06.18 08:40:15.566617 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:15.566652 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:15.566755 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:15.566922 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:15.566945 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 149 2025.06.18 08:40:15.566967 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:15.567247 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.567535 [ 66340 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeCleanupThread): Checking 1 blocks (1 are not cached) to clear old ones from ZooKeeper., path is /clickhouse/tables/01593_concurrent_alter_mutations_kill_many_replicas_long_test_1/s1/blocks 2025.06.18 08:40:15.567658 [ 66000 ] {} TCP-Session-81f7a8d1-e0a0-4195-b847-4d2979936fab: 81f7a8d1-e0a0-4195-b847-4d2979936fab Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:15.568206 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Creating shared ID for table test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae) 2025.06.18 08:40:15.568319 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Shared ID already set to 02fc079f-8864-4071-b4bb-fcd1b6184cae 2025.06.18 08:40:15.569658 [ 66750 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.569752 [ 66750 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.570062 [ 66750 ] {} DatabaseReplicated (test_1_db): Counting attached table .inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac to database test_1_db 2025.06.18 08:40:15.570532 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Starting up table 2025.06.18 08:40:15.571200 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:15.571315 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:15.571397 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:15.571498 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:15.571872 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 404 2025.06.18 08:40:15.572361 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.572433 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 380 2025.06.18 08:40:15.573319 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.573532 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Became leader 2025.06.18 08:40:15.573709 [ 66750 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2025.06.18 08:40:15.573996 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.574240 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.574249 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:15.574416 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:15.574614 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:15.574773 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:15.575972 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 406 2025.06.18 08:40:15.576393 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.577959 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.578147 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:15.578343 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:15.578471 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.578573 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:15.578610 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.578677 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.578726 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/02fc079f-8864-4071-b4bb-fcd1b6184cae/s1/replicas/r1/queue 2025.06.18 08:40:15.578736 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:15.578871 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.578928 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.578969 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.579036 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.579135 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.579152 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.579302 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.579369 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.579391 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.579496 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.579602 [ 66619 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.580049 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Updating strategy picker state 2025.06.18 08:40:15.580190 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:15.580230 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:15.580313 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:15.580429 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.580464 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:15.580618 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.580679 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.580768 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.580869 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.580933 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.581030 [ 66619 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.581030 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.581237 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.581292 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.581480 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.581584 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.581743 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.581805 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:15.581940 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:15.582043 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.582230 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.582370 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.582472 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.582530 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.582631 [ 66619 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.582992 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:15.583137 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:15.583265 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.583279 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:15.583394 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:15.583495 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.583504 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.583730 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.583797 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.583858 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.583952 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.583961 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.584067 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.584134 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.584139 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.584309 [ 66619 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.584403 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 91 2025.06.18 08:40:15.584981 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:15.585010 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:15.584993 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.585144 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:15.585159 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:15.585277 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.585296 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.585434 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.585529 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.585574 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.585751 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.585804 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.585788 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.585909 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.586004 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.586060 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.586199 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.586637 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:15.586734 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:15.586812 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.586963 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.587081 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.587106 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:15.587180 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.587241 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.587275 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:15.587338 [ 66619 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.587431 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.587714 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.587870 [ 66619 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:15.587901 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.587985 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:15.588033 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.588074 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.588111 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.588236 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.588238 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.588366 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66619, kind: Regular, unbound: 0 2025.06.18 08:40:15.588588 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.588651 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.588734 [ 66619 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.589034 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:15.589480 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:15.589620 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:15.591612 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:15.591662 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.591678 [ 66384 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.591874 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.591914 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:15.591960 [ 66389 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Scheduling next merge selecting task after 6096ms, current attempt status: CannotSelect 2025.06.18 08:40:15.592023 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:15.592037 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.592145 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.592185 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.592306 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.592925 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:15.593042 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:15.593158 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.593189 [ 66750 ] {} DatabaseReplicated (test_1_db): Executing CREATE TABLE test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` UUID '959bd902-bb2e-422b-83b3-85dced7f8d15' (`id` UInt64) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{uuid}/{shard}', '{replica}') ORDER BY id SETTINGS index_granularity = 8192 2025.06.18 08:40:15.593359 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.593522 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:15.593646 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:15.593709 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:15.593851 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:15.594195 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:15.594986 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:15.595387 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:15.595509 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:15.595698 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:15.598368 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:15.602615 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Loading data parts 2025.06.18 08:40:15.602962 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): loadDataParts: clearing data_parts_indexes (had 0 parts) 2025.06.18 08:40:15.603026 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): There are no data parts 2025.06.18 08:40:15.603317 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 278 2025.06.18 08:40:15.603580 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.604973 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Creating table /clickhouse/tables/959bd902-bb2e-422b-83b3-85dced7f8d15/s1 2025.06.18 08:40:15.606241 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 4957 2025.06.18 08:40:15.608945 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.617703 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Creating shared ID for table test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15) 2025.06.18 08:40:15.617785 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 2, bytes: 266 2025.06.18 08:40:15.618381 [ 66585 ] {} KeeperLogStore: Flushing 2 logs 2025.06.18 08:40:15.618524 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 409 2025.06.18 08:40:15.619341 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.620087 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Shared ID for table test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15) doesn't exist in ZooKeeper on path /clickhouse/tables/959bd902-bb2e-422b-83b3-85dced7f8d15/s1/table_shared_id 2025.06.18 08:40:15.620270 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Got candidate ID 959bd902-bb2e-422b-83b3-85dced7f8d15, will try to create it in ZooKeeper on path /clickhouse/tables/959bd902-bb2e-422b-83b3-85dced7f8d15/s1/table_shared_id 2025.06.18 08:40:15.620715 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 173 2025.06.18 08:40:15.621294 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.622099 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Initializing table shared ID with 959bd902-bb2e-422b-83b3-85dced7f8d15 2025.06.18 08:40:15.622528 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 3, bytes: 411 2025.06.18 08:40:15.623150 [ 66585 ] {} KeeperLogStore: Flushing 3 logs 2025.06.18 08:40:15.623314 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 6, bytes: 855 2025.06.18 08:40:15.624565 [ 66585 ] {} KeeperLogStore: Flushing 6 logs 2025.06.18 08:40:15.625721 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 150 2025.06.18 08:40:15.626020 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.626077 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 149 2025.06.18 08:40:15.626397 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.627472 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Creating shared ID for table test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15) 2025.06.18 08:40:15.627585 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Shared ID already set to 959bd902-bb2e-422b-83b3-85dced7f8d15 2025.06.18 08:40:15.628330 [ 66750 ] {} DatabaseReplicated (test_1_db): There are 0 detached tables. Start searching non used tables. 2025.06.18 08:40:15.628385 [ 66750 ] {} DatabaseReplicated (test_1_db): Found 0 non used tables in detached tables. 2025.06.18 08:40:15.628481 [ 66750 ] {} DatabaseReplicated (test_1_db): Counting attached table .inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085 to database test_1_db 2025.06.18 08:40:15.628683 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Starting up table 2025.06.18 08:40:15.629645 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 404 2025.06.18 08:40:15.630353 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.631372 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Became leader 2025.06.18 08:40:15.631470 [ 66750 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeRestartingThread): Starting restating thread, schedule: true 2025.06.18 08:40:15.631707 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeRestartingThread): Activating replica. 2025.06.18 08:40:15.631888 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeRestartingThread): Trying to start replica up 2025.06.18 08:40:15.633127 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 406 2025.06.18 08:40:15.633716 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.634971 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeQueue): Initializing parts in queue 2025.06.18 08:40:15.635417 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeQueue): Queue initialized 2025.06.18 08:40:15.635476 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/tables/959bd902-bb2e-422b-83b3-85dced7f8d15/s1/replicas/r1/queue 2025.06.18 08:40:15.636123 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeQueue): Having 0 queue entries to load, 0 entries already loaded. 2025.06.18 08:40:15.636617 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Updating strategy picker state 2025.06.18 08:40:15.637777 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeQueue): Loaded queue 2025.06.18 08:40:15.640279 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 91 2025.06.18 08:40:15.640555 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.643582 [ 66399 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeRestartingThread): Table started successfully 2025.06.18 08:40:15.644105 [ 66750 ] {} DatabaseReplicated (test_1_db): All tables are created successfully 2025.06.18 08:40:15.644367 [ 66404 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Scheduling next merge selecting task after 6464ms, current attempt status: CannotSelect 2025.06.18 08:40:15.644523 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 189 2025.06.18 08:40:15.644930 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.645578 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 138 2025.06.18 08:40:15.646038 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.646973 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 120 2025.06.18 08:40:15.647412 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.647943 [ 66750 ] {} DatabaseReplicated (test_1_db): Current in-memory metadata digest: 15600503427515196043 2025.06.18 08:40:15.648198 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 209 2025.06.18 08:40:15.648507 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.648966 [ 66750 ] {} DDLWorker(test_1_db): Initialized DDLWorker thread 2025.06.18 08:40:15.649024 [ 66750 ] {} DDLWorker(test_1_db): Scheduling tasks 2025.06.18 08:40:15.649085 [ 66750 ] {} DDLWorker(test_1_db): Don't have unfinished tasks after restarting 2025.06.18 08:40:15.649087 [ 66780 ] {} DDLWorker(test_1_db): Cleaning queue 2025.06.18 08:40:15.649710 [ 66750 ] {} DDLWorker(test_1_db): scheduleTasks: initialized=true, size_before_filtering=5, queue_size=5, entries=query-0000000001..query-0000000005, first_failed_task_name=none, current_tasks_size=0, last_current_task=none, last_skipped_entry_name=none 2025.06.18 08:40:15.649773 [ 66750 ] {} DDLWorker(test_1_db): Will schedule 5 tasks starting from query-0000000001 2025.06.18 08:40:15.649851 [ 66750 ] {} DDLWorker(test_1_db): Checking task query-0000000001 2025.06.18 08:40:15.649903 [ 66750 ] {} DDLWorker(test_1_db): Will not execute task query-0000000001: Task query-0000000001 already executed according to log pointer 5 2025.06.18 08:40:15.649939 [ 66750 ] {} DDLWorker(test_1_db): Checking task query-0000000002 2025.06.18 08:40:15.649997 [ 66750 ] {} DDLWorker(test_1_db): Will not execute task query-0000000002: Task query-0000000002 already executed according to log pointer 5 2025.06.18 08:40:15.650026 [ 66750 ] {} DDLWorker(test_1_db): Checking task query-0000000003 2025.06.18 08:40:15.650057 [ 66750 ] {} DDLWorker(test_1_db): Will not execute task query-0000000003: Task query-0000000003 already executed according to log pointer 5 2025.06.18 08:40:15.650083 [ 66750 ] {} DDLWorker(test_1_db): Checking task query-0000000004 2025.06.18 08:40:15.650111 [ 66750 ] {} DDLWorker(test_1_db): Will not execute task query-0000000004: Task query-0000000004 already executed according to log pointer 5 2025.06.18 08:40:15.650152 [ 66750 ] {} DDLWorker(test_1_db): Checking task query-0000000005 2025.06.18 08:40:15.650183 [ 66750 ] {} DDLWorker(test_1_db): Will not execute task query-0000000005: Task query-0000000005 already executed according to log pointer 5 2025.06.18 08:40:15.650228 [ 66750 ] {} DDLWorker(test_1_db): Waiting for queue updates 2025.06.18 08:40:15.661186 [ 66777 ] {} void DB::AsyncLoader::worker(Pool &): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=742, jobs=703). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. ./contrib/llvm-project/libcxx/include/vector:438: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x000000000fb1e06c 4. ./build_docker/./src/Common/ThreadPool.cpp:259: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x000000000fb1df58 5. ./build_docker/./src/Common/ThreadPool.cpp:0: void ThreadPoolImpl::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x000000000fb1646e 6. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000000fb17057 7. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000017686a82 8. ./build_docker/./src/Interpreters/DDLWorker.cpp:131: DB::DDLWorker::startup() @ 0x000000001766821a 9. ./src/Common/SharedMutexHelper.h:91: void std::__function::__policy_invoker const&)>::__call_impl>, std::vector, std::allocator>> const&)::$_0, void (DB::AsyncLoader&, std::shared_ptr const&)>>(std::__function::__policy_storage const*, DB::AsyncLoader&, std::shared_ptr const&) @ 0x00000000175d5618 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fcc51c7 11. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fcc5f73 12. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 13. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 15. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 16. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 17. __tsan_thread_start_func @ 0x000000000758af2f 18. ? @ 0x00007fac84fa8ac3 19. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:15.661610 [ 66777 ] {} AsyncLoader: Finish load job 'startup ddl worker' with status FAILED 2025.06.18 08:40:15.661721 [ 66777 ] {} AsyncLoader: Stop worker in BackgrndStartup 2025.06.18 08:40:15.661752 [ 66777 ] {} AsyncLoader: Change current priority: 2 -> none 2025.06.18 08:40:15.698173 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:15.698412 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:15.698652 [ 66619 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:15.699086 [ 66417 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:15.699211 [ 66618 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:15.699717 [ 66418 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:15.699877 [ 66418 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:15.701936 [ 66808 ] {} Poco: Queue size: 0, current threads: 1, threads in pool: 4, current connections: 0 2025.06.18 08:40:15.702111 [ 66000 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:40720 2025.06.18 08:40:15.702359 [ 66000 ] {} TCPHandler: Connected ClickHouse client version 24.8.0, revision: 54472, user: default. 2025.06.18 08:40:15.702477 [ 66000 ] {} TCP-Session-0f27fcf7-37ca-4dc6-aa22-aaebe551b142: Authenticating user 'default' from [::1]:40720 2025.06.18 08:40:15.702673 [ 66000 ] {} TCP-Session-0f27fcf7-37ca-4dc6-aa22-aaebe551b142: 0f27fcf7-37ca-4dc6-aa22-aaebe551b142 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:15.702742 [ 66000 ] {} TCP-Session-0f27fcf7-37ca-4dc6-aa22-aaebe551b142: Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:15.730103 [ 66000 ] {} TCP-Session-0f27fcf7-37ca-4dc6-aa22-aaebe551b142: 0f27fcf7-37ca-4dc6-aa22-aaebe551b142 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2025.06.18 08:40:15.731749 [ 66000 ] {fc99b19c-aa63-49ed-bd5d-f2dcd7e217df} executeQuery: (from [::1]:40720) SELECT count() FROM system.build_options WHERE name = 'CXX_FLAGS' AND position('sanitize=address' IN value) (stage: Complete) 2025.06.18 08:40:15.734335 [ 66000 ] {fc99b19c-aa63-49ed-bd5d-f2dcd7e217df} Planner: Query to stage Complete 2025.06.18 08:40:15.734896 [ 66000 ] {fc99b19c-aa63-49ed-bd5d-f2dcd7e217df} Planner: Query from stage FetchColumns to stage Complete 2025.06.18 08:40:15.781448 [ 66000 ] {fc99b19c-aa63-49ed-bd5d-f2dcd7e217df} executeQuery: Code: 439. DB::Exception: Cannot schedule a task: failed to start the thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.8.14.10063.altinitytest (altinity build)) (from [::1]:40720) (in query: SELECT count() FROM system.build_options WHERE name = 'CXX_FLAGS' AND position('sanitize=address' IN value)), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. ./contrib/llvm-project/libcxx/include/vector:438: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x000000000fb1e06c 4. ./build_docker/./src/Common/ThreadPool.cpp:259: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x000000000fb206f8 5. ./contrib/llvm-project/libcxx/include/string:1499: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x000000000fb1a6cb 6. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000000fb19a0b 7. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000001a2e30f2 8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:405: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001a2e18fb 9. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001a2e165f 10. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:94: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001a2f5a3b 11. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 12. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 13. __tsan_thread_start_func @ 0x000000000758af2f 14. ? @ 0x00007fac84fa8ac3 15. ? @ 0x00007fac8503a850 2025.06.18 08:40:15.782263 [ 66000 ] {fc99b19c-aa63-49ed-bd5d-f2dcd7e217df} TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: failed to start the thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. ./contrib/llvm-project/libcxx/include/vector:438: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x000000000fb1e06c 4. ./build_docker/./src/Common/ThreadPool.cpp:259: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x000000000fb206f8 5. ./contrib/llvm-project/libcxx/include/string:1499: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x000000000fb1a6cb 6. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000000fb19a0b 7. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000001a2e30f2 8. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:405: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001a2e18fb 9. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:274: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001a2e165f 10. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:94: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001a2f5a3b 11. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 12. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 13. __tsan_thread_start_func @ 0x000000000758af2f 14. ? @ 0x00007fac84fa8ac3 15. ? @ 0x00007fac8503a850 2025.06.18 08:40:15.791477 [ 66000 ] {} TCPHandler: Closing connection (open: true, cancelled: false, eof: true) 2025.06.18 08:40:15.791518 [ 66000 ] {} TCPHandler: Done processing connection. 2025.06.18 08:40:15.792008 [ 66000 ] {} TCP-Session-0f27fcf7-37ca-4dc6-aa22-aaebe551b142: 0f27fcf7-37ca-4dc6-aa22-aaebe551b142 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:15.965277 [ 66447 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.965594 [ 66447 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.965723 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:15.966106 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.966064 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.966509 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.968004 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.968059 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.969245 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.969297 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.969594 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:15.969755 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:15.969843 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:15.969899 [ 66452 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.970302 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:15.970451 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:15.970471 [ 66454 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.970528 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:15.970647 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:15.970812 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.970894 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.971124 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:15.971202 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.972018 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.972095 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:15.972400 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.972518 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:15.972667 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:15.972893 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:15.973142 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.973715 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.974008 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:15.974112 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.974148 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:15.974159 [ 66456 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.974217 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:15.974562 [ 66456 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.974695 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:15.974903 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.975030 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.975176 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.976422 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.976479 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.976854 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.976922 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:15.977054 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:15.977776 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:15.977850 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.978390 [ 66459 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.978594 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:15.978736 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:15.978833 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:15.978867 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.979124 [ 66451 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 423ms, ratio: 0.025641028, points per minute: 36.37025) 2025.06.18 08:40:15.979172 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.979366 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:15.979486 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:15.979532 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:15.979768 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:15.979879 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:15.980261 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:15.980433 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:15.980587 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:15.980833 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.981589 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:15.982311 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:15.982353 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:15.982391 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.982406 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:15.982516 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:15.982589 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:15.982951 [ 66462 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.983162 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:15.983498 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.983873 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.983912 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:15.984052 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:15.984328 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:15.984587 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.985733 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:15.985779 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.985788 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:15.985924 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:15.986015 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:15.986126 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:15.986328 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:15.986587 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:15.987111 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:15.987336 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:15.987736 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:15.988383 [ 66465 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:15.989092 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:15.989684 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:15.991576 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:15.991987 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:15.992048 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:15.992099 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:15.992132 [ 66451 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:15.992361 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:15.992455 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:15.992633 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.992769 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.992836 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:15.992873 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:15.992945 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:15.993389 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:15.993428 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:15.993567 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:15.993643 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:15.993777 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.993890 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.993963 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:15.993999 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:15.994073 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:15.994352 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:15.994460 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:15.994498 [ 66451 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 15ms, ratio: 0.025641028, points per minute: 1025.6411) 2025.06.18 08:40:15.994535 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:15.994602 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:15.994709 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:15.994789 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.994924 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.995013 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.995073 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.995232 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.995305 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.995451 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:15.995803 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:15.995881 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:15.995843 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:15.995953 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:15.996039 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:15.996082 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.996178 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.996239 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:15.996276 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:15.996344 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:15.996869 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:15.996939 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:15.996971 [ 66451 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 3ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:15.997006 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:15.997133 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.997231 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.997311 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:15.997359 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:15.997487 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:15.998312 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:15.998404 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:15.998487 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:15.998690 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.998889 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:15.998988 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:15.999035 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:15.999125 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:15.999603 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:15.999692 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:15.999777 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:15.999947 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.000068 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.000044 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.000106 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.000168 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.000210 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.000233 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.000316 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.000315 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.53 GiB, peak 1.54 GiB, free memory in arenas 0.00 B, will set to 1.64 GiB (RSS), difference: 104.75 MiB 2025.06.18 08:40:16.000332 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.000436 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.000762 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:16.001581 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.001939 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.002008 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:16.005439 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:16.005469 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:16.005706 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:16.006314 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.006799 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.007163 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.007531 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:16.007954 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.007925 [ 66629 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.008717 [ 66473 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.012723 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:16.013007 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:16.013170 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.013442 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.013703 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.013848 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.013919 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.014102 [ 66621 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.014961 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:16.015085 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:16.015219 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.015449 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.015628 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.015737 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.015811 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.015924 [ 66621 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.016751 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:16.016867 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:16.016969 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.017166 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.017316 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.017415 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.017473 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.017605 [ 66621 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.018300 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:16.018421 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:16.018530 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.018862 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.019028 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.019143 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.019202 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.019320 [ 66621 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.020180 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:16.020317 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:16.020437 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.020668 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.020822 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.020925 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.020993 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.021104 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.021949 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:16.022066 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:16.022166 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.022390 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.022573 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.022676 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.022733 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.022844 [ 66621 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.023407 [ 66621 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.023516 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:16.023628 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.023794 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.023917 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66621, kind: Regular, unbound: 0 2025.06.18 08:40:16.023999 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.024046 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.024133 [ 66621 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.024400 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:16.024986 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.025308 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.025385 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:16.028713 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:16.029999 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.030664 [ 66621 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.031134 [ 66479 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.031408 [ 66479 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.031438 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.031680 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.033571 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.035285 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.035707 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:16.035845 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:16.035916 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:16.036134 [ 66484 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.036614 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:16.036626 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.036705 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:16.036743 [ 66484 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.036794 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:16.037062 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.037264 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:16.037279 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.037647 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.038646 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:16.039010 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.039284 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:16.039468 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:16.039566 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.039818 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:16.040106 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.041260 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:16.041362 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:16.041424 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:16.041420 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.042132 [ 66487 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.042358 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.042835 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.043176 [ 66489 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.044083 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.044125 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.044594 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.045078 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:16.045136 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:16.045215 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:16.046500 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.046564 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.047431 [ 66483 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 50ms, ratio: 0.025641028, points per minute: 307.69232) 2025.06.18 08:40:16.047609 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:16.047720 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:16.048428 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:16.048479 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:16.048523 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:16.048707 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.048739 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:16.048808 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:16.049371 [ 66494 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.049651 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.049804 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.049850 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:16.049928 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:16.049998 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:16.050702 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:16.050724 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:16.051073 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:16.051203 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:16.051534 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:16.051743 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:16.051973 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.052114 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:16.052502 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.054008 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:16.054164 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:16.054264 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:16.054738 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.055176 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.055156 [ 66496 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.055305 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.055361 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.055423 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.055514 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.055593 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.055978 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.058158 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.059197 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:16.059276 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:16.059356 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:16.059379 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:16.059491 [ 66483 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:16.059856 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.060313 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.061187 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:16.061322 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:16.061487 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.062139 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:16.062218 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:16.062277 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:16.062650 [ 66483 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 16ms, ratio: 0.025641028, points per minute: 961.5385) 2025.06.18 08:40:16.063048 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:16.063411 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:16.063569 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:16.064902 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:16.065053 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:16.065178 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.065375 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.065532 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.065643 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.065713 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.065751 [ 66483 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 3ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:16.065847 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.066525 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:16.066667 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:16.066789 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.067010 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.067142 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.067228 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.067276 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.067365 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.068026 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:16.068096 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.068132 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:16.068136 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.068215 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.068231 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.068286 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.068356 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.068398 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.068560 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.068665 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.068715 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.068803 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.069436 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:16.069526 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:16.069647 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.069806 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.069970 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.070065 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.070110 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.070200 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.070832 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:16.070920 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:16.070988 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.071109 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.071199 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.071257 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.071291 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.071358 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.071991 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:16.072089 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:16.072170 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.072318 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:16.072328 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.072490 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:16.072525 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.072637 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.072685 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.072774 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.072906 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.073229 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.073319 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.073327 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:16.073446 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.073665 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.073798 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.073919 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.073965 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.074050 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.074128 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:16.074301 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:16.074480 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.074882 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.075175 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.075248 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:16.077847 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:16.077980 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:16.078096 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.078335 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.078490 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.078591 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:16.078608 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.078671 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.078765 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.079371 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:16.079357 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.079480 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:16.079602 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.079776 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.079906 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.079881 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.080024 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.080091 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.080214 [ 66618 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.080393 [ 66502 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.081079 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:16.081243 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:16.081355 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.081571 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.081720 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.081861 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.081930 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.082038 [ 66618 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.082637 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:16.082737 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:16.082830 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.082997 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.083134 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.083219 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.083268 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.083360 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.084074 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:16.084173 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:16.084262 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.084465 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.084690 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.084815 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.084886 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.085001 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.085662 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:16.085754 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:16.085840 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.085963 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.086038 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.086087 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.086115 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.086170 [ 66618 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.086473 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.086592 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:16.086684 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.086873 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.086997 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:16.087089 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.087137 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.087224 [ 66618 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.087526 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:16.088230 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.088623 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.088745 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:16.091811 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:16.092911 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.093302 [ 66618 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.093783 [ 66508 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.094103 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.094172 [ 66508 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.094385 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.096016 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.097601 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.098129 [ 66511 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.098131 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:16.098382 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:16.098496 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:16.098505 [ 66511 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.098790 [ 66511 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.098809 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.098982 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.099304 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:16.099373 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:16.099438 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:16.099801 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:16.100518 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.101008 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:16.101773 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:16.101986 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:16.102090 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.102358 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:16.102622 [ 66514 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.102742 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.102961 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.103009 [ 66514 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.103278 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.103278 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.103568 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.103890 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:16.103963 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:16.104046 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:16.104779 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.104853 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.106137 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.106261 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.106813 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:16.106810 [ 66517 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.106877 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:16.107078 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:16.107236 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.107388 [ 66517 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.107631 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.107764 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.107931 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.109025 [ 66510 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 43ms, ratio: 0.025641028, points per minute: 357.78177) 2025.06.18 08:40:16.109144 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.109168 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:16.109144 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.109228 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:16.109926 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:16.110029 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:16.110109 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:16.110504 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:16.110644 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.110682 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:16.111210 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:16.111170 [ 66521 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.111288 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:16.111361 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:16.111626 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.111874 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.111919 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:16.112084 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:16.112192 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:16.112285 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:16.112828 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:16.113048 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:16.113308 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:16.113507 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.113606 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.114641 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:16.114772 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:16.114792 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.114829 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.114910 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.114880 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:16.114974 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.115081 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.115356 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.115854 [ 66524 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.116164 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.116385 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.117945 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.118271 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:16.118410 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:16.118792 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.119104 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.119441 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:16.119575 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:16.119706 [ 66510 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:16.119735 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:16.119966 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.120527 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:16.120814 [ 66526 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 585ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:16.121283 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:16.121418 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:16.121498 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:16.122064 [ 66510 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 13ms, ratio: 0.025641028, points per minute: 1183.432) 2025.06.18 08:40:16.122084 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:16.122389 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:16.122468 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:16.122713 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:16.122826 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:16.122910 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.123045 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.123155 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.123228 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.123270 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.123339 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.123780 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:16.123850 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:16.123919 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.124084 [ 66510 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:16.124133 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.124240 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.124313 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.124350 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.124421 [ 66633 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.124607 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.124705 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.124778 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.124909 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.125014 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:16.125035 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.125094 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:16.125179 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.125287 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.125364 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.125415 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.125444 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.125498 [ 66633 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.125893 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:16.125956 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:16.126015 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.126119 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.126219 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.126286 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.126324 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.126397 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.126958 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:16.127036 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:16.127109 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.127244 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.127342 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.127407 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.127445 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.127518 [ 66633 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.128100 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:16.128178 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:16.128252 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.128383 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.128481 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.128561 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.128604 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.128636 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:16.128679 [ 66633 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.128795 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:16.129077 [ 66633 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.129175 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:16.129172 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.129238 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.129345 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.129428 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66633, kind: Regular, unbound: 0 2025.06.18 08:40:16.129471 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.129479 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.129535 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.129604 [ 66633 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.129766 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:16.130226 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.130221 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:16.130441 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.130492 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:16.130618 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.132938 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:16.133684 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.134147 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:16.134171 [ 66633 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.134266 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:16.134386 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.134671 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.134733 [ 66531 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.134858 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.134972 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.135034 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.135152 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.135841 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:16.135945 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:16.136037 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.136215 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.136339 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.136423 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.136471 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.136579 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.137242 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:16.137364 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:16.137454 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.137640 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.137763 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.137900 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.137953 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.138041 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.138687 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:16.138796 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:16.138901 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.139099 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.139244 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.139344 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.139398 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.139490 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.140154 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:16.140247 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:16.140334 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.140496 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.140660 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.140748 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.140795 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.140883 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.141513 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:16.141627 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:16.141716 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.141915 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.142042 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.142122 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.142168 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.142253 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.142777 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.142880 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:16.142977 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.143152 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.143272 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:16.143352 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.143398 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.143483 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.143752 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:16.144307 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.144636 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.144709 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:16.147370 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:16.148518 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.149167 [ 66629 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.149748 [ 66535 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.150032 [ 66535 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.543659 [ 66101 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.544091 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.544105 [ 66101 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.544438 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.544613 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.544881 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.547055 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.547101 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.548915 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.548980 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.549453 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:16.549662 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:16.549793 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:16.549999 [ 66104 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.550650 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.550799 [ 66104 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.550835 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:16.551000 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:16.551151 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:16.551201 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.551214 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.551508 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.551860 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:16.553221 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.553411 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.553414 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:16.554345 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:16.554593 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:16.554918 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:16.555214 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.555217 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.555309 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.556021 [ 66114 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.556751 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.556847 [ 66114 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.557129 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.557302 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.557298 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:16.557567 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:16.557619 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.557682 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:16.558918 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.559572 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.560736 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.561308 [ 66116 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.561597 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.561680 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:16.561849 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.562244 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.562733 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.562825 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:16.562940 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:16.563059 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:16.563082 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.563363 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.564904 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.564941 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:16.565678 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:16.565756 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:16.565773 [ 66102 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 442ms, ratio: 0.025641028, points per minute: 34.806824) 2025.06.18 08:40:16.565799 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:16.566092 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:16.566189 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:16.566370 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:16.566624 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:16.566700 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:16.566836 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.566974 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:16.567163 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:16.567284 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:16.567465 [ 66120 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.567878 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.568070 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.568384 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:16.569004 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.569047 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.569099 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.569154 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.569204 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.569958 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:16.569980 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.570721 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:16.570927 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:16.571237 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:16.571617 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.572178 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:16.572307 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:16.572426 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.572579 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.572750 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:16.572916 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:16.572970 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.573062 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:16.573090 [ 66122 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.573513 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.573776 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.573783 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:16.574161 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.575423 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.577196 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:16.577854 [ 66125 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:16.578554 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:16.578895 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:16.578954 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:16.579055 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:16.579087 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:16.579277 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.579327 [ 66102 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:16.579146 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:16.579461 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.579636 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.579721 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.579761 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.579882 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.580335 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:16.580409 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:16.580485 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.580643 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.580736 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.580799 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.580845 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.580920 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.581216 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:16.581387 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:16.581464 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:16.581553 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.581677 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.581781 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.581863 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.581903 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.581970 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.581981 [ 66102 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 16ms, ratio: 0.025641028, points per minute: 961.5385) 2025.06.18 08:40:16.582375 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:16.582449 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:16.582514 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.582652 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.582750 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.582811 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.582844 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.582912 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.582957 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:16.583417 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:16.583490 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:16.583571 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.583708 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.583800 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.583853 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.583865 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:16.583892 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.584020 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.584012 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:16.584254 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:16.584372 [ 66102 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:16.584742 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:16.584820 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:16.584890 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.585041 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.585137 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.585199 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.585236 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.585240 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:16.585306 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.585644 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:16.585768 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.585878 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:16.585867 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:16.585951 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.586085 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.586174 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:16.586237 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.586273 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.586339 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.586550 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:16.586955 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.587942 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.587992 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:16.590748 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:16.590796 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:16.590909 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:16.590939 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:16.591037 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:16.591160 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:16.591910 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.592336 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.592876 [ 66131 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.596302 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:16.596516 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:16.596915 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:16.597266 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:16.598062 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:16.598409 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:16.602383 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:16.602574 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:16.602710 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:16.602946 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.603115 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.603239 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:16.603305 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:16.603427 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:16.604155 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:16.604273 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:16.604386 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:16.604604 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.604764 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.604880 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:16.604943 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:16.605056 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:16.605943 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:16.606070 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:16.606178 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.606390 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.606571 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.606700 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.606758 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.606854 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.607436 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:16.607556 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:16.607654 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:16.607823 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.607951 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.608037 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:16.608085 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:16.608208 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:16.609021 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:16.609134 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:16.609256 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:16.609449 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.609596 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.609701 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:16.609762 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:16.609952 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:16.610818 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:16.610934 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:16.611060 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:16.611246 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.611395 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.611496 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:16.611573 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:16.611690 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:16.612338 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:16.612473 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:16.612609 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:16.612832 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.612985 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:16.613088 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:16.613147 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:16.613284 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:16.613610 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:16.614265 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:16.614620 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:16.614707 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:16.618457 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:16.619945 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.620759 [ 66626 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:16.621206 [ 66134 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:16.621405 [ 66134 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.000302 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.64 GiB, peak 1.64 GiB, free memory in arenas 0.00 B, will set to 1.70 GiB (RSS), difference: 69.95 MiB 2025.06.18 08:40:17.184867 [ 66244 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.185181 [ 66244 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.185224 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:17.185428 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.185479 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.185679 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.187768 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.187846 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.189705 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.189718 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.190013 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:17.190174 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:17.190245 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:17.190354 [ 66255 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.190676 [ 66255 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.190716 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:17.190899 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.190920 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.191060 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:17.191069 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.191131 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:17.191210 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:17.191621 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:17.192817 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.192947 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.193023 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:17.193716 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:17.193863 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:17.194207 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:17.194593 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.195574 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.195618 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.195986 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:17.196075 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:17.196058 [ 66251 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.196153 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:17.196458 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:17.196517 [ 66251 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.196774 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.196776 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.196920 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.198780 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.198806 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:17.198866 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:17.198917 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.198956 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:17.200833 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:17.200862 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.201352 [ 66259 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.201632 [ 66248 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 618ms, ratio: 0.025641028, points per minute: 24.894201) 2025.06.18 08:40:17.201733 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.201763 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:17.201890 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:17.201931 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:17.202028 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:17.202090 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:17.202123 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.202701 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:17.202786 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:17.202836 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:17.202877 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:17.203121 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:17.203255 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:17.203444 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:17.204030 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.204358 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:17.204904 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:17.205019 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:17.205310 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:17.205583 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.206725 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.206883 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:17.206963 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:17.207020 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:17.207298 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:17.207372 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:17.207448 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:17.207559 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:17.207650 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:17.209631 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:17.209691 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:17.209777 [ 66248 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:17.211517 [ 66248 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 10ms, ratio: 0.025641028, points per minute: 1538.4617) 2025.06.18 08:40:17.211841 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:17.212023 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:17.212374 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:17.212695 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.213442 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:17.213887 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:17.213933 [ 66248 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:17.217796 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:17.217978 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:17.218104 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:17.218324 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.218490 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.218617 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:17.218681 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:17.218806 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:17.219502 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:17.219646 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:17.219763 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:17.219963 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.220111 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.220236 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:17.220296 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:17.220390 [ 66618 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:17.221202 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:17.221321 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:17.221443 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.221674 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.221802 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.221959 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.222019 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.222129 [ 66618 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.222803 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:17.222914 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:17.223015 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:17.223203 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.223369 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.223470 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:17.223527 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:17.223662 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:17.224415 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:17.224528 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:17.224654 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:17.224857 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.225085 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.225263 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:17.225329 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:17.225450 [ 66618 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:17.226290 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:17.226407 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:17.226517 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.226750 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.226904 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.227004 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.227063 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.227173 [ 66618 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.227765 [ 66618 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:17.227872 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:17.227984 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:17.228174 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.228317 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66618, kind: Regular, unbound: 0 2025.06.18 08:40:17.228417 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:17.228474 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:17.228603 [ 66618 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:17.228880 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:17.229474 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:17.229898 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:17.229988 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:17.232935 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:17.234389 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.235119 [ 66618 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.235528 [ 66269 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.235725 [ 66269 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.235885 [ 66269 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.235980 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.236147 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.237503 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.238870 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:17.239444 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:17.239521 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:17.239581 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:17.240039 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:17.240245 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:17.240335 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:17.242479 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:17.242519 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:17.242575 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:17.242630 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:17.242679 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:17.245315 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:17.245436 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:17.245734 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:17.246071 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.246625 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:17.246833 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:17.248862 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:17.248934 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:17.249003 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:17.249137 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.249221 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.249275 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:17.249306 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:17.249360 [ 66626 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:17.249724 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:17.249784 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:17.249860 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:17.249965 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.250040 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.250097 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:17.250127 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:17.250181 [ 66626 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:17.250604 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:17.250662 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:17.250715 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.250813 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.250886 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.250935 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.250962 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.251016 [ 66626 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.251386 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:17.251443 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:17.251497 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:17.251612 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.251693 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.251743 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:17.251771 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:17.251825 [ 66626 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:17.252220 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:17.252278 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:17.252330 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:17.252428 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.252503 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.252564 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:17.252594 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:17.252647 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:17.253040 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:17.253097 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:17.253156 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.253254 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.253329 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.253378 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.253406 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.253458 [ 66626 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.253759 [ 66626 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:17.253855 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:17.253914 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:17.254014 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.254086 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66626, kind: Regular, unbound: 0 2025.06.18 08:40:17.254139 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:17.254171 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:17.254222 [ 66626 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:17.254385 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:17.254809 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:17.254993 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:17.255055 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:17.257291 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:17.258010 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.258388 [ 66626 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.258706 [ 66272 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.258832 [ 66272 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.703000 [ 66342 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 1582ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:17.791457 [ 66367 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.791911 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:17.791934 [ 66367 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.792215 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.792344 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.792660 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.793859 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.794149 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.795099 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.795442 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:17.795568 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:17.795559 [ 66325 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.795632 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:17.795701 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.796076 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:17.796188 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:17.796269 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:17.796327 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.796343 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:17.796797 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:17.797752 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.797776 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:17.798368 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:17.798509 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:17.798773 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:17.799068 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.799783 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.799939 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:17.800026 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:17.800084 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:17.800166 [ 66364 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.800524 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.800532 [ 66364 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.800756 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.800816 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:17.800983 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.802053 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.802281 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.802626 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:17.802673 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:17.802737 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:17.803339 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.803559 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:17.803630 [ 66339 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.803852 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.804002 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.804211 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:17.804275 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:17.804321 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:17.804474 [ 66349 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 590ms, ratio: 0.025641028, points per minute: 26.07562) 2025.06.18 08:40:17.804615 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:17.804703 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:17.804855 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:17.805043 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:17.805140 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:17.805187 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:17.805250 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.805246 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:17.805360 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:17.805662 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:17.806696 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.806776 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:17.806931 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:17.806973 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:17.807015 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:17.807075 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:17.807158 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:17.807176 [ 66378 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.807469 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:17.807599 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.807645 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:17.807764 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.807888 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:17.808258 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.809388 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:17.809485 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:17.809586 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:17.809928 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.810305 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:17.810416 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:17.810723 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:17.811062 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.811733 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:17.812287 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:17.812698 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:17.812815 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:17.812884 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:17.812893 [ 66380 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:17.812960 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:17.813242 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:17.813441 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:17.814911 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:17.814967 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:17.814972 [ 66349 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 11ms, ratio: 0.025641028, points per minute: 1398.6014) 2025.06.18 08:40:17.815069 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:17.815154 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:17.815313 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.815411 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.815479 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:17.815522 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:17.815601 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:17.816019 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:17.816085 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:17.816148 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:17.816205 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:17.816277 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.816365 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.816437 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:17.816492 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:17.816571 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:17.816643 [ 66349 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:17.816791 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:17.816857 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:17.816906 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:17.817070 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:17.817146 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:17.817205 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.817314 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.817377 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:17.817393 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.817497 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.817528 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.817605 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.817606 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:17.817706 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:17.818016 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:17.818083 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:17.818139 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:17.818247 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.818333 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.818388 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:17.818419 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:17.818475 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:17.818943 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:17.819004 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:17.819062 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:17.819175 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.819253 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.819305 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:17.819334 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:17.819390 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:17.819551 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:17.819574 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:17.819612 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:17.819666 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:17.819711 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:17.819948 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:17.820017 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:17.820083 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.820217 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.820295 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.820346 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.820376 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.820431 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.820765 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:17.820824 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:17.820879 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:17.820979 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.821055 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:17.821106 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:17.821142 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:17.821196 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:17.821402 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:17.821810 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:17.822046 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:17.822098 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:17.822441 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:17.822592 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:17.822949 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:17.823235 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:17.823950 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:17.824159 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:17.825377 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:17.826131 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.826508 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:17.826613 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:17.826590 [ 66629 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.826688 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:17.826850 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.826969 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.827035 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:17.827070 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:17.827042 [ 66371 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.827134 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:17.827562 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:17.827624 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:17.827679 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:17.827787 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.827864 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.827916 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:17.827946 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:17.828000 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:17.828404 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:17.828462 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:17.828515 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.828630 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.828705 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.828762 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.828791 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.828845 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.829182 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:17.829240 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:17.829293 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:17.829392 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.829467 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.829517 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:17.829562 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:17.829620 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:17.830045 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:17.830104 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:17.830158 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:17.830258 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.830338 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.830388 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:17.830416 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:17.830469 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:17.830907 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:17.830966 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:17.831018 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:17.831115 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.831188 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.831236 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:17.831264 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:17.831318 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:17.831615 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:17.831672 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:17.831722 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:17.831824 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.831897 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:17.831944 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:17.831972 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:17.832024 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:17.832183 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:17.832610 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:17.832805 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:17.832853 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:17.835750 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:17.836493 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.836913 [ 66625 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:17.837192 [ 66345 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:17.837343 [ 66345 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:18.000267 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.70 GiB, peak 1.70 GiB, free memory in arenas 0.00 B, will set to 1.74 GiB (RSS), difference: 34.76 MiB 2025.06.18 08:40:18.152870 [ 66435 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.153221 [ 66435 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.153272 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:18.153479 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:18.153528 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.153729 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.155907 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.155989 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.157516 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.157585 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.157929 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:18.158140 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:18.158271 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:18.158422 [ 66442 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.158774 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:18.158867 [ 66442 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.159094 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.159164 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:18.159280 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:18.159435 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:18.159436 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.159582 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:18.160159 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:18.160941 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.161405 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.161885 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:18.162924 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:18.162998 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.163158 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:18.163522 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.163556 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:18.163927 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:18.164080 [ 66448 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.164523 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:18.164576 [ 66448 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.164801 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.164877 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:18.165175 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.165482 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:18.165634 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:18.165772 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:18.166945 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.167160 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.169129 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.169228 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.169760 [ 66450 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.170273 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:18.170344 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:18.170438 [ 66450 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.170467 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:18.170649 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:18.170706 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.170763 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:18.170924 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.172845 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.172883 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.173469 [ 66441 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 356ms, ratio: 0.025641028, points per minute: 43.215214) 2025.06.18 08:40:18.173685 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:18.173768 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:18.174656 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:18.174761 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:18.174848 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:18.174900 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:18.174853 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:18.175402 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:18.175681 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:18.175765 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:18.175820 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:18.176483 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:18.176874 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:18.176987 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:18.176984 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:18.177770 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:18.177967 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:18.178374 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:18.178793 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:18.180267 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:18.180306 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:18.180340 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:18.180416 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:18.180434 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:18.180500 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:18.180527 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:18.180678 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:18.184690 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:18.184780 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:18.184862 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:18.184877 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:18.185066 [ 66441 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:18.185310 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:18.185849 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:18.186741 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:18.187104 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:18.187954 [ 66441 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 15ms, ratio: 0.025641028, points per minute: 1025.6411) 2025.06.18 08:40:18.190248 [ 66441 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:18.190687 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:18.190817 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:18.190929 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:18.191130 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.191293 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.191385 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:18.191436 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:18.191529 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:18.192162 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:18.192266 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:18.192358 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:18.192566 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.192716 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.192806 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:18.192856 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:18.192948 [ 66629 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:18.193665 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:18.193859 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:18.193992 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:18.194183 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.194318 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.194482 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:18.194563 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:18.194668 [ 66629 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:18.195297 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:18.195403 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:18.195498 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:18.195711 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.195841 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.195929 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:18.195977 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:18.196070 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:18.196873 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:18.196979 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:18.197073 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:18.197271 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.197400 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.197487 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:18.197562 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:18.197719 [ 66629 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:18.198491 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:18.198638 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:18.198735 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:18.198905 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.199032 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.199117 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:18.199164 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:18.199255 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:18.199836 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:18.199943 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:18.200033 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:18.200203 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.200326 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:18.200411 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:18.200460 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:18.200569 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:18.200869 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:18.201517 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:18.201906 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:18.201992 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:18.205170 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:18.206408 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:18.207154 [ 66629 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:18.207688 [ 66463 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:18.208001 [ 66463 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:18.208304 [ 66463 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:18.208369 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:18.208648 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:18.210339 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:18.211838 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:18.212572 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:18.212673 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:18.212766 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:18.213435 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:18.213654 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:18.213729 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:18.215407 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:18.215506 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:18.215602 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:18.215730 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:18.215853 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:18.219711 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:18.219899 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:18.220285 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:18.220717 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:18.221423 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:18.221756 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:18.225637 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:18.225798 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:18.225980 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:18.226188 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.226340 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.226436 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:18.226487 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:18.226605 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:18.227201 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:18.227303 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:18.227395 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:18.227589 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.227753 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.227842 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:18.227891 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:18.227984 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:18.228799 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:18.228905 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:18.228998 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:18.229170 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.229295 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.229378 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:18.229425 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:18.229516 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:18.230174 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:18.230333 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:18.230432 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:18.230621 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.230749 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.230834 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:18.230880 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:18.230970 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:18.231696 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:18.231794 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:18.231882 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:18.232045 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.232168 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.232250 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:18.232295 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:18.232383 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:18.233098 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:18.233194 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:18.233282 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:18.233446 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.233587 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.233671 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:18.233717 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:18.233803 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:18.234328 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:18.234419 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:18.234504 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:18.234685 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.234806 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:18.234887 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:18.234943 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:18.235032 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:18.235309 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:18.235981 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:18.236296 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:18.236372 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:18.238972 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:18.240209 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:18.241141 [ 66628 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:18.241481 [ 66467 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:18.699498 [ 66694 ] {} SystemLog (system.text_log): Flushing system log, 6479 entries to flush up to offset 6479 2025.06.18 08:40:18.703630 [ 66694 ] {} SystemLog (system.text_log): Will use existing table system.text_log for TextLog 2025.06.18 08:40:18.712000 [ 66661 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Found 1 old parts to remove. Parts: [202506_372_372_0] 2025.06.18 08:40:18.712214 [ 66661 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 1 parts from filesystem (serially): Parts: [202506_372_372_0] 2025.06.18 08:40:18.713163 [ 66661 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_372_372_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:18.713224 [ 66661 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 1 parts from memory: Parts: [202506_372_372_0] 2025.06.18 08:40:18.816965 [ 66663 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Found 1 old parts to remove. Parts: [20250618_6_6_0] 2025.06.18 08:40:18.817115 [ 66663 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Removing 1 parts from filesystem (serially): Parts: [20250618_6_6_0] 2025.06.18 08:40:18.818340 [ 66663 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): removePartsFinally: removing 20250618_6_6_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:18.818435 [ 66663 ] {} system.asynchronous_insert_log (aaa6ffb8-1fb0-4941-b703-9b1e92e5fb2b): Removing 1 parts from memory: Parts: [20250618_6_6_0] 2025.06.18 08:40:18.854462 [ 66694 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:18.857439 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Trying to reserve 1.62 MiB using storage policy from min volume index 0 2025.06.18 08:40:18.857596 [ 66694 ] {} DiskLocal: Reserved 1.62 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:18.897680 [ 66694 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:18.900282 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_488_488_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:18.900517 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): preparePartForCommit: inserting 202506_488_488_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:18.903091 [ 66694 ] {} SystemLog (system.text_log): Flushed system log up to offset 6479 2025.06.18 08:40:19.000269 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.74 GiB, peak 1.74 GiB, free memory in arenas 0.00 B, will set to 1.77 GiB (RSS), difference: 34.15 MiB 2025.06.18 08:40:19.260131 [ 66661 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Found 1 old parts to remove. Parts: [202506_185_185_0] 2025.06.18 08:40:19.260243 [ 66661 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Removing 1 parts from filesystem (serially): Parts: [202506_185_185_0] 2025.06.18 08:40:19.261182 [ 66661 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_185_185_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:19.261257 [ 66661 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Removing 1 parts from memory: Parts: [202506_185_185_0] 2025.06.18 08:40:19.286090 [ 66040 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.286510 [ 66040 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.286579 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:19.286892 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.286929 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:19.287219 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.287474 [ 65999 ] {} KeeperTCPHandler: Receiving request for session 120 took 1048 ms 2025.06.18 08:40:19.289364 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.289560 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.291442 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:19.291688 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:19.291766 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:19.291944 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:19.292045 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:19.292154 [ 66119 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.292706 [ 66119 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.292700 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:19.293040 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:19.293047 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.293051 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:19.293355 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.293530 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:19.293687 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:19.294337 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:19.295185 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.295806 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.295926 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:19.296873 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:19.297113 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:19.297573 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:19.297657 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:19.298086 [ 66122 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.298196 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:19.298483 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:19.298757 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.299238 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:19.299714 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:19.299741 [ 66127 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.299853 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:19.299956 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:19.300169 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:19.300447 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.301023 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.302431 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.303011 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:19.303512 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.303770 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:19.303874 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:19.303955 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:19.303976 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:19.304213 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.304635 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:19.306083 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.306714 [ 66117 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 1117ms, ratio: 0.025641028, points per minute: 13.773157) 2025.06.18 08:40:19.306896 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:19.306969 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:19.307708 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:19.307868 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:19.307961 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:19.308054 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:19.308433 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:19.308710 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:19.308820 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:19.308894 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:19.309482 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:19.309708 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:19.309793 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:19.309843 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:19.310560 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:19.310716 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:19.311096 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:19.311565 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:19.311739 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:19.311838 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:19.311911 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:19.312044 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:19.312141 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:19.312936 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:19.313052 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:19.313132 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:19.316226 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:19.316413 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:19.316624 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:19.316706 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:19.316790 [ 66117 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:19.316840 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:19.317246 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:19.318199 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:19.318557 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:19.319329 [ 66117 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 12ms, ratio: 0.025641028, points per minute: 1282.0513) 2025.06.18 08:40:19.322294 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:19.322437 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:19.322584 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:19.322820 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.322983 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.323084 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:19.323139 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:19.323241 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:19.323925 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:19.324034 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:19.324135 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:19.324329 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.324468 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.324577 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:19.324630 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:19.324730 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:19.325472 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:19.325598 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:19.325693 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:19.325907 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.326045 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.326133 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:19.326182 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:19.326288 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:19.326922 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:19.327027 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:19.327118 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:19.327291 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.327420 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.327507 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:19.327574 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:19.327672 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:19.328664 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:19.328804 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:19.328933 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:19.329201 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.329404 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.329592 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:19.329680 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:19.329791 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:19.330565 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:19.330627 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:19.330682 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:19.330784 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.330857 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.330907 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:19.330935 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:19.330988 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:19.331285 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:19.331344 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:19.331396 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:19.331494 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.331589 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:19.331641 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:19.331669 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:19.331721 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:19.331884 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:19.332226 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:19.332431 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:19.332483 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:19.336381 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:19.337653 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:19.338427 [ 66625 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:19.338973 [ 66133 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:19.339316 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:19.339379 [ 66133 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:19.339647 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:19.341643 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:19.343441 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:19.344166 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:19.344227 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:19.344272 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:19.344882 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:19.345225 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:19.345370 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:19.348404 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:19.348450 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:19.348496 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:19.348564 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:19.348619 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:19.351064 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:19.351170 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:19.351485 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:19.351842 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:19.352402 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:19.352635 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:19.354723 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:19.354805 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:19.354887 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:19.355058 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.355156 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.355216 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:19.355249 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:19.355311 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:19.355735 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:19.355800 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:19.355865 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:19.355989 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.356069 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.356123 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:19.356154 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:19.356212 [ 66628 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:19.356660 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:19.356724 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:19.356780 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:19.356887 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.356963 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.357014 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:19.357043 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:19.357104 [ 66628 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:19.357467 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:19.357527 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:19.357597 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:19.357699 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.357774 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.357844 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:19.357876 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:19.357932 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:19.358346 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:19.358404 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:19.358467 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:19.358590 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.358667 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.358726 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:19.358755 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:19.358808 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:19.359215 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:19.359274 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:19.359349 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:19.359458 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.359546 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.359599 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:19.359627 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:19.359678 [ 66628 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:19.359983 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:19.360039 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:19.360091 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:19.360189 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.360268 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:19.360318 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:19.360346 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:19.360397 [ 66628 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:19.360568 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:19.360911 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:19.361116 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:19.361166 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:19.363352 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:19.364079 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:19.364487 [ 66628 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:19.364812 [ 66144 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:19.364978 [ 66144 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:19.635498 [ 66178 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 1932ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:19.995996 [ 66658 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Found 1 old parts to remove. Parts: [202506_207_207_0] 2025.06.18 08:40:19.996127 [ 66658 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 1 parts from filesystem (serially): Parts: [202506_207_207_0] 2025.06.18 08:40:19.997226 [ 66658 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_207_207_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:19.997294 [ 66658 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 1 parts from memory: Parts: [202506_207_207_0] 2025.06.18 08:40:20.000200 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.77 GiB, peak 1.77 GiB, free memory in arenas 0.00 B, will set to 1.78 GiB (RSS), difference: 9.68 MiB 2025.06.18 08:40:20.095065 [ 66662 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Found 1 old parts to remove. Parts: [202506_105_105_0] 2025.06.18 08:40:20.095183 [ 66662 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Removing 1 parts from filesystem (serially): Parts: [202506_105_105_0] 2025.06.18 08:40:20.095848 [ 66662 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): removePartsFinally: removing 202506_105_105_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.095902 [ 66662 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Removing 1 parts from memory: Parts: [202506_105_105_0] 2025.06.18 08:40:20.098866 [ 66658 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Found 1 old parts to remove. Parts: [202506_144_144_0] 2025.06.18 08:40:20.098979 [ 66658 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Removing 1 parts from filesystem (serially): Parts: [202506_144_144_0] 2025.06.18 08:40:20.099715 [ 66658 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_144_144_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.099781 [ 66658 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Removing 1 parts from memory: Parts: [202506_144_144_0] 2025.06.18 08:40:20.157232 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '16940c08-1716-4469-8db3-c96f596592a5'. 2025.06.18 08:40:20.157389 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '18c89ff0-5a12-4b30-a585-ecab531d37f5'. 2025.06.18 08:40:20.157463 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'ad76396a-306a-47b4-b440-4bd762b5dfda'. 2025.06.18 08:40:20.157529 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '063a9953-6b5e-4e5c-9dcd-4aeb7b2d7622'. 2025.06.18 08:40:20.157614 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'ef54eaf2-08ca-4239-b643-d291c9d47053'. 2025.06.18 08:40:20.157678 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '46a318ed-df43-4956-92c9-94303284b22a'. 2025.06.18 08:40:20.157749 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'b5d9905a-1085-4ef9-bfe3-4bc2bb365e0d'. 2025.06.18 08:40:20.157834 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '4dce4414-6450-4b6d-8815-2b49a84277a8'. 2025.06.18 08:40:20.157898 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'ca6c80f1-19f3-4439-a167-d35e1034a955'. 2025.06.18 08:40:20.191037 [ 66662 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Found 1 old parts to remove. Parts: [202506_156_156_0] 2025.06.18 08:40:20.191134 [ 66662 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Removing 1 parts from filesystem (serially): Parts: [202506_156_156_0] 2025.06.18 08:40:20.191785 [ 66662 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_156_156_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.191835 [ 66662 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Removing 1 parts from memory: Parts: [202506_156_156_0] 2025.06.18 08:40:20.441367 [ 66295 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.441678 [ 66295 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.441904 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:20.443463 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.443483 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:20.443827 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.445606 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.445645 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.447313 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:20.447339 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:20.447562 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:20.447692 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:20.447752 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:20.447891 [ 66315 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.448264 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:20.448290 [ 66315 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.448470 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:20.448497 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.448555 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:20.448576 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:20.448638 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:20.448793 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.448971 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:20.450061 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:20.450123 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.450325 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.450582 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:20.450691 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:20.450961 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:20.451325 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:20.452160 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:20.452332 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:20.452409 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:20.452472 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:20.452478 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:20.452500 [ 66331 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.452883 [ 66331 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.452886 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:20.453079 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.453117 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:20.453351 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.454889 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.454976 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.455032 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:20.455094 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:20.455285 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.456297 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:20.456842 [ 66192 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 1138ms, ratio: 0.025641028, points per minute: 13.518995) 2025.06.18 08:40:20.456924 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:20.456916 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:20.457021 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:20.457125 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:20.457726 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:20.457958 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:20.458043 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:20.458844 [ 66192 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:20.458968 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:20.459013 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:20.459622 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:20.459671 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:20.459715 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:20.459981 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:20.460068 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:20.460115 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:20.460159 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:20.460213 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:20.460265 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:20.460908 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:20.461388 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:20.461473 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:20.461692 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:20.461944 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:20.462830 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:20.462836 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:20.462959 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:20.462962 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:20.463055 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:20.463215 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:20.463473 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:20.464112 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:20.465312 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:20.465388 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.465440 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:20.465495 [ 66192 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:20.467190 [ 66192 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 8ms, ratio: 0.025641028, points per minute: 1923.077) 2025.06.18 08:40:20.467409 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:20.467492 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:20.467593 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:20.467728 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.467824 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.467890 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:20.467923 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:20.467983 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:20.468382 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:20.468448 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:20.468510 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:20.468643 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.468726 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.468780 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:20.468810 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:20.468867 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:20.468979 [ 66665 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Found 1 old parts to remove. Parts: [202506_187_187_0] 2025.06.18 08:40:20.469076 [ 66665 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Removing 1 parts from filesystem (serially): Parts: [202506_187_187_0] 2025.06.18 08:40:20.469323 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:20.469389 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:20.469444 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:20.469572 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.469649 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.469700 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:20.469730 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:20.469752 [ 66665 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): removePartsFinally: removing 202506_187_187_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.469789 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:20.469842 [ 66665 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Removing 1 parts from memory: Parts: [202506_187_187_0] 2025.06.18 08:40:20.470324 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:20.470419 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:20.470506 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:20.470669 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.470758 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.470811 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:20.470840 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:20.470897 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:20.471322 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:20.471380 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:20.471436 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:20.471560 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.471639 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.471689 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:20.471717 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:20.471771 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:20.472182 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:20.472241 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:20.472294 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:20.472392 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.472466 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.472514 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:20.472556 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:20.472618 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:20.472910 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:20.472967 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:20.473019 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:20.473116 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.473188 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:20.473237 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:20.473265 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:20.473317 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:20.473476 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:20.473892 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:20.474104 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:20.474155 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:20.476679 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:20.477384 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:20.477803 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:20.478094 [ 66338 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:20.478274 [ 66338 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:20.478459 [ 66338 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:20.478475 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:20.478654 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:20.479866 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:20.480976 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:20.481446 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:20.481514 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:20.481581 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:20.482075 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:20.482262 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:20.482342 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:20.484430 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:20.484466 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:20.484507 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:20.484575 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:20.484627 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:20.487345 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:20.487449 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:20.487729 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:20.487967 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:20.488642 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:20.488842 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:20.490856 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:20.490936 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:20.491023 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:20.491164 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.491261 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.491321 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:20.491354 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:20.491414 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:20.491813 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:20.491875 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:20.491936 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:20.492050 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.492129 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.492183 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:20.492214 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:20.492271 [ 66625 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:20.492729 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:20.492792 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:20.492847 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:20.492951 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.493025 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.493076 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:20.493105 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:20.493160 [ 66625 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:20.493515 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:20.493587 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:20.493642 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:20.493746 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.493852 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.493909 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:20.493938 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:20.494003 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:20.494424 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:20.494483 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:20.494552 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:20.494666 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.494742 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.494793 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:20.494821 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:20.494876 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:20.495283 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:20.495344 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:20.495397 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:20.495496 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.495583 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.495640 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:20.495669 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:20.495723 [ 66625 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:20.496023 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:20.496081 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:20.496131 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:20.496228 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.496300 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:20.496348 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:20.496375 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:20.496427 [ 66625 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:20.496599 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:20.496936 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:20.497145 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:20.497196 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:20.499600 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:20.500309 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:20.500727 [ 66625 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:20.501097 [ 66352 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:20.502637 [ 66352 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:20.674166 [ 66665 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Found 1 old parts to remove. Parts: [202506_160_160_0] 2025.06.18 08:40:20.674259 [ 66665 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Removing 1 parts from filesystem (serially): Parts: [202506_160_160_0] 2025.06.18 08:40:20.674844 [ 66665 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): removePartsFinally: removing 202506_160_160_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:20.674893 [ 66665 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Removing 1 parts from memory: Parts: [202506_160_160_0] 2025.06.18 08:40:20.931871 [ 66808 ] {} Poco: Queue size: 0, current threads: 1, threads in pool: 4, current connections: 0 2025.06.18 08:40:20.932099 [ 66000 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:40732 2025.06.18 08:40:20.932365 [ 66000 ] {} TCPHandler: Connected ClickHouse client version 24.8.0, revision: 54472, user: default. 2025.06.18 08:40:20.932500 [ 66000 ] {} TCP-Session-61649dbe-ca0c-4333-b293-6f272db23d9f: Authenticating user 'default' from [::1]:40732 2025.06.18 08:40:20.932759 [ 66000 ] {} TCP-Session-61649dbe-ca0c-4333-b293-6f272db23d9f: 61649dbe-ca0c-4333-b293-6f272db23d9f Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:20.932844 [ 66000 ] {} TCP-Session-61649dbe-ca0c-4333-b293-6f272db23d9f: Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:20.961235 [ 66000 ] {} TCP-Session-61649dbe-ca0c-4333-b293-6f272db23d9f: 61649dbe-ca0c-4333-b293-6f272db23d9f Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2025.06.18 08:40:20.963146 [ 66000 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} executeQuery: (from [::1]:40732) SELECT count() FROM system.build_options WHERE name = 'CXX_FLAGS' AND position('sanitize=address' IN value) (stage: Complete) 2025.06.18 08:40:20.966740 [ 66000 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} Planner: Query to stage Complete 2025.06.18 08:40:20.967438 [ 66000 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} Planner: Query from stage FetchColumns to stage Complete 2025.06.18 08:40:20.974064 [ 66718 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} Aggregator: Aggregation method: without_key 2025.06.18 08:40:20.974208 [ 66718 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} AggregatingTransform: Aggregated. 0 to 1 rows (from 0.00 B) in 0.004028917 sec. (0.000 rows/sec., 0.00 B/sec.) 2025.06.18 08:40:20.974263 [ 66718 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} Aggregator: Merging aggregated data 2025.06.18 08:40:20.974329 [ 66718 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} HashTablesStatistics: Statistics updated for key=16690531032610678897: new sum_of_sizes=1, median_size=1 2025.06.18 08:40:20.992206 [ 66000 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} executeQuery: Read 66 rows, 4.86 KiB in 0.030063 sec., 2195.389681668496 rows/sec., 161.67 KiB/sec. 2025.06.18 08:40:20.993302 [ 66000 ] {3e949773-c32a-413f-8d9d-80ff2a4d8c77} TCPHandler: Processed in 0.03265796 sec. 2025.06.18 08:40:21.000221 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.78 GiB, peak 1.78 GiB, free memory in arenas 0.00 B, will set to 1.79 GiB (RSS), difference: 10.20 MiB 2025.06.18 08:40:21.031343 [ 66422 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 1396ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:21.032488 [ 66661 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Found 1 old parts to remove. Parts: [202506_218_218_0] 2025.06.18 08:40:21.032634 [ 66661 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Removing 1 parts from filesystem (serially): Parts: [202506_218_218_0] 2025.06.18 08:40:21.033626 [ 66661 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_218_218_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:21.033731 [ 66661 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Removing 1 parts from memory: Parts: [202506_218_218_0] 2025.06.18 08:40:21.042644 [ 66000 ] {} TCPHandler: Closing connection (open: true, cancelled: false, eof: true) 2025.06.18 08:40:21.042716 [ 66000 ] {} TCPHandler: Done processing connection. 2025.06.18 08:40:21.043525 [ 66000 ] {} TCP-Session-61649dbe-ca0c-4333-b293-6f272db23d9f: 61649dbe-ca0c-4333-b293-6f272db23d9f Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:27.805944 [ 66808 ] {} Poco: Queue size: 0, current threads: 1, threads in pool: 4, current connections: 0 2025.06.18 08:40:27.806238 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.79 GiB, peak 1.79 GiB, free memory in arenas 0.00 B, will set to 1.79 GiB (RSS), difference: 3.80 MiB 2025.06.18 08:40:27.806713 [ 66694 ] {} SystemLog (system.text_log): Flushing system log, 284 entries to flush up to offset 6763 2025.06.18 08:40:27.806794 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '16940c08-1716-4469-8db3-c96f596592a5'. 2025.06.18 08:40:27.808026 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '18c89ff0-5a12-4b30-a585-ecab531d37f5'. 2025.06.18 08:40:27.808534 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'ad76396a-306a-47b4-b440-4bd762b5dfda'. 2025.06.18 08:40:27.808680 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '063a9953-6b5e-4e5c-9dcd-4aeb7b2d7622'. 2025.06.18 08:40:27.808838 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'ef54eaf2-08ca-4239-b643-d291c9d47053'. 2025.06.18 08:40:27.808765 [ 66716 ] {} SystemLog (system.zookeeper_log): Flushing system log, 4740 entries to flush up to offset 4740 2025.06.18 08:40:27.808709 [ 66712 ] {} SystemLog (system.opentelemetry_span_log): Flushing system log, 5 entries to flush up to offset 5 2025.06.18 08:40:27.808823 [ 66717 ] {} SystemLog (system.transactions_info_log): Flushing system log, 16 entries to flush up to offset 16 2025.06.18 08:40:27.807994 [ 66725 ] {} SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 7 2025.06.18 08:40:27.807991 [ 66739 ] {} SystemLog (system.part_log): Flushing system log, 38 entries to flush up to offset 38 2025.06.18 08:40:27.807668 [ 66748 ] {} SystemLog (system.error_log): Flushing system log, 11 entries to flush up to offset 11 2025.06.18 08:40:27.809988 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '46a318ed-df43-4956-92c9-94303284b22a'. 2025.06.18 08:40:27.809956 [ 66689 ] {} SystemLog (system.processors_profile_log): Flushing system log, 34 entries to flush up to offset 34 2025.06.18 08:40:27.810422 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'b5d9905a-1085-4ef9-bfe3-4bc2bb365e0d'. 2025.06.18 08:40:27.810740 [ 66691 ] {} ExternalDictionariesLoader: Loading config file '4dce4414-6450-4b6d-8815-2b49a84277a8'. 2025.06.18 08:40:27.808320 [ 66731 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 2623 entries to flush up to offset 2623 2025.06.18 08:40:27.810091 [ 66727 ] {} SystemLog (system.query_log): Flushing system log, 6 entries to flush up to offset 6 2025.06.18 08:40:27.812074 [ 66691 ] {} ExternalDictionariesLoader: Loading config file 'ca6c80f1-19f3-4439-a167-d35e1034a955'. 2025.06.18 08:40:27.814499 [ 66000 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:44086 2025.06.18 08:40:27.815088 [ 65999 ] {} KeeperTCPHandler: Receiving request for session 120 took 6783 ms 2025.06.18 08:40:27.815129 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2025.06.18 08:40:27.815209 [ 65999 ] {} KeeperTCPHandler: Received heartbeat for session #120 2025.06.18 08:40:27.815465 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Found 2 old parts to remove. Parts: [202506_373_373_0, 202506_374_374_0] 2025.06.18 08:40:27.814376 [ 66488 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.815959 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 2 parts from filesystem (serially): Parts: [202506_373_373_0, 202506_374_374_0] 2025.06.18 08:40:27.817291 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:27.818126 [ 66000 ] {} TCPHandler: Connected ClickHouse client version 24.8.0, revision: 54472, user: default. 2025.06.18 08:40:27.818237 [ 66000 ] {} TCP-Session-f5d32a8a-0537-410c-af4a-a8f9eec0478e: Authenticating user 'default' from [::1]:44086 2025.06.18 08:40:27.818357 [ 66000 ] {} TCP-Session-f5d32a8a-0537-410c-af4a-a8f9eec0478e: f5d32a8a-0537-410c-af4a-a8f9eec0478e Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:27.818404 [ 66000 ] {} TCP-Session-f5d32a8a-0537-410c-af4a-a8f9eec0478e: Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:27.817656 [ 66617 ] {} CgroupsMemoryUsageObserver: Read current memory usage 6994268160 bytes (6.51 GiB) from cgroups 2025.06.18 08:40:27.819573 [ 66490 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8) (MergerMutator): Selected 5 parts from 202506_154_158_1 to 202506_162_162_0 2025.06.18 08:40:27.821214 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_373_373_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:27.821323 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_374_374_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:27.821394 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 2 parts from memory: Parts: [202506_373_373_0, 202506_374_374_0] 2025.06.18 08:40:27.822831 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:27.822826 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk azure 2025.06.18 08:40:27.823632 [ 66694 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.823708 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk backups 2025.06.18 08:40:27.823854 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk cached_azure 2025.06.18 08:40:27.824417 [ 66490 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.824811 [ 66472 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Scheduling next merge selecting task after 7684ms, current attempt status: CannotSelect 2025.06.18 08:40:27.825999 [ 66385 ] {} DNSResolver: Updating DNS cache 2025.06.18 08:40:27.826513 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.826502 [ 66488 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.826657 [ 66694 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.826803 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.827723 [ 66518 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Scheduling next merge selecting task after 7987ms, current attempt status: CannotSelect 2025.06.18 08:40:27.827843 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:27.827887 [ 66490 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.829250 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.829561 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.831933 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:27.832881 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:27.833078 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.834132 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:27.834160 [ 66433 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 6802ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:27.834280 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:27.834753 [ 66385 ] {} DNSResolver: Updated DNS cache 2025.06.18 08:40:27.835008 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTask::PrepareStage: Merging 5 parts: from 202506_154_158_1 to 202506_162_162_0 into Compact with storage Full 2025.06.18 08:40:27.836126 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:27.836257 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:27.836567 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:27.837150 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:27.838482 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:27.838513 [ 66382 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.840120 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:27.841068 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.841061 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:27.842088 [ 66395 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.842606 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:27.843260 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:27.844053 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.844050 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:27.844181 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.844297 [ 66731 ] {} SystemLog (system.asynchronous_metric_log): Will use existing table system.asynchronous_metric_log for AsynchronousMetricLog 2025.06.18 08:40:27.844440 [ 66748 ] {} SystemLog (system.error_log): Will use existing table system.error_log for ErrorLog 2025.06.18 08:40:27.844740 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:27.844744 [ 66717 ] {} SystemLog (system.transactions_info_log): Will use existing table system.transactions_info_log for TransactionsInfoLog 2025.06.18 08:40:27.845071 [ 66712 ] {} SystemLog (system.opentelemetry_span_log): Will use existing table system.opentelemetry_span_log for OpenTelemetrySpanLog 2025.06.18 08:40:27.845290 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:27.845700 [ 66689 ] {} SystemLog (system.processors_profile_log): Will use existing table system.processors_profile_log for ProcessorsProfileLog 2025.06.18 08:40:27.847254 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:27.847460 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:27.847442 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:27.847639 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:27.847712 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:27.847841 [ 66000 ] {} TCP-Session-f5d32a8a-0537-410c-af4a-a8f9eec0478e: f5d32a8a-0537-410c-af4a-a8f9eec0478e Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2025.06.18 08:40:27.848364 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.848486 [ 66380 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.849337 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:27.849630 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.850203 [ 66000 ] {b4fc439a-9a1a-41f7-a397-4a5760936e5c} executeQuery: (from [::1]:44086) SELECT 'Connected to clickhouse-server after attaching gdb' (stage: Complete) 2025.06.18 08:40:27.850502 [ 66694 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:27.850634 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeSequentialSource: Reading 2 marks from part 202506_154_158_1, total 884 rows starting from the beginning of the part 2025.06.18 08:40:27.851723 [ 66000 ] {b4fc439a-9a1a-41f7-a397-4a5760936e5c} Planner: Query to stage Complete 2025.06.18 08:40:27.851811 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:27.852674 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.852692 [ 66000 ] {b4fc439a-9a1a-41f7-a397-4a5760936e5c} Planner: Query from stage FetchColumns to stage Complete 2025.06.18 08:40:27.853051 [ 66378 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.854641 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:27.854782 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:27.854861 [ 66786 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.854930 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.854949 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeSequentialSource: Reading 2 marks from part 202506_159_159_0, total 17 rows starting from the beginning of the part 2025.06.18 08:40:27.855649 [ 66377 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.857055 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.857425 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:27.858408 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.858513 [ 66786 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.858894 [ 66739 ] {} SystemLog (system.part_log): Will use existing table system.part_log for PartLog 2025.06.18 08:40:27.859571 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:27.859986 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeSequentialSource: Reading 2 marks from part 202506_160_160_0, total 153 rows starting from the beginning of the part 2025.06.18 08:40:27.860188 [ 66000 ] {b4fc439a-9a1a-41f7-a397-4a5760936e5c} executeQuery: Read 1 rows, 1.00 B in 0.011246 sec., 88.92050506846878 rows/sec., 88.92 B/sec. 2025.06.18 08:40:27.860623 [ 66712 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.861060 [ 66000 ] {b4fc439a-9a1a-41f7-a397-4a5760936e5c} TCPHandler: Processed in 0.014362848 sec. 2025.06.18 08:40:27.861738 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_489_489_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.861748 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.862021 [ 66717 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.862168 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): preparePartForCommit: inserting 202506_489_489_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.862180 [ 66785 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.862214 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeSequentialSource: Reading 2 marks from part 202506_161_161_0, total 206 rows starting from the beginning of the part 2025.06.18 08:40:27.864534 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:27.864436 [ 66381 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c) (MergerMutator): Selected 6 parts from 202506_474_484_2 to 202506_489_489_0 2025.06.18 08:40:27.864604 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:27.864808 [ 66712 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.864905 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:27.864931 [ 66712 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.864946 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:27.865260 [ 66786 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.865721 [ 66748 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.865875 [ 66381 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.866232 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeSequentialSource: Reading 2 marks from part 202506_162_162_0, total 258 rows starting from the beginning of the part 2025.06.18 08:40:27.866434 [ 66381 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.867070 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:27.867546 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:27.868303 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:27.869190 [ 66401 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 7402ms, ratio: 0.025641028, points per minute: 2.0784404) 2025.06.18 08:40:27.869968 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.870020 [ 66785 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.870169 [ 66716 ] {} SystemLog (system.zookeeper_log): Will use existing table system.zookeeper_log for ZooKeeperLog 2025.06.18 08:40:27.870487 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:27.870408 [ 66727 ] {} SystemLog (system.query_log): Will use existing table system.query_log for QueryLog 2025.06.18 08:40:27.870651 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTask::PrepareStage: Merging 6 parts: from 202506_474_484_2 to 202506_489_489_0 into Compact with storage Full 2025.06.18 08:40:27.870673 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:27.871042 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:27.871083 [ 66694 ] {} SystemLog (system.text_log): Flushed system log up to offset 6763 2025.06.18 08:40:27.871343 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:27.871631 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:27.872001 [ 66689 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.872634 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:27.872761 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:27.873196 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:27.874562 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:27.875255 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:27.875307 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.875854 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.876133 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:27.876381 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:27.876491 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:27.876840 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:27.878552 [ 66689 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.878592 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:27.879082 [ 66748 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.879465 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:27.879491 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:27.879613 [ 66717 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.879699 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:27.879882 [ 66712 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.879971 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:27.880831 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_474_484_2, total 910 rows starting from the beginning of the part 2025.06.18 08:40:27.880564 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:27.882543 [ 66731 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.882765 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:27.882913 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:27.882968 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:27.884423 [ 66786 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.886037 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_485_485_0, total 148 rows starting from the beginning of the part 2025.06.18 08:40:27.886112 [ 66739 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.887806 [ 66785 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.888327 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_486_486_0, total 64 rows starting from the beginning of the part 2025.06.18 08:40:27.888707 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk default 2025.06.18 08:40:27.888788 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk1_02961 2025.06.18 08:40:27.888830 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk2_02961 2025.06.18 08:40:27.888864 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk3_02961 2025.06.18 08:40:27.888896 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk disk4_02961 2025.06.18 08:40:27.888947 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_cache 2025.06.18 08:40:27.888988 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_cache_2 2025.06.18 08:40:27.889026 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_cache_3 2025.06.18 08:40:27.889058 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_disk 2025.06.18 08:40:27.889090 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_disk_2 2025.06.18 08:40:27.889121 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk local_disk_3 2025.06.18 08:40:27.889693 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache 2025.06.18 08:40:27.889929 [ 66786 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.890174 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_02933 2025.06.18 08:40:27.890177 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_487_487_0, total 173 rows starting from the beginning of the part 2025.06.18 08:40:27.890644 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:27.890713 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_02944 2025.06.18 08:40:27.890883 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:27.891171 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:27.891218 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_multi 2025.06.18 08:40:27.891358 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:27.891371 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:27.891783 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_cache_multi_2 2025.06.18 08:40:27.891863 [ 66777 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.892060 [ 66401 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:27.892290 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_disk 2025.06.18 08:40:27.892301 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:27.892342 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_disk_02944 2025.06.18 08:40:27.892392 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_disk_02963 2025.06.18 08:40:27.892426 [ 66426 ] {} DatabaseCatalog: Nothing to clean up from store/ on disk s3_no_cache 2025.06.18 08:40:27.892645 [ 66712 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_150_150_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.892944 [ 66689 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.892944 [ 66712 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): preparePartForCommit: inserting 202506_150_150_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.892945 [ 66748 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.893203 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_488_488_0, total 6479 rows starting from the beginning of the part 2025.06.18 08:40:27.893616 [ 66376 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227) (MergerMutator): Selected 2 parts from 202506_1_145_41 to 202506_146_146_0 2025.06.18 08:40:27.894143 [ 66376 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.894294 [ 66785 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.894303 [ 66376 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.894377 [ 66717 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.894685 [ 66618 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_489_489_0, total 284 rows starting from the beginning of the part 2025.06.18 08:40:27.895290 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:27.895483 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTask::PrepareStage: Merging 2 parts: from 202506_1_145_41 to 202506_146_146_0 into Compact with storage Full 2025.06.18 08:40:27.895706 [ 66739 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.895832 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:27.895884 [ 66739 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.896920 [ 66401 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 28ms, ratio: 0.025641028, points per minute: 549.45056) 2025.06.18 08:40:27.897194 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:27.897223 [ 66712 ] {} SystemLog (system.opentelemetry_span_log): Flushed system log up to offset 5 2025.06.18 08:40:27.897993 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTreeSequentialSource: Reading 2 marks from part 202506_1_145_41, total 5410 rows starting from the beginning of the part 2025.06.18 08:40:27.898582 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.898761 [ 66731 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.899128 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:27.899353 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:27.899427 [ 66786 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.899574 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:27.899974 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.900232 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.900544 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:27.900578 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_240_240_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.900705 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:27.900876 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:27.900927 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTreeSequentialSource: Reading 2 marks from part 202506_146_146_0, total 1 rows starting from the beginning of the part 2025.06.18 08:40:27.900965 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): preparePartForCommit: inserting 202506_240_240_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.901279 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:27.901318 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_270_270_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.901341 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:27.901423 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:27.901531 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.901590 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): preparePartForCommit: inserting 202506_270_270_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.901602 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.901696 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:27.901735 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:27.901788 [ 66620 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:27.902322 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:27.902385 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:27.902436 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:27.902548 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.902635 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.902691 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:27.902718 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:27.902787 [ 66620 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:27.903033 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_163_163_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.903127 [ 66777 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.903367 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:27.903444 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:27.903500 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:27.903624 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.903619 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): preparePartForCommit: inserting 202506_163_163_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.903703 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.903756 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:27.903781 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:27.903834 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:27.903494 [ 66373 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7) (MergerMutator): Selected 5 parts from 202506_1_265_53 to 202506_269_269_0 2025.06.18 08:40:27.904262 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:27.904341 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:27.904397 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:27.904528 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.904611 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.904663 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:27.904660 [ 66373 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.904703 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:27.904794 [ 66620 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:27.904876 [ 66373 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.905772 [ 66717 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 16 2025.06.18 08:40:27.906792 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:27.906868 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:27.906934 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:27.907028 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.907112 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.907176 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:27.907211 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:27.907267 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:27.907406 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTask::PrepareStage: Merging 5 parts: from 202506_1_265_53 to 202506_269_269_0 into Compact with storage Full 2025.06.18 08:40:27.907924 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:27.907990 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:27.908047 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:27.908149 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.908220 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:27.908273 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:27.908299 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:27.908356 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:27.908538 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:27.909611 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.909855 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.909915 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:27.910712 [ 66748 ] {} SystemLog (system.error_log): Flushed system log up to offset 11 2025.06.18 08:40:27.911108 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:27.911819 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeSequentialSource: Reading 3 marks from part 202506_1_265_53, total 9172 rows starting from the beginning of the part 2025.06.18 08:40:27.911970 [ 66727 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.912481 [ 66689 ] {} SystemLog (system.processors_profile_log): Flushed system log up to offset 34 2025.06.18 08:40:27.913079 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:27.913362 [ 66785 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.913450 [ 66739 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.914393 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeSequentialSource: Reading 2 marks from part 202506_266_266_0, total 26 rows starting from the beginning of the part 2025.06.18 08:40:27.914459 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:27.914873 [ 66620 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:27.916389 [ 66368 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:27.916750 [ 66786 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.916814 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:27.916851 [ 66368 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:27.916879 [ 66000 ] {} TCPHandler: Closing connection (open: true, cancelled: false, eof: true) 2025.06.18 08:40:27.916979 [ 66000 ] {} TCPHandler: Done processing connection. 2025.06.18 08:40:27.917099 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:27.917325 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeSequentialSource: Reading 2 marks from part 202506_267_267_0, total 9 rows starting from the beginning of the part 2025.06.18 08:40:27.918493 [ 66000 ] {} TCP-Session-f5d32a8a-0537-410c-af4a-a8f9eec0478e: f5d32a8a-0537-410c-af4a-a8f9eec0478e Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:27.918493 [ 66777 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.919025 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeSequentialSource: Reading 2 marks from part 202506_268_268_0, total 24 rows starting from the beginning of the part 2025.06.18 08:40:27.919065 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:27.920295 [ 66785 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.920346 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeSequentialSource: Reading 2 marks from part 202506_269_269_0, total 30 rows starting from the beginning of the part 2025.06.18 08:40:27.920891 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:27.921068 [ 66786 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:27.921593 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.921883 [ 66727 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:27.922185 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:27.922264 [ 66739 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_109_109_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.922342 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:27.922445 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:27.922514 [ 66739 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): preparePartForCommit: inserting 202506_109_109_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.923769 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:27.924251 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:27.924380 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:27.926701 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:27.926800 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:27.926895 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:27.926993 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:27.928070 [ 66739 ] {} SystemLog (system.part_log): Flushed system log up to offset 38 2025.06.18 08:40:27.928148 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:27.929728 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergeTask::MergeProjectionsStage: Merge sorted 1518 rows, containing 19 columns (19 merged, 0 gathered) in 0.098405971 sec., 15425.893211297109 rows/sec., 2.79 MiB/sec. 2025.06.18 08:40:27.930898 [ 66731 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.933243 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:27.933541 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:27.934006 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:27.934886 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:27.935793 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:27.936037 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:27.937395 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_284_284_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.937746 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} MergedBlockOutputStream: filled checksums 202506_154_162_2 (state Temporary) 2025.06.18 08:40:27.937995 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): preparePartForCommit: inserting 202506_284_284_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.939005 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:27.939148 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:27.939250 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:27.939583 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.939729 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.939818 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:27.939870 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:27.939944 [ 66623 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:27.940456 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:27.940556 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:27.940645 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:27.940786 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.940933 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.941010 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:27.941064 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:27.941142 [ 66623 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:27.941722 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:27.941803 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:27.941889 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:27.942020 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.942128 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.942212 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:27.942259 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:27.942341 [ 66623 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:27.942780 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Renaming temporary part tmp_merge_202506_154_162_2 to 202506_154_162_2 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.942843 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:27.942943 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:27.943023 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:27.943031 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): preparePartForCommit: inserting 202506_154_162_2 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.943118 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8) (MergerMutator): Merged 5 parts: [202506_154_158_1, 202506_162_162_0] -> 202506_154_162_2 2025.06.18 08:40:27.943164 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.943264 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_154_158_1 2025.06.18 08:40:27.943272 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.943382 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_159_159_0 2025.06.18 08:40:27.943406 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:27.943448 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_160_160_0 2025.06.18 08:40:27.943457 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:27.943506 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_161_161_0 2025.06.18 08:40:27.943558 [ 66623 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:27.943584 [ 66631 ] {c9cd645f-6d54-4617-ad56-fb3f67a060f8::202506_154_162_2} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8), part: 202506_162_162_0 2025.06.18 08:40:27.944105 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:27.944207 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:27.944289 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:27.944426 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.944553 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.944623 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:27.944659 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:27.944733 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:27.945123 [ 66731 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 2623 2025.06.18 08:40:27.945626 [ 66631 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 6.15 MiB. 2025.06.18 08:40:27.945712 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:27.945803 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:27.945915 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:27.946061 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.946169 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.946244 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:27.946281 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:27.946343 [ 66623 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:27.946753 [ 66623 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:27.946835 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:27.946913 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:27.947058 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.947170 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66623, kind: Regular, unbound: 0 2025.06.18 08:40:27.947245 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:27.947278 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:27.947333 [ 66623 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:27.947570 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:27.948167 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.948307 [ 66727 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:27.948450 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.948551 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:27.951677 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:27.952677 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:27.953224 [ 66623 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:27.953651 [ 66365 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:27.955280 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_168_168_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:27.955541 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): preparePartForCommit: inserting 202506_168_168_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:27.960977 [ 66727 ] {} SystemLog (system.query_log): Flushed system log up to offset 6 2025.06.18 08:40:27.970679 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergeTask::MergeProjectionsStage: Merge sorted 5411 rows, containing 11 columns (11 merged, 0 gathered) in 0.075347194 sec., 71814.22044728036 rows/sec., 10.19 MiB/sec. 2025.06.18 08:40:27.983022 [ 66716 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:27.987637 [ 66725 ] {} SystemLog (system.metric_log): Will use existing table system.metric_log for MetricLog 2025.06.18 08:40:27.990720 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Trying to reserve 1.13 MiB using storage policy from min volume index 0 2025.06.18 08:40:27.990889 [ 66716 ] {} DiskLocal: Reserved 1.13 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:28.000371 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.81 GiB, peak 1.82 GiB, free memory in arenas 0.00 B, will set to 1.91 GiB (RSS), difference: 97.70 MiB 2025.06.18 08:40:28.002735 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} MergedBlockOutputStream: filled checksums 202506_1_146_42 (state Temporary) 2025.06.18 08:40:28.006564 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Renaming temporary part tmp_merge_202506_1_146_42 to 202506_1_146_42 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.006773 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): preparePartForCommit: inserting 202506_1_146_42 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.006843 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227) (MergerMutator): Merged 2 parts: [202506_1_145_41, 202506_146_146_0] -> 202506_1_146_42 2025.06.18 08:40:28.006972 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_1_145_41 2025.06.18 08:40:28.007052 [ 66629 ] {3772ccdf-fbcf-4ce3-ad0a-515b3f93b227::202506_1_146_42} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227), part: 202506_146_146_0 2025.06.18 08:40:28.007914 [ 66618 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. ./contrib/llvm-project/libcxx/include/vector:438: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x000000000fb1e06c 4. ./build_docker/./src/Common/ThreadPool.cpp:259: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x000000000fb206f8 5. ./build_docker/./src/Common/ThreadPool.cpp:0: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x000000000fb19cce 6. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000000fb19a0b 7. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019b9375d 8. ./src/Common/threadPoolCallbackRunner.h:70: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x0000000019b8fe30 9. ./build_docker/./src/Storages/MergeTree/MergeTreeMarksLoader.cpp:73: DB::MergeTreeMarksLoader::startAsyncLoad() @ 0x0000000019b8fb01 10. ./build_docker/./src/Storages/MergeTree/MergeTreeReaderCompact.cpp:0: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr, DB::NamesAndTypesList, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map, std::allocator>>, std::function const&, int) @ 0x0000000019bbd056 11. ./contrib/llvm-project/libcxx/include/__tree:1088: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int>(std::shared_ptr&, DB::NamesAndTypesList const&, std::unordered_map, std::equal_to, std::allocator>> const&, std::shared_ptr const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&, int&&) @ 0x0000000019aa4952 12. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr const&, DB::MarkRanges const&, std::unordered_map, std::equal_to, std::allocator>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr const&, DB::MergeTreeReaderSettings const&, std::map, std::allocator>> const&, std::function const&) const @ 0x0000000019aa0e4b 13. ./build_docker/./src/Storages/MergeTree/MergeTreeSequentialSource.cpp:169: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::vector>, std::optional, bool, bool, bool) @ 0x0000000019bf3daf 14. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15007] const&, std::shared_ptr&, std::shared_ptr&, std::vector>&, std::optional, bool, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr&, std::shared_ptr&, std::vector>&, std::optional&&, bool&&, bool&, bool&) @ 0x0000000019bf7d4d 15. ./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298: DB::createMergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::vector>, std::optional, std::shared_ptr>, bool, bool, bool) @ 0x0000000019bf63a2 16. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:1136: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::createMergedStream() @ 0x00000000199667df 17. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x0000000019962c25 18. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000001996a26e 19. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:0: DB::MergeTask::execute() @ 0x0000000019971917 20. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:0: DB::MergePlainMergeTreeTask::executeStep() @ 0x0000000019e92ac9 21. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 22. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 23. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 24. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 25. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 26. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 27. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 28. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 29. __tsan_thread_start_func @ 0x000000000758af2f 30. ? @ 0x00007fac84fa8ac3 31. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.008786 [ 66629 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 6.16 MiB. 2025.06.18 08:40:28.029424 [ 66716 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:28.029887 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergeTask::MergeProjectionsStage: Merge sorted 9261 rows, containing 14 columns (14 merged, 0 gathered) in 0.123031968 sec., 75273.11925954073 rows/sec., 12.36 MiB/sec. 2025.06.18 08:40:28.032733 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_246_246_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.032913 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): preparePartForCommit: inserting 202506_246_246_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.033376 [ 66362 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e) (MergerMutator): Selected 6 parts from 202506_190_241_13 to 202506_246_246_0 2025.06.18 08:40:28.033599 [ 66362 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:28.034072 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} MergedBlockOutputStream: filled checksums 202506_1_269_54 (state Temporary) 2025.06.18 08:40:28.034717 [ 66362 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:28.035295 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTask::PrepareStage: Merging 6 parts: from 202506_190_241_13 to 202506_246_246_0 into Compact with storage Full 2025.06.18 08:40:28.035931 [ 66716 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 4740 2025.06.18 08:40:28.037958 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Renaming temporary part tmp_merge_202506_1_269_54 to 202506_1_269_54 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.038144 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): preparePartForCommit: inserting 202506_1_269_54 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.038204 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7) (MergerMutator): Merged 5 parts: [202506_1_265_53, 202506_269_269_0] -> 202506_1_269_54 2025.06.18 08:40:28.038299 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_1_265_53 2025.06.18 08:40:28.038354 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_266_266_0 2025.06.18 08:40:28.038356 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:28.038406 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_267_267_0 2025.06.18 08:40:28.038453 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_268_268_0 2025.06.18 08:40:28.038491 [ 66628 ] {2f108207-c586-44f8-8201-2f3f8b2a61e7::202506_1_269_54} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7), part: 202506_269_269_0 2025.06.18 08:40:28.038835 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeSequentialSource: Reading 3 marks from part 202506_190_241_13, total 18374 rows starting from the beginning of the part 2025.06.18 08:40:28.040018 [ 66777 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.040107 [ 66628 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 7.26 MiB. 2025.06.18 08:40:28.040952 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeSequentialSource: Reading 2 marks from part 202506_242_242_0, total 1 rows starting from the beginning of the part 2025.06.18 08:40:28.042037 [ 66785 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.042411 [ 66808 ] {} Poco: Queue size: 0, current threads: 1, threads in pool: 4, current connections: 0 2025.06.18 08:40:28.042479 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeSequentialSource: Reading 2 marks from part 202506_243_243_0, total 1 rows starting from the beginning of the part 2025.06.18 08:40:28.042643 [ 66000 ] {} TCPHandlerFactory: TCP Request. Address: [::1]:44094 2025.06.18 08:40:28.043373 [ 66000 ] {} TCPHandler: Connected ClickHouse client version 24.8.0, revision: 54472, user: default. 2025.06.18 08:40:28.043567 [ 66000 ] {} TCP-Session-6fad4f30-f9be-4f63-b4e6-dc0bce31c830: Authenticating user 'default' from [::1]:44094 2025.06.18 08:40:28.043759 [ 66786 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.043817 [ 66000 ] {} TCP-Session-6fad4f30-f9be-4f63-b4e6-dc0bce31c830: 6fad4f30-f9be-4f63-b4e6-dc0bce31c830 Authenticated with global context as user 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:28.043917 [ 66000 ] {} TCP-Session-6fad4f30-f9be-4f63-b4e6-dc0bce31c830: Creating session context with user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:28.044315 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeSequentialSource: Reading 2 marks from part 202506_244_244_0, total 1 rows starting from the beginning of the part 2025.06.18 08:40:28.045337 [ 66777 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.045970 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeSequentialSource: Reading 2 marks from part 202506_245_245_0, total 1 rows starting from the beginning of the part 2025.06.18 08:40:28.047112 [ 66785 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.047684 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeSequentialSource: Reading 2 marks from part 202506_246_246_0, total 4740 rows starting from the beginning of the part 2025.06.18 08:40:28.048414 [ 66786 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.072624 [ 66000 ] {} TCP-Session-6fad4f30-f9be-4f63-b4e6-dc0bce31c830: 6fad4f30-f9be-4f63-b4e6-dc0bce31c830 Creating query context from session context, user_id: 94309d50-4f52-5250-31bd-74fecac179db, parent context user: default 2025.06.18 08:40:28.074515 [ 66000 ] {4040e71b-c12f-4ea8-88b4-d787f0345bc6} executeQuery: (from [::1]:44094) SELECT 'Server successfully started', 'OK', NULL, '' (stage: Complete) 2025.06.18 08:40:28.076356 [ 66000 ] {4040e71b-c12f-4ea8-88b4-d787f0345bc6} Planner: Query to stage Complete 2025.06.18 08:40:28.077146 [ 66000 ] {4040e71b-c12f-4ea8-88b4-d787f0345bc6} Planner: Query from stage FetchColumns to stage Complete 2025.06.18 08:40:28.082400 [ 66000 ] {4040e71b-c12f-4ea8-88b4-d787f0345bc6} executeQuery: Read 1 rows, 1.00 B in 0.008186 sec., 122.15978499877839 rows/sec., 122.16 B/sec. 2025.06.18 08:40:28.082986 [ 66000 ] {4040e71b-c12f-4ea8-88b4-d787f0345bc6} TCPHandler: Processed in 0.011432462 sec. 2025.06.18 08:40:28.087253 [ 66346 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.087732 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.087854 [ 66346 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.088141 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.088176 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.088354 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.090272 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.090381 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.092427 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.092553 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.092860 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:28.093174 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:28.093252 [ 66340 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.093357 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:28.093572 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.093665 [ 66340 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.093878 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.093927 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.094131 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.094298 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:28.094368 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:28.094493 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:28.095143 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:28.095740 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.096003 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.096871 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:28.097515 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.097766 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:28.097837 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.097880 [ 66326 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.098006 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:28.098211 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.098267 [ 66326 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.098323 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:28.098438 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.098479 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.098738 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.098659 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.101633 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:28.101717 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:28.101773 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:28.102389 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.102778 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.103980 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.104231 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.104256 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.104272 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.104328 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:28.104466 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:28.104534 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.104606 [ 66349 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.104805 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.104884 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.105113 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.106970 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.107127 [ 66334 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 210ms, ratio: 0.025641028, points per minute: 73.26008) 2025.06.18 08:40:28.107278 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:28.107275 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.107346 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:28.108188 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:28.108248 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:28.108302 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:28.108593 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:28.109152 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:28.109304 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.110001 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:28.110021 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:28.110109 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:28.110199 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:28.110736 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:28.110796 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:28.110844 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:28.111110 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:28.111161 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:28.111236 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:28.111450 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.112467 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:28.112547 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:28.112597 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:28.113210 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:28.113248 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:28.113290 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:28.113346 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:28.113398 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:28.114846 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.114901 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:28.114959 [ 66334 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:28.116638 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:28.116751 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:28.117003 [ 66334 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 10ms, ratio: 0.025641028, points per minute: 1538.4617) 2025.06.18 08:40:28.117075 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:28.117376 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.117967 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:28.118221 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:28.118947 [ 66334 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:28.120308 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:28.120412 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:28.120495 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:28.120653 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.120759 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.120820 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:28.120855 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:28.120920 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:28.121335 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:28.121402 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:28.121467 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:28.121602 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.121687 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.121745 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:28.121778 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:28.121857 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:28.122324 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:28.122388 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:28.122445 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.122566 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.122645 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.122697 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.122727 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.122784 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.123158 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:28.123223 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:28.123280 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:28.123387 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.123465 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.123534 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:28.123568 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:28.123625 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:28.124062 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:28.124122 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:28.124180 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:28.124291 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.124369 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.124428 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:28.124459 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:28.124515 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:28.125079 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:28.125143 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:28.125202 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.125308 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.125384 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.125437 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.125474 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.125547 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.125989 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:28.126049 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:28.126103 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:28.126201 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.126275 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:28.126323 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:28.126369 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:28.126426 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:28.126606 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:28.127049 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.127056 [ 66000 ] {} TCPHandler: Closing connection (open: true, cancelled: false, eof: true) 2025.06.18 08:40:28.127137 [ 66000 ] {} TCPHandler: Done processing connection. 2025.06.18 08:40:28.127263 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.127320 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:28.128226 [ 66000 ] {} TCP-Session-6fad4f30-f9be-4f63-b4e6-dc0bce31c830: 6fad4f30-f9be-4f63-b4e6-dc0bce31c830 Logout, user_id: 94309d50-4f52-5250-31bd-74fecac179db 2025.06.18 08:40:28.129970 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:28.130769 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.131391 [ 66628 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.131675 [ 66339 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:28.131851 [ 66339 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.132076 [ 66339 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:28.132094 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.132239 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.133563 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.135044 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:28.135697 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:28.135772 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:28.135826 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:28.136369 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:28.136664 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:28.136779 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:28.139351 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:28.139386 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:28.139429 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:28.139476 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:28.139538 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:28.142547 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:28.142642 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:28.142959 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:28.143222 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.143766 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:28.144005 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:28.146052 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:28.146128 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:28.146229 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:28.146419 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.146594 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.146692 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:28.146735 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:28.146792 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:28.147249 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:28.147315 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:28.147398 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:28.147567 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.147658 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.147743 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:28.147782 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:28.147868 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:28.148293 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:28.148371 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:28.148467 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.148653 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.148738 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.148788 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.148828 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.148923 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.149286 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:28.149347 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:28.149402 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:28.149504 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.149599 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.149660 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:28.149690 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:28.149745 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:28.150189 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:28.150252 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:28.150309 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:28.150413 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.150490 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.150557 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:28.150589 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:28.150643 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:28.151123 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:28.151186 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:28.151239 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.151339 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.151421 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.151471 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.151500 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.151567 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.151868 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:28.151928 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:28.151981 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:28.152092 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.152196 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:28.152248 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:28.152278 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:28.152331 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:28.152537 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:28.152964 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.153175 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.153225 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:28.156975 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:28.158196 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.158824 [ 66631 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.159213 [ 66333 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:28.164130 [ 66725 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:28.209100 [ 65995 ] {} BaseDaemon: Received signal 15 2025.06.18 08:40:28.209250 [ 65995 ] {} Application: Received termination signal (Terminated) 2025.06.18 08:40:28.209373 [ 65992 ] {} Application: Received termination signal. 2025.06.18 08:40:28.209893 [ 65992 ] {} Application: Waiting for current connections to close. 2025.06.18 08:40:28.216937 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:28.217111 [ 66725 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:28.259487 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergeTask::MergeProjectionsStage: Merge sorted 23118 rows, containing 34 columns (34 merged, 0 gathered) in 0.224444328 sec., 103001.04353717506 rows/sec., 20.31 MiB/sec. 2025.06.18 08:40:28.261194 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} MergedBlockOutputStream: filled checksums 202506_190_246_14 (state Temporary) 2025.06.18 08:40:28.265295 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Renaming temporary part tmp_merge_202506_190_246_14 to 202506_190_246_14 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.265468 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): preparePartForCommit: inserting 202506_190_246_14 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.265531 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e) (MergerMutator): Merged 6 parts: [202506_190_241_13, 202506_246_246_0] -> 202506_190_246_14 2025.06.18 08:40:28.265625 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_190_241_13 2025.06.18 08:40:28.265674 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_242_242_0 2025.06.18 08:40:28.265713 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_243_243_0 2025.06.18 08:40:28.265752 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_244_244_0 2025.06.18 08:40:28.265788 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_245_245_0 2025.06.18 08:40:28.265841 [ 66619 ] {00215803-513d-428e-8a0c-741b5d959f4e::202506_190_246_14} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e), part: 202506_246_246_0 2025.06.18 08:40:28.267461 [ 66619 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 12.65 MiB. 2025.06.18 08:40:28.320708 [ 66725 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:28.382484 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_226_226_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.382852 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): preparePartForCommit: inserting 202506_226_226_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.384828 [ 66312 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3) (MergerMutator): Selected 6 parts from 202506_1_221_44 to 202506_226_226_0 2025.06.18 08:40:28.385167 [ 66312 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Trying to reserve 1.65 MiB using storage policy from min volume index 0 2025.06.18 08:40:28.385319 [ 66312 ] {} DiskLocal: Reserved 1.65 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:28.386079 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTask::PrepareStage: Merging 6 parts: from 202506_1_221_44 to 202506_226_226_0 into Compact with storage Full 2025.06.18 08:40:28.390874 [ 66321 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.391423 [ 66321 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.391440 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.391746 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.391801 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.391927 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.394663 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.394809 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.396878 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.397064 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.397343 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:28.397566 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:28.397798 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:28.397859 [ 66309 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.398444 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.398479 [ 66309 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.398899 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.398909 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:28.398983 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.399111 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:28.399270 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:28.399351 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.399978 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:28.401216 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.401835 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.401844 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:28.402871 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:28.403076 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:28.403466 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:28.403631 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.403957 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.404238 [ 66307 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.404678 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.404960 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.405053 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.405413 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:28.405616 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:28.405714 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:28.407151 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.409302 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.410020 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.409979 [ 66305 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.410138 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:28.410486 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:28.410596 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.410732 [ 66305 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.410947 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.411102 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:28.411442 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.412925 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.413457 [ 66314 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 295ms, ratio: 0.025641028, points per minute: 52.15124) 2025.06.18 08:40:28.413541 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.413667 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:28.413795 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:28.414616 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:28.414695 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.414721 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:28.414818 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:28.415171 [ 66300 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.415350 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:28.415669 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.415975 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.420777 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:28.420778 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:28.421568 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:28.421745 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:28.421766 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.421807 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:28.421935 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:28.422039 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:28.422129 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:28.422553 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.422890 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:28.423217 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:28.423368 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:28.423936 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:28.424088 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:28.424191 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:28.424854 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:28.425467 [ 66353 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:28.425879 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:28.426058 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:28.427573 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:28.427654 [ 66725 ] {} SystemLog (system.metric_log): Flushed system log up to offset 7 2025.06.18 08:40:28.427656 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:28.427747 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:28.427865 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:28.427981 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:28.428014 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:28.428988 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.429092 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:28.429191 [ 66314 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:28.429895 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:28.430595 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:28.430672 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:28.430712 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:28.431362 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:28.431625 [ 66314 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 18ms, ratio: 0.025641028, points per minute: 854.70087) 2025.06.18 08:40:28.431694 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:28.431870 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:28.432556 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:28.432796 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:28.433140 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:28.433610 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.434498 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:28.434634 [ 66314 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 3ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:28.434899 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:28.435691 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:28.435728 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:28.435774 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:28.435823 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:28.435872 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:28.439371 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:28.439364 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:28.439533 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:28.439666 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:28.439832 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:28.439905 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:28.440085 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.440277 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.440302 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:28.440380 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:28.440439 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:28.440556 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:28.441066 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:28.441195 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:28.441307 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:28.441321 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:28.441403 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:28.441696 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.441966 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.442115 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:28.442197 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:28.442337 [ 66630 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:28.443492 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:28.443659 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:28.443789 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.444030 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.444165 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.444263 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.444346 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.444445 [ 66630 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.445141 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:28.445243 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:28.445332 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:28.445502 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.445727 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.445944 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:28.446050 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:28.446261 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:28.447319 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:28.447470 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:28.447612 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:28.447641 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:28.447786 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:28.447854 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.447914 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:28.448058 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.448170 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.448213 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:28.448292 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:28.448349 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.448426 [ 66630 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:28.448465 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:28.448589 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:28.448827 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:28.449406 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:28.449494 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:28.449543 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:28.449594 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:28.449666 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:28.449746 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.449765 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.449885 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.449968 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:28.449981 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.450011 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:28.450092 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:28.450123 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.450214 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.450263 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.450354 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.450700 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:28.450788 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:28.450861 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.450913 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:28.451005 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.451041 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:28.451115 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.451136 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:28.451191 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.451236 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.451309 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.451315 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.451459 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:28.451567 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:28.451621 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:28.451723 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:28.451798 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:28.451885 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:28.451956 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:28.452003 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:28.452094 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.452198 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.452265 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:28.452303 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:28.452375 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:28.452665 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.453120 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:28.453170 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.453211 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:28.453263 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:28.453291 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:28.453433 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.453589 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.453681 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:28.453739 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:28.453866 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:28.454848 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:28.454965 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:28.455053 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:28.455191 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.455287 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.455362 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:28.455392 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:28.455467 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:28.455875 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:28.455943 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:28.456013 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:28.456142 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.456241 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:28.456294 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:28.456329 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:28.456401 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:28.456583 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:28.456673 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:28.457015 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.457220 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.457268 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:28.458077 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.458802 [ 66630 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.459736 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:28.460462 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.460871 [ 66627 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:28.461218 [ 66291 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:28.461393 [ 66291 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:28.495851 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:28.504086 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeSequentialSource: Reading 3 marks from part 202506_1_221_44, total 1913 rows starting from the beginning of the part 2025.06.18 08:40:28.532201 [ 66777 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.551333 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeSequentialSource: Reading 2 marks from part 202506_222_222_0, total 8 rows starting from the beginning of the part 2025.06.18 08:40:28.579850 [ 66785 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.600155 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeSequentialSource: Reading 2 marks from part 202506_223_223_0, total 4 rows starting from the beginning of the part 2025.06.18 08:40:28.629337 [ 66786 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.651577 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeSequentialSource: Reading 2 marks from part 202506_224_224_0, total 9 rows starting from the beginning of the part 2025.06.18 08:40:28.681268 [ 66777 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.702449 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeSequentialSource: Reading 2 marks from part 202506_225_225_0, total 8 rows starting from the beginning of the part 2025.06.18 08:40:28.731642 [ 66785 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.751508 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeSequentialSource: Reading 2 marks from part 202506_226_226_0, total 7 rows starting from the beginning of the part 2025.06.18 08:40:28.772976 [ 66241 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c) (MergerMutator): Selected 6 parts from 202506_474_484_2 to 202506_489_489_0 2025.06.18 08:40:28.773252 [ 66241 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:28.773348 [ 66241 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:28.774155 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTask::PrepareStage: Merging 6 parts: from 202506_474_484_2 to 202506_489_489_0 into Compact with storage Full 2025.06.18 08:40:28.776349 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:28.776735 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_474_484_2, total 910 rows starting from the beginning of the part 2025.06.18 08:40:28.777499 [ 66786 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.778359 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_485_485_0, total 148 rows starting from the beginning of the part 2025.06.18 08:40:28.779432 [ 66777 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.780078 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_486_486_0, total 64 rows starting from the beginning of the part 2025.06.18 08:40:28.781271 [ 66785 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.782222 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_487_487_0, total 173 rows starting from the beginning of the part 2025.06.18 08:40:28.782678 [ 66786 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.783436 [ 66777 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.784309 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_488_488_0, total 6479 rows starting from the beginning of the part 2025.06.18 08:40:28.785594 [ 66785 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.786385 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeSequentialSource: Reading 2 marks from part 202506_489_489_0, total 284 rows starting from the beginning of the part 2025.06.18 08:40:28.787346 [ 66786 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:28.861653 [ 66665 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Found 1 old parts to remove. Parts: [202506_219_219_0] 2025.06.18 08:40:28.861748 [ 66665 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Removing 1 parts from filesystem (serially): Parts: [202506_219_219_0] 2025.06.18 08:40:28.862768 [ 66665 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): removePartsFinally: removing 202506_219_219_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.862868 [ 66665 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Removing 1 parts from memory: Parts: [202506_219_219_0] 2025.06.18 08:40:28.875660 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergeTask::MergeProjectionsStage: Merge sorted 8058 rows, containing 25 columns (25 merged, 0 gathered) in 0.101933378 sec., 79051.63311668136 rows/sec., 16.59 MiB/sec. 2025.06.18 08:40:28.876802 [ 66663 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Found 2 old parts to remove. Parts: [202506_1_141_37, 202506_145_145_0] 2025.06.18 08:40:28.876906 [ 66663 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Removing 2 parts from filesystem (serially): Parts: [202506_1_141_37, 202506_145_145_0] 2025.06.18 08:40:28.878291 [ 66663 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_1_141_37 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.878346 [ 66663 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): removePartsFinally: removing 202506_145_145_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.878396 [ 66663 ] {} system.opentelemetry_span_log (3772ccdf-fbcf-4ce3-ad0a-515b3f93b227): Removing 2 parts from memory: Parts: [202506_1_141_37, 202506_145_145_0] 2025.06.18 08:40:28.911615 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} MergedBlockOutputStream: filled checksums 202506_474_489_3 (state Temporary) 2025.06.18 08:40:28.914605 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Renaming temporary part tmp_merge_202506_474_489_3 to 202506_474_489_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:28.914798 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): preparePartForCommit: inserting 202506_474_489_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:28.914851 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c) (MergerMutator): Merged 6 parts: [202506_474_484_2, 202506_489_489_0] -> 202506_474_489_3 2025.06.18 08:40:28.914988 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_474_484_2 2025.06.18 08:40:28.915063 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_485_485_0 2025.06.18 08:40:28.915108 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_486_486_0 2025.06.18 08:40:28.915147 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_487_487_0 2025.06.18 08:40:28.915183 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_488_488_0 2025.06.18 08:40:28.915219 [ 66625 ] {12281c43-dcc2-4ef9-a954-ce29c5a4624c::202506_474_489_3} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c), part: 202506_489_489_0 2025.06.18 08:40:28.916878 [ 66625 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 9.88 MiB. 2025.06.18 08:40:28.957573 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Found 1 old parts to remove. Parts: [202506_272_374_23] 2025.06.18 08:40:28.957668 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 1 parts from filesystem (serially): Parts: [202506_272_374_23] 2025.06.18 08:40:28.960730 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): removePartsFinally: removing 202506_272_374_23 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.960802 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Removing 1 parts from memory: Parts: [202506_272_374_23] 2025.06.18 08:40:28.961629 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Unloaded primary key for outdated part 202506_488_488_0 2025.06.18 08:40:28.961693 [ 66665 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Unloaded primary key for outdated part 202506_489_489_0 2025.06.18 08:40:28.997036 [ 66663 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Found 1 old parts to remove. Parts: [202506_186_186_0] 2025.06.18 08:40:28.997123 [ 66663 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Removing 1 parts from filesystem (serially): Parts: [202506_186_186_0] 2025.06.18 08:40:28.997774 [ 66663 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): removePartsFinally: removing 202506_186_186_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:28.997846 [ 66663 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Removing 1 parts from memory: Parts: [202506_186_186_0] 2025.06.18 08:40:29.000269 [ 66775 ] {} AsynchronousMetrics: MemoryTracking: was 1.91 GiB, peak 1.91 GiB, free memory in arenas 0.00 B, will set to 2.06 GiB (RSS), difference: 159.29 MiB 2025.06.18 08:40:29.000435 [ 66775 ] {} MemoryTracker: Current memory usage (total): 2.06 GiB. 2025.06.18 08:40:29.165225 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Found 1 old parts to remove. Parts: [202506_161_161_0] 2025.06.18 08:40:29.165314 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Removing 1 parts from filesystem (serially): Parts: [202506_161_161_0] 2025.06.18 08:40:29.165977 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): removePartsFinally: removing 202506_161_161_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.166041 [ 66662 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Removing 1 parts from memory: Parts: [202506_161_161_0] 2025.06.18 08:40:29.177929 [ 66659 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Found 1 old parts to remove. Parts: [202506_106_106_0] 2025.06.18 08:40:29.178010 [ 66659 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Removing 1 parts from filesystem (serially): Parts: [202506_106_106_0] 2025.06.18 08:40:29.178547 [ 66659 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): removePartsFinally: removing 202506_106_106_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.178594 [ 66659 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Removing 1 parts from memory: Parts: [202506_106_106_0] 2025.06.18 08:40:29.261355 [ 66173 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 1428ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:29.271765 [ 66169 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.272014 [ 66169 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.272036 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.272244 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.272256 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.272426 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.273728 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.273770 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.275056 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.275092 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.275247 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:29.275347 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:29.275409 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:29.275515 [ 66168 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.275793 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.275811 [ 66168 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.275976 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.275974 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:29.276007 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.276082 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:29.276177 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:29.276214 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.276578 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:29.277220 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.277593 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:29.277603 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.278110 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:29.278229 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:29.278373 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.278448 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:29.278781 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.279328 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.279590 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:29.279610 [ 66159 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.279676 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:29.279737 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:29.279829 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.279973 [ 66158 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.280161 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.280202 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.280338 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.281289 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.281468 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.282026 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.282078 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:29.282152 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:29.282581 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:29.282652 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.282992 [ 66157 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.283191 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:29.283249 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.283257 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:29.283358 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:29.283402 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.283811 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:29.283903 [ 66167 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 849ms, ratio: 0.025641028, points per minute: 18.120869) 2025.06.18 08:40:29.284018 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:29.284022 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:29.284065 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:29.284124 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:29.284621 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:29.284672 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:29.284706 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.284714 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:29.285364 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:29.286000 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.286279 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:29.286313 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:29.286286 [ 66154 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.286363 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:29.286317 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:29.286413 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:29.286478 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:29.286592 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.286767 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.286919 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:29.287016 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:29.287242 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:29.287468 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.288255 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:29.288320 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:29.288320 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.288367 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:29.288678 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:29.288772 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:29.288959 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:29.289238 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.289750 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:29.289869 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.290206 [ 66151 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.290473 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.290510 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:29.290588 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.290624 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.290634 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:29.290753 [ 66167 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:29.291734 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.292141 [ 66167 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 8ms, ratio: 0.025641028, points per minute: 1923.077) 2025.06.18 08:40:29.292176 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:29.292247 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:29.292317 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:29.292433 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.292531 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.292584 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:29.292619 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:29.292671 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:29.292860 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:29.293005 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:29.293064 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:29.293118 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:29.293224 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.293313 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.293351 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:29.293361 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:29.293440 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:29.293457 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:29.293495 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:29.293509 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:29.293536 [ 66167 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:29.293909 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:29.293965 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:29.293979 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:29.294016 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.294113 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.294176 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.294183 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:29.294221 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.294249 [ 66659 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Found 1 old parts to remove. Parts: [202506_208_208_0] 2025.06.18 08:40:29.294260 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.294296 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:29.294326 [ 66659 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 1 parts from filesystem (serially): Parts: [202506_208_208_0] 2025.06.18 08:40:29.294360 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.294722 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:29.294776 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:29.294824 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:29.294914 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.294946 [ 66659 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): removePartsFinally: removing 202506_208_208_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.294981 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.294999 [ 66659 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Removing 1 parts from memory: Parts: [202506_208_208_0] 2025.06.18 08:40:29.295033 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:29.295070 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:29.295134 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:29.295632 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:29.295684 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:29.295734 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:29.295829 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.295902 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.295946 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:29.295970 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:29.296018 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:29.296439 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:29.296490 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:29.296546 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.296581 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:29.296617 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:29.296641 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.296678 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:29.296731 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.296739 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:29.296781 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.296797 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:29.296812 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.296887 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.297192 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:29.297244 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:29.297291 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:29.297375 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.297438 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.297479 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:29.297503 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:29.297559 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:29.297699 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:29.298035 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.298210 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.298254 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:29.299648 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:29.299766 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:29.299964 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:29.300203 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.300252 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:29.300627 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:29.300858 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:29.300860 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.301214 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.301463 [ 66144 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.303011 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:29.303096 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:29.303177 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:29.303317 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.303414 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.303475 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:29.303509 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:29.303585 [ 66627 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:29.303973 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:29.304036 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:29.304096 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:29.304211 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.304290 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.304344 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:29.304376 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:29.304441 [ 66627 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:29.304898 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:29.304961 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:29.305015 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.305121 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.305196 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.305247 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.305276 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.305330 [ 66627 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.305718 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:29.305779 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:29.305866 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:29.305973 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.306048 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.306106 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:29.306135 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:29.306190 [ 66627 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:29.306621 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:29.306680 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:29.306736 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:29.306844 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.306931 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.306981 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:29.307009 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:29.307069 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:29.307535 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:29.307616 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:29.307680 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.307794 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.307878 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.307928 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.307955 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.308033 [ 66627 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.308341 [ 66627 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:29.308398 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:29.308451 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:29.308562 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.308636 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66627, kind: Regular, unbound: 0 2025.06.18 08:40:29.308684 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:29.308712 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:29.308765 [ 66627 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:29.308929 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:29.309318 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.309541 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.309606 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:29.311633 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:29.312333 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.312764 [ 66627 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.313158 [ 66143 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.313410 [ 66143 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.438493 [ 66664 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Found 2 old parts to remove. Parts: [202506_1_152_60, 202506_157_157_0] 2025.06.18 08:40:29.438611 [ 66664 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Removing 2 parts from filesystem (serially): Parts: [202506_1_152_60, 202506_157_157_0] 2025.06.18 08:40:29.439750 [ 66664 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_1_152_60 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.439791 [ 66664 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): removePartsFinally: removing 202506_157_157_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.439823 [ 66664 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Removing 2 parts from memory: Parts: [202506_1_152_60, 202506_157_157_0] 2025.06.18 08:40:29.481065 [ 66659 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Found 1 old parts to remove. Parts: [202506_188_188_0] 2025.06.18 08:40:29.481165 [ 66659 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Removing 1 parts from filesystem (serially): Parts: [202506_188_188_0] 2025.06.18 08:40:29.481921 [ 66659 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): removePartsFinally: removing 202506_188_188_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.481983 [ 66659 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Removing 1 parts from memory: Parts: [202506_188_188_0] 2025.06.18 08:40:29.482914 [ 66659 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Unloaded primary key for outdated part 202506_246_246_0 2025.06.18 08:40:29.505766 [ 66524 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.506011 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.506031 [ 66524 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.506173 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.506230 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.506388 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.507736 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.507777 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.508867 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.508924 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.509047 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:29.509151 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:29.509213 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:29.509291 [ 66128 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.509613 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.509621 [ 66128 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.509855 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.509850 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:29.509865 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.509983 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:29.510081 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:29.510101 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.510438 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:29.511392 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.511391 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.511465 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:29.512002 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:29.512097 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:29.512307 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:29.512625 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.513169 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.513285 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.513439 [ 66125 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.513582 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:29.513668 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:29.513691 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.513701 [ 66125 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.513723 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:29.513900 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.513937 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.514044 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.515095 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.515123 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.515931 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.515979 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:29.516070 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:29.516452 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.516531 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:29.516751 [ 66130 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.516989 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.517010 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:29.517110 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:29.517145 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:29.517198 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.517568 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:29.517766 [ 66129 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 224ms, ratio: 0.025641028, points per minute: 68.68132) 2025.06.18 08:40:29.517794 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:29.517888 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:29.517905 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:29.517940 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:29.518437 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:29.518484 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:29.518496 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.518537 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:29.519115 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:29.519634 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.519913 [ 66120 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.520007 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:29.520040 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:29.520046 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:29.520084 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:29.520126 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:29.520142 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.520170 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:29.520378 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.520535 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:29.520639 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:29.520842 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:29.521101 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.521972 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:29.522029 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.522051 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:29.522103 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:29.522255 [ 66661 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Found 1 old parts to remove. Parts: [202506_33_33_0] 2025.06.18 08:40:29.522360 [ 66661 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Removing 1 parts from filesystem (serially): Parts: [202506_33_33_0] 2025.06.18 08:40:29.522412 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:29.522496 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:29.522806 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:29.523043 [ 66661 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): removePartsFinally: removing 202506_33_33_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.523082 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.523097 [ 66661 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Removing 1 parts from memory: Parts: [202506_33_33_0] 2025.06.18 08:40:29.523677 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:29.523771 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.524026 [ 66116 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.524205 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.524315 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.524429 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:29.524486 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.524549 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:29.524602 [ 66129 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:29.525663 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.526161 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:29.526193 [ 66129 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 8ms, ratio: 0.025641028, points per minute: 1923.077) 2025.06.18 08:40:29.526232 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:29.526307 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:29.526433 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.526513 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.526572 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:29.526601 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:29.526648 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:29.526882 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:29.526966 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:29.527021 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:29.527077 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:29.527167 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.527231 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.527273 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:29.527301 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:29.527299 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:29.527349 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:29.527358 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:29.527396 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:29.527531 [ 66129 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:29.527738 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:29.527780 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:29.527795 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:29.527891 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.527978 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.527990 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:29.528048 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.528080 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:29.528096 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.528126 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.528171 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.528482 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:29.528547 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:29.528595 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:29.528682 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.528743 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.528787 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:29.528812 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:29.528856 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:29.529219 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:29.529269 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:29.529315 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:29.529407 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.529469 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.529510 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:29.529546 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:29.529591 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:29.530022 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:29.530074 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:29.530120 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.530202 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.530231 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:29.530257 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:29.530266 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.530303 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:29.530359 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.530380 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:29.530391 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.530450 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.530455 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:29.530764 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:29.530820 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:29.530868 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:29.530956 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.531018 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.531061 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:29.531085 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:29.531131 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:29.531270 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:29.531608 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.531777 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.531824 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:29.532486 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:29.532605 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:29.532882 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:29.533132 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.533634 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:29.533790 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:29.535028 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:29.535541 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:29.535613 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:29.535680 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:29.535645 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.535810 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.535895 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.535944 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:29.535971 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:29.536024 [ 66620 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:29.535991 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.536297 [ 66111 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.536386 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:29.536451 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:29.536503 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:29.536615 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.536689 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.536734 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:29.536760 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:29.536808 [ 66620 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:29.537170 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:29.537222 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:29.537269 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.537355 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.537418 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.537460 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.537483 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.537541 [ 66620 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.537863 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:29.537915 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:29.537966 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:29.538051 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.538114 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.538156 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:29.538180 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:29.538226 [ 66620 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:29.538580 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:29.538629 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:29.538676 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:29.538767 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.538830 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.538872 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:29.538895 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:29.538941 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:29.539316 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:29.539366 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:29.539411 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.539494 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.539574 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.539616 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.539639 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.539681 [ 66620 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.539926 [ 66620 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:29.539974 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:29.540017 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:29.540100 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.540160 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66620, kind: Regular, unbound: 0 2025.06.18 08:40:29.540200 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:29.540223 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:29.540272 [ 66620 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:29.540407 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:29.540726 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.540912 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.540955 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:29.542673 [ 66665 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Found 1 old parts to remove. Parts: [202506_174_174_0] 2025.06.18 08:40:29.542769 [ 66665 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Removing 1 parts from filesystem (serially): Parts: [202506_174_174_0] 2025.06.18 08:40:29.543548 [ 66665 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): removePartsFinally: removing 202506_174_174_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.543615 [ 66665 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Removing 1 parts from memory: Parts: [202506_174_174_0] 2025.06.18 08:40:29.550751 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:29.551513 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.551892 [ 66620 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.552241 [ 66109 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.552437 [ 66109 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.618505 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergeTask::MergeProjectionsStage: Merge sorted 1949 rows, containing 1015 columns (1015 merged, 0 gathered) in 1.232732172 sec., 1581.0409140518482 rows/sec., 2.94 MiB/sec. 2025.06.18 08:40:29.669809 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} MergedBlockOutputStream: filled checksums 202506_1_226_45 (state Temporary) 2025.06.18 08:40:29.764870 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Renaming temporary part tmp_merge_202506_1_226_45 to 202506_1_226_45 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.765269 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): preparePartForCommit: inserting 202506_1_226_45 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.765337 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3) (MergerMutator): Merged 6 parts: [202506_1_221_44, 202506_226_226_0] -> 202506_1_226_45 2025.06.18 08:40:29.765454 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_1_221_44 2025.06.18 08:40:29.765509 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_222_222_0 2025.06.18 08:40:29.765568 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_223_223_0 2025.06.18 08:40:29.765610 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_224_224_0 2025.06.18 08:40:29.765659 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_225_225_0 2025.06.18 08:40:29.765698 [ 66618 ] {3dfb1247-1a39-4b49-ad7d-daa7a55182d3::202506_1_226_45} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3), part: 202506_226_226_0 2025.06.18 08:40:29.778220 [ 66618 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 39.32 MiB. 2025.06.18 08:40:29.808163 [ 65992 ] {} Application: Closed all listening sockets. 2025.06.18 08:40:29.808269 [ 65992 ] {} Application: Closed connections. 2025.06.18 08:40:29.808352 [ 65992 ] {} Application: Stopping AsyncLoader. 2025.06.18 08:40:29.808557 [ 65992 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.06.18 08:40:29.813972 [ 65992 ] {} Application: Shutting down storages. 2025.06.18 08:40:29.814055 [ 65992 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.06.18 08:40:29.815359 [ 65992 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.06.18 08:40:29.815414 [ 65992 ] {} Context: Shutting down dictionaries loader 2025.06.18 08:40:29.815615 [ 65992 ] {} Context: Shutting down UDFs loader 2025.06.18 08:40:29.815727 [ 65992 ] {} Context: Shutting down another UDFs storage 2025.06.18 08:40:29.815762 [ 65992 ] {} Context: Shutting down named sessions 2025.06.18 08:40:29.815815 [ 65992 ] {} Context: Shutting down system logs 2025.06.18 08:40:29.815934 [ 66727 ] {} SystemLog (system.query_log): Flushing system log, 4 entries to flush up to offset 10 2025.06.18 08:40:29.815973 [ 66748 ] {} SystemLog (system.error_log): Flushing system log, 3 entries to flush up to offset 14 2025.06.18 08:40:29.815958 [ 66739 ] {} SystemLog (system.part_log): Flushing system log, 20 entries to flush up to offset 58 2025.06.18 08:40:29.816032 [ 66689 ] {} SystemLog (system.processors_profile_log): Flushing system log, 12 entries to flush up to offset 46 2025.06.18 08:40:29.815988 [ 66731 ] {} SystemLog (system.asynchronous_metric_log): Flushing system log, 1233 entries to flush up to offset 3856 2025.06.18 08:40:29.815969 [ 66694 ] {} SystemLog (system.text_log): Flushing system log, 829 entries to flush up to offset 7592 2025.06.18 08:40:29.816024 [ 65992 ] {} SystemLogQueue (system.query_log): Requested flush up to offset 10 2025.06.18 08:40:29.816116 [ 66725 ] {} SystemLog (system.metric_log): Flushing system log, 3 entries to flush up to offset 10 2025.06.18 08:40:29.816046 [ 66717 ] {} SystemLog (system.transactions_info_log): Flushing system log, 46 entries to flush up to offset 62 2025.06.18 08:40:29.816040 [ 66716 ] {} SystemLog (system.zookeeper_log): Flushing system log, 1037 entries to flush up to offset 5777 2025.06.18 08:40:29.816167 [ 66682 ] {} SystemLog (system.session_log): Flushing system log, 10 entries to flush up to offset 10 2025.06.18 08:40:29.819244 [ 66748 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.819751 [ 66689 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.820372 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.820478 [ 66748 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.821138 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.821243 [ 66689 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.821338 [ 66717 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.821428 [ 66739 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.822829 [ 66748 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.823262 [ 66739 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.823289 [ 66682 ] {} SystemLog (system.session_log): Will use existing table system.session_log for SessionLog 2025.06.18 08:40:29.823367 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.823448 [ 66739 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.823606 [ 66717 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.824312 [ 66689 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.825209 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_241_241_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.825427 [ 66748 ] {} system.error_log (3236e22a-f5c0-4cf1-9312-43eafe1de72e): preparePartForCommit: inserting 202506_241_241_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.827609 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_164_164_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.827794 [ 66689 ] {} system.processors_profile_log (c9cd645f-6d54-4617-ad56-fb3f67a060f8): preparePartForCommit: inserting 202506_164_164_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.828281 [ 66748 ] {} SystemLog (system.error_log): Flushed system log up to offset 14 2025.06.18 08:40:29.828590 [ 66717 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.828889 [ 66739 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.829638 [ 66689 ] {} SystemLog (system.processors_profile_log): Flushed system log up to offset 46 2025.06.18 08:40:29.831615 [ 66739 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_110_110_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.831757 [ 66739 ] {} system.part_log (630dea68-bd65-4118-a62e-459157383449): preparePartForCommit: inserting 202506_110_110_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.832907 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_271_271_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.833153 [ 66717 ] {} system.transactions_info_log (2f108207-c586-44f8-8201-2f3f8b2a61e7): preparePartForCommit: inserting 202506_271_271_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.833242 [ 66727 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.833452 [ 66682 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.833616 [ 66739 ] {} SystemLog (system.part_log): Flushed system log up to offset 58 2025.06.18 08:40:29.834027 [ 66731 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.835755 [ 66717 ] {} SystemLog (system.transactions_info_log): Flushed system log up to offset 62 2025.06.18 08:40:29.836291 [ 66682 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.836496 [ 66682 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.837656 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.837780 [ 66727 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.838427 [ 66716 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.840078 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.840187 [ 66731 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.841028 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.841170 [ 66716 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.842699 [ 66682 ] {} MergedBlockOutputStream: filled checksums 202506_1_1_0 (state Temporary) 2025.06.18 08:40:29.847762 [ 66682 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Renaming temporary part tmp_insert_202506_1_1_0 to 202506_39_39_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.848042 [ 66682 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): preparePartForCommit: inserting 202506_39_39_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.848560 [ 66082 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665) (MergerMutator): Selected 5 parts from 202506_1_34_7 to 202506_38_38_0 2025.06.18 08:40:29.849051 [ 66082 ] {} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.849156 [ 66082 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.850208 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTask::PrepareStage: Merging 5 parts: from 202506_1_34_7 to 202506_38_38_0 into Compact with storage Full 2025.06.18 08:40:29.850477 [ 66694 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.851612 [ 66682 ] {} SystemLog (system.session_log): Flushed system log up to offset 10 2025.06.18 08:40:29.853427 [ 66731 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.853596 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:29.853734 [ 66694 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:29.854654 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTask::PrepareStage: Selected MergeAlgorithm: Horizontal 2025.06.18 08:40:29.855164 [ 66716 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.855365 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeSequentialSource: Reading 3 marks from part 202506_1_34_7, total 15219 rows starting from the beginning of the part 2025.06.18 08:40:29.856208 [ 66727 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:29.856783 [ 66777 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:29.856826 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_285_285_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.857094 [ 66731 ] {} system.asynchronous_metric_log (9c53901b-1a6c-463c-9e1d-3c7ced8a33a1): preparePartForCommit: inserting 202506_285_285_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.857948 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeSequentialSource: Reading 2 marks from part 202506_35_35_0, total 236 rows starting from the beginning of the part 2025.06.18 08:40:29.859447 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_247_247_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.859505 [ 66785 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:29.859681 [ 66716 ] {} system.zookeeper_log (00215803-513d-428e-8a0c-741b5d959f4e): preparePartForCommit: inserting 202506_247_247_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.860442 [ 66731 ] {} SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 3856 2025.06.18 08:40:29.860482 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeSequentialSource: Reading 2 marks from part 202506_36_36_0, total 238 rows starting from the beginning of the part 2025.06.18 08:40:29.862000 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_169_169_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.862007 [ 66786 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:29.862244 [ 66727 ] {} system.query_log (6f0c91ed-346a-41ef-9c1f-0d43bddfe6ae): preparePartForCommit: inserting 202506_169_169_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.862838 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeSequentialSource: Reading 2 marks from part 202506_37_37_0, total 235 rows starting from the beginning of the part 2025.06.18 08:40:29.862884 [ 66716 ] {} SystemLog (system.zookeeper_log): Flushed system log up to offset 5777 2025.06.18 08:40:29.863955 [ 66777 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:29.864744 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeSequentialSource: Reading 2 marks from part 202506_38_38_0, total 30 rows starting from the beginning of the part 2025.06.18 08:40:29.866077 [ 66785 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTreeMarksLoader: Loading marks from path data.cmrk3 2025.06.18 08:40:29.866933 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} SortDescription: Compile sort description (type: Date, direction: 1, nulls_direction: 1), (type: DateTime, direction: 1, nulls_direction: 1) 2025.06.18 08:40:29.867297 [ 66727 ] {} SystemLog (system.query_log): Flushed system log up to offset 10 2025.06.18 08:40:29.867336 [ 65992 ] {} SystemLogQueue (system.query_thread_log): Requested flush up to offset 0 2025.06.18 08:40:29.867636 [ 65992 ] {} SystemLogQueue (system.part_log): Requested flush up to offset 58 2025.06.18 08:40:29.867739 [ 65992 ] {} SystemLogQueue (system.trace_log): Requested flush up to offset 0 2025.06.18 08:40:29.867838 [ 65992 ] {} SystemLogQueue (system.crash_log): Requested flush up to offset 0 2025.06.18 08:40:29.867946 [ 65992 ] {} SystemLogQueue (system.text_log): Requested flush up to offset 7592 2025.06.18 08:40:29.871733 [ 66694 ] {} MergedBlockOutputStream: filled checksums 202506_3_3_0 (state Temporary) 2025.06.18 08:40:29.875045 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): Renaming temporary part tmp_insert_202506_3_3_0 to 202506_490_490_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.875249 [ 66694 ] {} system.text_log (12281c43-dcc2-4ef9-a954-ce29c5a4624c): preparePartForCommit: inserting 202506_490_490_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.877195 [ 66694 ] {} SystemLog (system.text_log): Flushed system log up to offset 7592 2025.06.18 08:40:29.877231 [ 65992 ] {} SystemLogQueue (system.metric_log): Requested flush up to offset 10 2025.06.18 08:40:29.930812 [ 66205 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.931151 [ 66205 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.931229 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.931371 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.931459 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.931619 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.933622 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.933704 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.935051 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.935304 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:29.935500 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:29.935552 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.935593 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:29.935765 [ 66068 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.936111 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.936192 [ 66068 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.936347 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:29.936412 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.936443 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:29.936466 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.936539 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:29.936743 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.936924 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:29.937958 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:29.938019 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.938347 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.938380 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:29.938475 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:29.938661 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:29.938928 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.939582 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.939804 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:29.939873 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:29.939923 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:29.939931 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.939931 [ 66057 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.940273 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:29.940279 [ 66057 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.940536 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.940544 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.940723 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.942152 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.942201 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:29.942261 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:29.942301 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.942335 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.943607 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:29.943618 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.943948 [ 66055 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.944141 [ 66056 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 416ms, ratio: 0.025641028, points per minute: 36.98225) 2025.06.18 08:40:29.944211 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:29.944244 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.944257 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:29.944288 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:29.944342 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:29.944373 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:29.944434 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.944881 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:29.944943 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:29.944987 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:29.945004 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:29.945208 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:29.945324 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:29.945457 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:29.945979 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.946263 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:29.946966 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:29.947058 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:29.947309 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:29.947679 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.948300 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:29.948546 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:29.948652 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:29.948724 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:29.949052 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:29.949105 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:29.949164 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:29.949221 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:29.949294 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:29.951437 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:29.951507 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:29.951595 [ 66056 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:29.951975 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:29.952105 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:29.952374 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:29.952707 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.953233 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:29.953496 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:29.954504 [ 66056 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 11ms, ratio: 0.025641028, points per minute: 1398.6014) 2025.06.18 08:40:29.955947 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:29.956040 [ 66056 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 1ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:29.956048 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:29.956192 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:29.956360 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.956476 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.956561 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:29.956605 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:29.956674 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:29.957139 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:29.957219 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:29.957292 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:29.957431 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.957538 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.957602 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:29.957641 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:29.957711 [ 66625 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:29.958231 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:29.958309 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:29.958375 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.958500 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.958604 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.958664 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.958702 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.958771 [ 66625 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.959183 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:29.959250 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:29.959314 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:29.959438 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.959539 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.959600 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:29.959637 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:29.959704 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:29.960195 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:29.960266 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:29.960331 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:29.960462 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.960571 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.960651 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:29.960693 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:29.960762 [ 66625 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:29.961416 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:29.961497 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:29.961581 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.961714 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.961829 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.961897 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.961937 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.962004 [ 66625 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.962380 [ 66625 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:29.962456 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:29.962536 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:29.962654 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.962737 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66625, kind: Regular, unbound: 0 2025.06.18 08:40:29.962788 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:29.962827 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:29.962907 [ 66625 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:29.963106 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:29.963559 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:29.963808 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:29.963870 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:29.966473 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:29.967269 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.967739 [ 66625 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:29.968067 [ 66054 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.968296 [ 66054 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:29.968502 [ 66054 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:29.968634 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:29.968955 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:29.970545 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:29.972056 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:29.972780 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:29.972947 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:29.973036 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:29.973786 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:29.974068 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:29.974175 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:29.976376 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:29.976499 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:29.976603 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:29.976746 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:29.976857 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:29.981007 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:29.981218 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:29.981668 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:29.982108 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:29.982883 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:29.983295 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:29.987910 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:29.988073 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:29.988234 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:29.988579 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.988822 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.988962 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:29.989042 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:29.989214 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:29.990225 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:29.990395 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:29.990503 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:29.990761 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.991015 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.991170 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:29.991276 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:29.991462 [ 66632 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:29.992881 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:29.992991 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:29.993087 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.993270 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.993402 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.993567 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.993647 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.993793 [ 66632 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.994601 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:29.994708 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:29.994806 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:29.994984 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.995115 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.995235 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:29.995303 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:29.995496 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:29.995511 [ 66725 ] {} InterpreterInsertQuery: Pipeline could use up to 0 thread 2025.06.18 08:40:29.996356 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:29.996469 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:29.996605 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:29.996802 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.996950 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.997039 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:29.997088 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:29.997183 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:29.998435 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:29.998569 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:29.998667 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:29.998840 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.998971 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:29.999057 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:29.999106 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:29.999199 [ 66632 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:29.999732 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:29.999833 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:29.999934 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:30.000101 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.000227 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.000310 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:30.000358 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:30.000448 [ 66632 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:30.000825 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:30.001471 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.001900 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.001991 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:30.004769 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:30.005996 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.007203 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.007657 [ 66041 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:30.046231 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Trying to reserve 1.00 MiB using storage policy from min volume index 0 2025.06.18 08:40:30.046347 [ 66725 ] {} DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 303.62 GiB. 2025.06.18 08:40:30.144684 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergeTask::MergeProjectionsStage: Merge sorted 15958 rows, containing 23 columns (23 merged, 0 gathered) in 0.295133024 sec., 54070.53329281104 rows/sec., 18.99 MiB/sec. 2025.06.18 08:40:30.179715 [ 66725 ] {} MergedBlockOutputStream: filled checksums 202506_2_2_0 (state Temporary) 2025.06.18 08:40:30.187877 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} MergedBlockOutputStream: filled checksums 202506_1_38_8 (state Temporary) 2025.06.18 08:40:30.191238 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): Renaming temporary part tmp_merge_202506_1_38_8 to 202506_1_38_8 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.191401 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665): preparePartForCommit: inserting 202506_1_38_8 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.191448 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665) (MergerMutator): Merged 5 parts: [202506_1_34_7, 202506_38_38_0] -> 202506_1_38_8 2025.06.18 08:40:30.191557 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_1_34_7 2025.06.18 08:40:30.191608 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_35_35_0 2025.06.18 08:40:30.191649 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_36_36_0 2025.06.18 08:40:30.191687 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_37_37_0 2025.06.18 08:40:30.191727 [ 66626 ] {58b4b289-4d41-4e80-8b6d-0e5198830665::202506_1_38_8} VersionMetadata: Trying to lock removal_tid by (1, 1, 00000000-0000-0000-0000-000000000000), table: system.session_log (58b4b289-4d41-4e80-8b6d-0e5198830665), part: 202506_38_38_0 2025.06.18 08:40:30.193222 [ 66626 ] {} MemoryTracker: Peak memory usage background process to apply mutate/merge in table: 13.36 MiB. 2025.06.18 08:40:30.252947 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Renaming temporary part tmp_insert_202506_2_2_0 to 202506_227_227_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.253307 [ 66725 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): preparePartForCommit: inserting 202506_227_227_0 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.291100 [ 66725 ] {} SystemLog (system.metric_log): Flushed system log up to offset 10 2025.06.18 08:40:30.291241 [ 65992 ] {} SystemLogQueue (system.error_log): Requested flush up to offset 14 2025.06.18 08:40:30.291401 [ 65992 ] {} SystemLogQueue (system.filesystem_cache_log): Requested flush up to offset 0 2025.06.18 08:40:30.291503 [ 65992 ] {} SystemLogQueue (system.s3queue_log): Requested flush up to offset 0 2025.06.18 08:40:30.291620 [ 65992 ] {} SystemLogQueue (system.asynchronous_metric_log): Requested flush up to offset 3856 2025.06.18 08:40:30.291741 [ 65992 ] {} SystemLogQueue (system.opentelemetry_span_log): Requested flush up to offset 5 2025.06.18 08:40:30.291819 [ 65992 ] {} SystemLogQueue (system.query_views_log): Requested flush up to offset 0 2025.06.18 08:40:30.291894 [ 65992 ] {} SystemLogQueue (system.zookeeper_log): Requested flush up to offset 5777 2025.06.18 08:40:30.291971 [ 65992 ] {} SystemLogQueue (system.session_log): Requested flush up to offset 10 2025.06.18 08:40:30.292041 [ 65992 ] {} SystemLogQueue (system.transactions_info_log): Requested flush up to offset 62 2025.06.18 08:40:30.292153 [ 65992 ] {} SystemLogQueue (system.processors_profile_log): Requested flush up to offset 46 2025.06.18 08:40:30.292231 [ 65992 ] {} SystemLogQueue (system.asynchronous_insert_log): Requested flush up to offset 0 2025.06.18 08:40:30.292306 [ 65992 ] {} SystemLogQueue (system.backup_log): Requested flush up to offset 0 2025.06.18 08:40:30.292381 [ 65992 ] {} SystemLogQueue (system.blob_storage_log): Requested flush up to offset 0 2025.06.18 08:40:30.292595 [ 66727 ] {} SystemLog (system.query_log): Terminating 2025.06.18 08:40:30.293353 [ 66749 ] {} SystemLog (system.query_thread_log): Terminating 2025.06.18 08:40:30.294064 [ 66739 ] {} SystemLog (system.part_log): Terminating 2025.06.18 08:40:30.294884 [ 66726 ] {} SystemLog (system.trace_log): Terminating 2025.06.18 08:40:30.295583 [ 66740 ] {} SystemLog (system.crash_log): Terminating 2025.06.18 08:40:30.296147 [ 66694 ] {} SystemLog (system.text_log): Terminating 2025.06.18 08:40:30.330261 [ 66469 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.330579 [ 66469 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.330575 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:30.330889 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.330948 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.331179 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.332628 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.332692 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.334379 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.334560 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.334738 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:30.334878 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:30.334937 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:30.335028 [ 66502 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.335615 [ 66502 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.335659 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:30.335868 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:30.335951 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:30.335956 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.335956 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.336042 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:30.336322 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.336504 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:30.337774 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:30.338005 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.338049 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.338400 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:30.338536 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:30.338845 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:30.339305 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.340422 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:30.340493 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:30.340572 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:30.342420 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.342455 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.342921 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:30.342986 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:30.343058 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:30.343214 [ 66411 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.343621 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:30.343631 [ 66411 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.343991 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.344050 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.344286 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.345306 [ 66413 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 389ms, ratio: 0.025641028, points per minute: 39.54914) 2025.06.18 08:40:30.345431 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:30.345475 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:30.345775 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.345893 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.346023 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:30.346077 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:30.346119 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:30.346371 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:30.347420 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:30.347468 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:30.347467 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.348070 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:30.348173 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:30.348226 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:30.348328 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:30.348402 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:30.348450 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:30.348829 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.349177 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:30.349653 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:30.349791 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:30.350020 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:30.350103 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:30.350154 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:30.353227 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:30.353301 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:30.353378 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:30.353467 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:30.353549 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:30.353576 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:30.353669 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:30.353760 [ 66413 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:30.355819 [ 66413 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 11ms, ratio: 0.025641028, points per minute: 1398.6014) 2025.06.18 08:40:30.357416 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:30.357627 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:30.357866 [ 66413 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:30.357997 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:30.358452 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.359313 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:30.359687 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:30.363168 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:30.363311 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:30.363444 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:30.363694 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.363863 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.363965 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:30.364022 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:30.364127 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:30.364826 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:30.364939 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:30.365044 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:30.365242 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.365380 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.365472 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:30.365557 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:30.365662 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:30.366483 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:30.366641 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:30.366742 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.366927 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.367060 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.367149 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.367199 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.367295 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.367943 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:30.368049 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:30.368143 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:30.368316 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.368448 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.368572 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:30.368626 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:30.368723 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:30.369623 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:30.369739 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:30.369876 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:30.370093 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.370232 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.370323 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:30.370374 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:30.370471 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:30.371251 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:30.371360 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:30.371455 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.371653 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.371797 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.371885 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.371934 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.372027 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.372563 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:30.372683 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:30.372803 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:30.373085 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.373245 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:30.373340 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:30.373391 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:30.373483 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:30.373794 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:30.374426 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.374837 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.374929 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:30.377940 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:30.379139 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.379984 [ 66628 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.380405 [ 66407 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.380722 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.380753 [ 66407 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:30.380930 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.382309 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.383473 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:30.383993 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:30.384049 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:30.384092 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:30.384656 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:30.384978 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:30.385109 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:30.388792 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:30.388811 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:30.388899 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:30.388954 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:30.389003 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:30.391857 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:30.391963 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:30.392253 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:30.392701 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.393401 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:30.393629 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:30.396094 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:30.396203 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:30.396310 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:30.396494 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.396637 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.396719 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:30.396762 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:30.396845 [ 66630 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:30.397387 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:30.397452 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:30.397534 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:30.397661 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.397743 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.397797 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:30.397857 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:30.397922 [ 66630 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:30.398374 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:30.398437 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:30.398493 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.398617 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.398695 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.398746 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.398775 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.398832 [ 66630 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.399196 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:30.399257 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:30.399316 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:30.399453 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.399574 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.399656 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:30.399697 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:30.399771 [ 66630 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:30.400339 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:30.400417 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:30.400490 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:30.400654 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.400757 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.400824 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:30.400863 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:30.400936 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:30.401458 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:30.401531 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:30.401588 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.401690 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.401772 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.401848 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.401881 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.401936 [ 66630 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.402240 [ 66630 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:30.402299 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:30.402364 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:30.402495 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.402615 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66630, kind: Regular, unbound: 0 2025.06.18 08:40:30.402681 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:30.402718 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:30.402787 [ 66630 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:30.403005 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:30.403458 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.403753 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.403823 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:30.406763 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:30.407454 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.407874 [ 66630 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.408152 [ 66519 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:30.408292 [ 66519 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:30.705242 [ 66725 ] {} SystemLog (system.metric_log): Terminating 2025.06.18 08:40:30.732901 [ 66391 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.733333 [ 66391 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.733361 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:30.733655 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.733763 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.734144 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.737549 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.737657 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.740673 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.740779 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.741078 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:30.741267 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:30.741362 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:30.741544 [ 66406 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.742220 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:30.742255 [ 66406 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.742557 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.742609 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:30.742722 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.742750 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:30.742957 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:30.743068 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.743559 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:30.745014 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.745326 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:30.745449 [ 66621 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.746310 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:30.746506 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:30.746927 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:30.747242 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.747369 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.747762 [ 66409 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.748299 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:30.748633 [ 66621 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.748649 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.749147 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:30.749289 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:30.749196 [ 66536 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.749380 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:30.749804 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.750081 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.751003 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.752376 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.753054 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:30.753137 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:30.753199 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:30.753248 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:30.754198 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:30.754323 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:30.754340 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.754406 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:30.754749 [ 66511 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.755186 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.755203 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:30.755459 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.755635 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:30.755779 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:30.756080 [ 66444 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 398ms, ratio: 0.025641028, points per minute: 38.654816) 2025.06.18 08:40:30.756272 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:30.756343 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:30.757128 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:30.757207 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:30.757270 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:30.757750 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.757893 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:30.759366 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:30.759445 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:30.759446 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:30.759605 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:30.759702 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:30.759813 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:30.760184 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:30.760281 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:30.760430 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:30.760673 [ 66384 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:30.760797 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:30.761013 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:30.761206 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.761251 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:30.762739 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:30.762865 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:30.762945 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:30.763550 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:30.764080 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:30.764269 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:30.764731 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:30.765204 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.766684 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:30.766777 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:30.766876 [ 66444 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:30.770861 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:30.771255 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:30.771604 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:30.772240 [ 66472 ] {} test_1.rmt2 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 1000ms (points: 0, interval: 1511ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:30.772446 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:30.772572 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:30.772651 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:30.772841 [ 66444 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 17ms, ratio: 0.025641028, points per minute: 904.9774) 2025.06.18 08:40:30.773325 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:30.773678 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:30.773849 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:30.775089 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:30.775239 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:30.775378 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:30.775391 [ 66444 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:30.775634 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.775809 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.775916 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:30.775974 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:30.776081 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:30.776785 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:30.776899 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:30.777009 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:30.777215 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.777294 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:30.777363 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.777363 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:30.777475 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:30.777485 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:30.777563 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:30.777636 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:30.777677 [ 66632 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:30.777736 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:30.778629 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:30.778751 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:30.778852 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.779039 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.779174 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.779264 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.779315 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.779410 [ 66632 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.780073 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:30.780180 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:30.780290 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:30.780487 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.780642 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.780731 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:30.780780 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:30.780874 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:30.781621 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:30.781728 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:30.781859 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:30.782061 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.782127 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:30.782197 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.782295 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:30.782321 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:30.782352 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:30.782469 [ 66632 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:30.782838 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:30.783313 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:30.783358 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:30.783426 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:30.783548 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.783727 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.783857 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.783943 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.783992 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.784084 [ 66632 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.784387 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:30.784647 [ 66632 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:30.784760 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:30.784753 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:30.784875 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:30.785056 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.785198 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66632, kind: Regular, unbound: 0 2025.06.18 08:40:30.785287 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:30.785336 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:30.785430 [ 66632 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:30.785740 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:30.786412 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.786796 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.786886 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:30.788487 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:30.788656 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:30.788792 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:30.789024 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.789191 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.789304 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:30.789363 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:30.789470 [ 66629 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:30.790262 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:30.790379 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:30.790485 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:30.790708 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.790850 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.790968 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:30.791021 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:30.791122 [ 66629 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:30.791186 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:30.791918 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:30.792038 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:30.792134 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.792315 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.792452 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.792431 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.792585 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.792658 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.792758 [ 66629 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.793156 [ 66632 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.793405 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:30.793545 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:30.793652 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:30.793636 [ 66454 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:30.793910 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.794057 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.794150 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:30.794202 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:30.794300 [ 66629 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:30.795179 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:30.795287 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:30.795385 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:30.795639 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.795774 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.795877 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:30.795929 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:30.796026 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:30.796818 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:30.796927 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:30.797022 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:30.797195 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.797324 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.797412 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:30.797462 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:30.797576 [ 66629 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:30.798251 [ 66629 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:30.798361 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:30.798452 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:30.798667 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.798809 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66629, kind: Regular, unbound: 0 2025.06.18 08:40:30.798899 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:30.798949 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:30.799040 [ 66629 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:30.799325 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:30.799950 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:30.800308 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:30.800399 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:30.804458 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:30.805704 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.806483 [ 66629 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:30.806977 [ 66428 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:30.807204 [ 66428 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:31.027851 [ 66658 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Found 1 old parts to remove. Parts: [202506_175_175_0] 2025.06.18 08:40:31.027988 [ 66658 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Removing 1 parts from filesystem (serially): Parts: [202506_175_175_0] 2025.06.18 08:40:31.029034 [ 66658 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): removePartsFinally: removing 202506_175_175_0 (state Deleting) from data_parts_indexes 2025.06.18 08:40:31.029126 [ 66658 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Removing 1 parts from memory: Parts: [202506_175_175_0] 2025.06.18 08:40:31.040925 [ 66449 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.041536 [ 66449 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.041587 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.042849 [ 66658 ] {} system.metric_log (3dfb1247-1a39-4b49-ad7d-daa7a55182d3): Unloaded primary key for outdated part 202506_226_226_0 2025.06.18 08:40:31.043454 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.043537 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.043862 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.046655 [ 66626 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.046716 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.048837 [ 66626 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.048996 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.049260 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:31.049454 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:31.049572 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:31.049767 [ 66453 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.050275 [ 66453 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.050300 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.050559 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.050602 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.050706 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:31.050861 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.050866 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:31.051048 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:31.051646 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:31.052668 [ 66625 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.052960 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.053399 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:31.054385 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:31.054646 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:31.054666 [ 66625 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.055118 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:31.055109 [ 66385 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.055459 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.055589 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.055593 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.055922 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.057237 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:31.057356 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:31.057440 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:31.057987 [ 66624 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.060018 [ 66624 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.060560 [ 66521 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.060942 [ 66521 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.060950 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.061139 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:31.061221 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.061248 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:31.061345 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.061445 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:31.061640 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.063322 [ 66633 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.063710 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.064283 [ 66440 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 289ms, ratio: 0.025641028, points per minute: 53.233967) 2025.06.18 08:40:31.064474 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:31.064566 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:31.065362 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:31.065439 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:31.065511 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:31.065503 [ 66633 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.065796 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:31.065973 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:31.066010 [ 66377 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.066357 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.066638 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.066786 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:31.066892 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:31.066967 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:31.067686 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:31.067758 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:31.068119 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:31.068256 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:31.068432 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:31.068604 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:31.068846 [ 66630 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.068948 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:31.069351 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.070908 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:31.071031 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:31.071107 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:31.071608 [ 66630 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.071787 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:31.071880 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:31.071969 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:31.072081 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:31.072183 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:31.072260 [ 66379 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.072827 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.073059 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.074913 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:31.074998 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:31.075074 [ 66440 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:31.075173 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.076390 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:31.076602 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:31.077006 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:31.077236 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_2_2_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:31.077477 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.078537 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:31.078615 [ 66440 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 15ms, ratio: 0.025641028, points per minute: 1025.6411) 2025.06.18 08:40:31.078752 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:31.078862 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:31.078884 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:31.078941 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:31.079692 [ 66838 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [::ffff:172.17.0.2]:41748, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:31.080030 [ 66838 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_2_2_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:31.080163 [ 66838 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_2_2_0_3 2025.06.18 08:40:31.081228 [ 66440 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 2ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:31.082413 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgl/bbbleegpllpnthgxcmhdileknvnuf (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/columns.txt) 2025.06.18 08:40:31.082579 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Reset state for seek to position 0 2025.06.18 08:40:31.082715 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:31.082967 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.083129 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: 5355cd98919a2b306d501e636785db15, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.083235 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:31.083293 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:31.083399 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5355cd98919a2b306d501e636785db15): Key: 5355cd98919a2b306d501e636785db15. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:31.083667 [ 66838 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:31.083753 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:31.083836 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:31.083935 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:31.084026 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:31.084146 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eqm/fteboibtqjfvakmesclrhcvkgxtnj (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/serialization.json) 2025.06.18 08:40:31.084273 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Reset state for seek to position 0 2025.06.18 08:40:31.084385 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:31.084659 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.084808 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: fbfa7751fe0b3c92650a6e326bf525b6, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.084904 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:31.084973 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:31.085074 [ 66628 ] {} CachedOnDiskReadBufferFromFile(fbfa7751fe0b3c92650a6e326bf525b6): Key: fbfa7751fe0b3c92650a6e326bf525b6. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:31.085906 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kgz/gakoqakveggqjvdvwyryunqdtnjjd (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/metadata_version.txt) 2025.06.18 08:40:31.086022 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Reset state for seek to position 0 2025.06.18 08:40:31.086120 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:31.086308 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.086453 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 5cd413ef3fae0cd351cae018c6e7feb5, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.086565 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:31.086619 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:31.086715 [ 66628 ] {} CachedOnDiskReadBufferFromFile(5cd413ef3fae0cd351cae018c6e7feb5): Key: 5cd413ef3fae0cd351cae018c6e7feb5. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:31.087349 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt) 2025.06.18 08:40:31.087455 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Reset state for seek to position 0 2025.06.18 08:40:31.087580 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:31.087787 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.087922 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0e1651943582be3521d041ee1c35f583, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.088026 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:31.088077 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:31.088175 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0e1651943582be3521d041ee1c35f583): Key: 0e1651943582be3521d041ee1c35f583. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:31.088341 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk. 2025.06.18 08:40:31.088568 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 2025.06.18 08:40:31.088942 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/cxu/hxgwxfpuhikrmppkzsyadcoyzofdv (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/n.cmrk2) 2025.06.18 08:40:31.089006 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:31.089054 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Reset state for seek to position 0 2025.06.18 08:40:31.089155 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:31.089352 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.089418 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.089489 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 153f717bd4cc249a954deb95500a2a55, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.089609 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:31.089663 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:31.089760 [ 66628 ] {} CachedOnDiskReadBufferFromFile(153f717bd4cc249a954deb95500a2a55): Key: 153f717bd4cc249a954deb95500a2a55. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:31.090447 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 created 2025.06.18 08:40:31.090654 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ehb/pweujyeafjhbxskwjwkmgfpywbhjh (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/count.txt) 2025.06.18 08:40:31.090768 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Reset state for seek to position 0 2025.06.18 08:40:31.090829 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:31.090868 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:31.091052 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.091184 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: d36b2ad475fec116fe7225b3a96e766a, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.091271 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:31.091320 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:31.091413 [ 66628 ] {} CachedOnDiskReadBufferFromFile(d36b2ad475fec116fe7225b3a96e766a): Key: d36b2ad475fec116fe7225b3a96e766a. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:31.092106 [ 66628 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pkh/afzpjfcacisnjvjhimbgtyngnhguy (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/default_compression_codec.txt) 2025.06.18 08:40:31.092210 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Reset state for seek to position 0 2025.06.18 08:40:31.092305 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:31.092483 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.092636 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 0400c7ab1c29805388345a0482cb56e8, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66628, kind: Regular, unbound: 0 2025.06.18 08:40:31.092725 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:31.092790 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:31.092885 [ 66628 ] {} CachedOnDiskReadBufferFromFile(0400c7ab1c29805388345a0482cb56e8): Key: 0400c7ab1c29805388345a0482cb56e8. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:31.093191 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk finished. 2025.06.18 08:40:31.093888 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_1_1_0_3 to all_1_1_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:31.094271 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_1_1_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:31.094366 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_1_1_0_3 to zookeeper 2025.06.18 08:40:31.094690 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/sgt/kvyvuczvqjxbbihzjvlkhgegrgpzi (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/columns.txt) 2025.06.18 08:40:31.094839 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Reset state for seek to position 0 2025.06.18 08:40:31.094974 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Having 1 file segments to read: [0, 66], current read range: [0, 67) 2025.06.18 08:40:31.095237 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.095406 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 66], key: d4577545012ce613fa1602212590f556, state: DOWNLOADED, downloaded size: 67, reserved size: 67, downloader id: None, current write offset: 67, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.095513 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Read 67 bytes, read type CACHED, file offset: 0, impl offset: 67/67, impl position: 0, segment: [0, 66] 2025.06.18 08:40:31.095594 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Remaining size to read: 67, read: 67. Resizing buffer to 67 2025.06.18 08:40:31.095700 [ 66631 ] {} CachedOnDiskReadBufferFromFile(d4577545012ce613fa1602212590f556): Key: d4577545012ce613fa1602212590f556. Returning with 67 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 67, current range: [0, 66], file offset of buffer end: 67, file segment state: DOWNLOADED, current write offset: 67, read_type: CACHED, reading until position: 67, started with offset: 0, remaining ranges: [0, 66] 2025.06.18 08:40:31.096406 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lwd/ldmvuoekipiwmcsmfhtrlqfwyeqli (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/serialization.json) 2025.06.18 08:40:31.096547 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Reset state for seek to position 0 2025.06.18 08:40:31.096673 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Having 1 file segments to read: [0, 204], current read range: [0, 205) 2025.06.18 08:40:31.096879 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.097020 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 204], key: 010668954635108bb41ac4d25be76a56, state: DOWNLOADED, downloaded size: 205, reserved size: 205, downloader id: None, current write offset: 205, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.097113 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Read 205 bytes, read type CACHED, file offset: 0, impl offset: 205/205, impl position: 0, segment: [0, 204] 2025.06.18 08:40:31.097167 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Remaining size to read: 205, read: 205. Resizing buffer to 205 2025.06.18 08:40:31.097267 [ 66631 ] {} CachedOnDiskReadBufferFromFile(010668954635108bb41ac4d25be76a56): Key: 010668954635108bb41ac4d25be76a56. Returning with 205 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 205, current range: [0, 204], file offset of buffer end: 205, file segment state: DOWNLOADED, current write offset: 205, read_type: CACHED, reading until position: 205, started with offset: 0, remaining ranges: [0, 204] 2025.06.18 08:40:31.098036 [ 66628 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_1_1_0_3. 2025.06.18 08:40:31.098097 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vmd/jrtbftzoydvnlnfqmsvbrkrcumgyg (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/metadata_version.txt) 2025.06.18 08:40:31.098218 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Reset state for seek to position 0 2025.06.18 08:40:31.098314 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:31.098496 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.098654 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: ccedd24c74b3a8c6391fb6094032c53b, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.098745 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:31.098797 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:31.098894 [ 66631 ] {} CachedOnDiskReadBufferFromFile(ccedd24c74b3a8c6391fb6094032c53b): Key: ccedd24c74b3a8c6391fb6094032c53b. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:31.099245 [ 66628 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:31.099556 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tex/swajcuuqlidfowdmxkmebjnsvshoz (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/checksums.txt) 2025.06.18 08:40:31.099683 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Reset state for seek to position 0 2025.06.18 08:40:31.099780 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Having 1 file segments to read: [0, 275], current read range: [0, 276) 2025.06.18 08:40:31.099971 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.099969 [ 66628 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:31.100107 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 275], key: 0892477eba8f8adf41e91d6781ca5ecb, state: DOWNLOADED, downloaded size: 276, reserved size: 276, downloader id: None, current write offset: 276, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.100235 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Read 276 bytes, read type CACHED, file offset: 0, impl offset: 276/276, impl position: 0, segment: [0, 275] 2025.06.18 08:40:31.100330 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Remaining size to read: 276, read: 276. Resizing buffer to 276 2025.06.18 08:40:31.100510 [ 66631 ] {} CachedOnDiskReadBufferFromFile(0892477eba8f8adf41e91d6781ca5ecb): Key: 0892477eba8f8adf41e91d6781ca5ecb. Returning with 276 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 276, current range: [0, 275], file offset of buffer end: 276, file segment state: DOWNLOADED, current write offset: 276, read_type: CACHED, reading until position: 276, started with offset: 0, remaining ranges: [0, 275] 2025.06.18 08:40:31.100510 [ 66374 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:31.101400 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qmi/miqvlxwfwxxtztvpnhomgwwwvtixr (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/n.cmrk2) 2025.06.18 08:40:31.101508 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Reset state for seek to position 0 2025.06.18 08:40:31.101631 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Having 1 file segments to read: [0, 46], current read range: [0, 47) 2025.06.18 08:40:31.101872 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.102018 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 46], key: 9017d8e8332975ac7f59689d7ee2bc69, state: DOWNLOADED, downloaded size: 47, reserved size: 47, downloader id: None, current write offset: 47, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.102109 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Read 47 bytes, read type CACHED, file offset: 0, impl offset: 47/47, impl position: 0, segment: [0, 46] 2025.06.18 08:40:31.102159 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Remaining size to read: 47, read: 47. Resizing buffer to 47 2025.06.18 08:40:31.102256 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9017d8e8332975ac7f59689d7ee2bc69): Key: 9017d8e8332975ac7f59689d7ee2bc69. Returning with 47 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 47, current range: [0, 46], file offset of buffer end: 47, file segment state: DOWNLOADED, current write offset: 47, read_type: CACHED, reading until position: 47, started with offset: 0, remaining ranges: [0, 46] 2025.06.18 08:40:31.103036 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rxl/iflnklcljyvpuoufljpxnvrgqfyuc (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/count.txt) 2025.06.18 08:40:31.103144 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Reset state for seek to position 0 2025.06.18 08:40:31.103239 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Having 1 file segments to read: [0, 0], current read range: [0, 1) 2025.06.18 08:40:31.103416 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.103564 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 0], key: 9a775cd6b3f02f8cf2e0e075bd39dd62, state: DOWNLOADED, downloaded size: 1, reserved size: 1, downloader id: None, current write offset: 1, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.103654 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Read 1 bytes, read type CACHED, file offset: 0, impl offset: 1/1, impl position: 0, segment: [0, 0] 2025.06.18 08:40:31.103703 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Remaining size to read: 1, read: 1. Resizing buffer to 1 2025.06.18 08:40:31.103795 [ 66631 ] {} CachedOnDiskReadBufferFromFile(9a775cd6b3f02f8cf2e0e075bd39dd62): Key: 9a775cd6b3f02f8cf2e0e075bd39dd62. Returning with 1 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 1, current range: [0, 0], file offset of buffer end: 1, file segment state: DOWNLOADED, current write offset: 1, read_type: CACHED, reading until position: 1, started with offset: 0, remaining ranges: [0, 0] 2025.06.18 08:40:31.104321 [ 66631 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/xik/eqwqmpvuvcecxedufestkbpgukfyp (store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_2_2_0_3/default_compression_codec.txt) 2025.06.18 08:40:31.104423 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Reset state for seek to position 0 2025.06.18 08:40:31.104533 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Having 1 file segments to read: [0, 9], current read range: [0, 10) 2025.06.18 08:40:31.104711 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl read range: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.104839 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Current read type: CACHED, read offset: 0, impl offset: 0, impl position: 0, file segment: File segment: [0, 9], key: 1a2ad12bea0766a7a5bb42b1411957c0, state: DOWNLOADED, downloaded size: 10, reserved size: 10, downloader id: None, current write offset: 10, caller id: None:MergeMutate:66631, kind: Regular, unbound: 0 2025.06.18 08:40:31.104926 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Read 10 bytes, read type CACHED, file offset: 0, impl offset: 10/10, impl position: 0, segment: [0, 9] 2025.06.18 08:40:31.104988 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Remaining size to read: 10, read: 10. Resizing buffer to 10 2025.06.18 08:40:31.105081 [ 66631 ] {} CachedOnDiskReadBufferFromFile(1a2ad12bea0766a7a5bb42b1411957c0): Key: 1a2ad12bea0766a7a5bb42b1411957c0. Returning with 10 bytes, buffer position: 0 (offset: 0, predownloaded: 0), buffer available: 10, current range: [0, 9], file offset of buffer end: 10, file segment state: DOWNLOADED, current write offset: 10, read_type: CACHED, reading until position: 10, started with offset: 0, remaining ranges: [0, 9] 2025.06.18 08:40:31.105367 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Download of part all_2_2_0_3 unique id s3/tex/swajcuuqlidfowdmxkmebjnsvshoz metadata onto disk s3_disk finished. 2025.06.18 08:40:31.106037 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Renaming temporary part tmp-fetch_all_2_2_0_3 to all_2_2_0_3 with tid (1, 1, 00000000-0000-0000-0000-000000000000). 2025.06.18 08:40:31.106402 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): preparePartForCommit: inserting all_2_2_0_3 (state PreActive) into data_parts_indexes 2025.06.18 08:40:31.106494 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Committing part all_2_2_0_3 to zookeeper 2025.06.18 08:40:31.110616 [ 66631 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Undoing transaction (1, 1, 00000000-0000-0000-0000-000000000000). Removing parts: all_2_2_0_3. 2025.06.18 08:40:31.111824 [ 66631 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:31.112543 [ 66631 ] {} MergeTreeBackgroundExecutor: Exception while executing background task {2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3}: Code: 999. Coordination::Exception: Fault injected (before part commit). (KEEPER_EXCEPTION), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. DB::Exception::Exception(int, FormatStringHelperImpl::type>, String const&) @ 0x000000000762aaa0 4. ./src/Common/ZooKeeper/IKeeper.h:490: Coordination::Exception::Exception(Coordination::Error, FormatStringHelperImpl::type>, String const&) @ 0x000000001adc33a4 5. ./build_docker/./src/Common/ZooKeeper/IKeeper.cpp:66: Coordination::SimpleFaultInjection::SimpleFaultInjection(double, double, String const&) @ 0x000000001adc1ebc 6. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::checkPartChecksumsAndCommit(DB::MergeTreeData::Transaction&, std::shared_ptr const&, std::optional, bool) @ 0x0000000019377964 7. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::fetchPart(String const&, std::shared_ptr const&, String const&, String const&, bool, unsigned long, std::shared_ptr, bool) @ 0x00000000193a345f 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:0: DB::StorageReplicatedMergeTree::executeFetch(DB::ReplicatedMergeTreeLogEntry&, bool) @ 0x0000000019394192 9. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:170: DB::ReplicatedMergeMutateTaskBase::executeImpl()::$_1::operator()(bool) const @ 0x0000000019d36f12 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x0000000019d35c3c 11. ./build_docker/./src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:0: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x0000000019d34329 12. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:298: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x00000000199950a9 13. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:0: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000019995c95 14. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x0000000019997d02 15. ./contrib/llvm-project/libcxx/include/__functional/function.h:0: ? @ 0x000000000fb188a8 16. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:0: ? @ 0x000000000fb20286 17. ./contrib/llvm-project/libcxx/include/__functional/function.h:717: ? @ 0x000000000fb201a2 18. ./base/base/../base/wide_integer_impl.h:817: ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x000000000fb1541e 19. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: void* std::__thread_proxy[abi:v15007]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000000fb1d3bc 20. __tsan_thread_start_func @ 0x000000000758af2f 21. ? @ 0x00007fac84fa8ac3 22. ? @ 0x00007fac8503a850 (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:31.112980 [ 66376 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000002 of type MUTATE_PART for part all_1_1_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:31.113171 [ 66376 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because recently it has failed. According to exponential backoff policy, put aside this log entry. 2025.06.18 08:40:31.705322 [ 66748 ] {} SystemLog (system.error_log): Terminating 2025.06.18 08:40:31.705756 [ 66724 ] {} SystemLog (system.filesystem_cache_log): Terminating 2025.06.18 08:40:31.706674 [ 66721 ] {} SystemLog (system.s3queue_log): Terminating 2025.06.18 08:40:31.707377 [ 66731 ] {} SystemLog (system.asynchronous_metric_log): Terminating 2025.06.18 08:40:31.708033 [ 66712 ] {} SystemLog (system.opentelemetry_span_log): Terminating 2025.06.18 08:40:31.708724 [ 66736 ] {} SystemLog (system.query_views_log): Terminating 2025.06.18 08:40:31.709450 [ 66716 ] {} SystemLog (system.zookeeper_log): Terminating 2025.06.18 08:40:31.710226 [ 66682 ] {} SystemLog (system.session_log): Terminating 2025.06.18 08:40:31.710887 [ 66717 ] {} SystemLog (system.transactions_info_log): Terminating 2025.06.18 08:40:31.711542 [ 66689 ] {} SystemLog (system.processors_profile_log): Terminating 2025.06.18 08:40:31.712206 [ 66719 ] {} SystemLog (system.asynchronous_insert_log): Terminating 2025.06.18 08:40:31.712935 [ 66714 ] {} SystemLog (system.backup_log): Terminating 2025.06.18 08:40:31.713632 [ 66683 ] {} SystemLog (system.blob_storage_log): Terminating 2025.06.18 08:40:31.714201 [ 65992 ] {} Context: Shutting down database catalog 2025.06.18 08:40:31.714399 [ 65992 ] {} DatabaseCatalog: Shutting down database 02911_support_alias_column_in_indices 2025.06.18 08:40:31.716118 [ 65992 ] {} DatabaseCatalog: Shutting down database INFORMATION_SCHEMA 2025.06.18 08:40:31.721776 [ 65992 ] {} DatabaseCatalog: Shutting down database datasets 2025.06.18 08:40:31.721911 [ 65992 ] {} DatabaseCatalog: Shutting down database db_dict 2025.06.18 08:40:31.722838 [ 65992 ] {} DatabaseCatalog: Shutting down database default 2025.06.18 08:40:31.722926 [ 65992 ] {} DatabaseCatalog: Shutting down database empty_db_01036 2025.06.18 08:40:31.722991 [ 65992 ] {} DatabaseCatalog: Shutting down database information_schema 2025.06.18 08:40:31.726054 [ 66306 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.726697 [ 66306 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.726720 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.727124 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.727221 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.727662 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.730578 [ 66618 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.730679 [ 66623 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.730964 [ 65992 ] {} DatabaseCatalog: Shutting down database test 2025.06.18 08:40:31.732999 [ 66618 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.733074 [ 66623 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.733328 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 parts to remove and reached the limit for one removal iteration 2025.06.18 08:40:31.733503 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_1_1_0_3] 2025.06.18 08:40:31.733616 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:31.733685 [ 66298 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.734351 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.734443 [ 66298 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.734775 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.734804 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.734876 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_1_1_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:31.735002 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:31.735080 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.735152 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_1_1_0_3] 2025.06.18 08:40:31.735845 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:31.737649 [ 66622 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.737779 [ 66620 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.737848 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_1_1_0 for part all_1_1_0_3 2025.06.18 08:40:31.738625 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_1_1_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:31.738838 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 for part all_1_1_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:31.739177 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:31.739685 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.740747 [ 66622 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_1_1_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.740993 [ 66620 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.741171 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh 2025.06.18 08:40:31.741299 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:31.741298 [ 66296 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.741397 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_1_1_0_3 cannot be removed 2025.06.18 08:40:31.741479 [ 65992 ] {} HashJoin: Join data is being destroyed, 6144 bytes and 0 rows in hash table 2025.06.18 08:40:31.741891 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_1_1_0 to all_1_1_0_3 2025.06.18 08:40:31.741912 [ 66296 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.742212 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutating part all_1_1_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.742360 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.742637 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.744086 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Mutation of part all_1_1_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.744425 [ 66632 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.745135 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_1_1_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:31.745226 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_1_1_0_3] 2025.06.18 08:40:31.745352 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:31.745790 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching part all_1_1_0_3 from default:/test/02485/test_1/rmt/replicas/2 2025.06.18 08:40:31.746219 [ 66632 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.746588 [ 65992 ] {} DatabaseCatalog: Shutting down database test_01516 2025.06.18 08:40:31.746659 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Trying to fetch with zero-copy replication, but disk is not provided, will try to select 2025.06.18 08:40:31.746710 [ 66294 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.746800 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Checking disk s3_disk with type s3 2025.06.18 08:40:31.746924 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk s3_disk (with type s3) supports zero-copy replication 2025.06.18 08:40:31.747092 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.747316 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.747563 [ 66001 ] {} InterserverIOHTTPHandler-factory: HTTP Request for InterserverIOHTTPHandler-factory. Method: POST, Address: [2001:3984:3989::242:ac11:2]:34450, User-Agent: ClickHouse/24.8.14.10063.altinitytest, Length: 0, Content Type: , Transfer Encoding: identity, X-Forwarded-For: (none) 2025.06.18 08:40:31.747839 [ 66001 ] {} InterserverIOHTTPHandler: Request URI: /?endpoint=DataPartsExchange%3Adefault%3A%2Ftest%2F02485%2Ftest_1%2Frmt%2Freplicas%2F2&part=all_1_1_0_3&client_protocol_version=8&compress=false&remote_fs_metadata=s3 2025.06.18 08:40:31.747953 [ 66001 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375) (Replicated PartsService): Sending part all_1_1_0_3 2025.06.18 08:40:31.748201 [ 65992 ] {} DatabaseCatalog: Shutting down database test_1 2025.06.18 08:40:31.748255 [ 66302 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 667ms, ratio: 0.025641028, points per minute: 23.065392) 2025.06.18 08:40:31.748467 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 old parts to remove. Parts: [all_2_2_0_3] 2025.06.18 08:40:31.748565 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 old parts from ZooKeeper 2025.06.18 08:40:31.749323 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): There is no part all_2_2_0_3 in ZooKeeper, it was only in filesystem 2025.06.18 08:40:31.749401 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts from ZooKeeper. Removing them from filesystem. 2025.06.18 08:40:31.749418 [ 66629 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.749483 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from filesystem (serially): Parts: [all_2_2_0_3] 2025.06.18 08:40:31.749924 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 local references is zero, will check blobs can be removed in zookeeper 2025.06.18 08:40:31.750093 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Start preparing for shutdown 2025.06.18 08:40:31.750216 [ 66001 ] {} InterserverIOHTTPHandler: Done processing query 2025.06.18 08:40:31.750232 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Stopped being leader 2025.06.18 08:40:31.750281 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using storage balanced reservation 2025.06.18 08:40:31.750362 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, reserving space using TTL rules 2025.06.18 08:40:31.750432 [ 65992 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.750471 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Trying to reserve 1.00 MiB on the selected disk: s3_disk (with type s3) 2025.06.18 08:40:31.750638 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Disk for fetch is not provided, getting disk from reservation s3_disk with type 's3' 2025.06.18 08:40:31.750637 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): The attach thread is shutdown 2025.06.18 08:40:31.750806 [ 65992 ] {} test_1.concurrent_kill_1 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.750919 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Finished preparing for shutdown 2025.06.18 08:40:31.751056 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Start preparing for shutdown 2025.06.18 08:40:31.751149 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Stopped being leader 2025.06.18 08:40:31.751230 [ 65992 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.751277 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): The attach thread is shutdown 2025.06.18 08:40:31.751353 [ 65992 ] {} test_1.concurrent_kill_2 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.751406 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Finished preparing for shutdown 2025.06.18 08:40:31.751452 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Start preparing for shutdown 2025.06.18 08:40:31.751499 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Stopped being leader 2025.06.18 08:40:31.751565 [ 65992 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.751582 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found mutation parent all_2_2_0 for part all_2_2_0_3 2025.06.18 08:40:31.751611 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): The attach thread is shutdown 2025.06.18 08:40:31.751673 [ 66629 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.751765 [ 65992 ] {} test_1.concurrent_kill_4 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.751874 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Finished preparing for shutdown 2025.06.18 08:40:31.751967 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Start preparing for shutdown 2025.06.18 08:40:31.752030 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Stopped being leader 2025.06.18 08:40:31.752099 [ 65992 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.752067 [ 66293 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zero-copy lock on path /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/part_exclusive_lock doesn't exist 2025.06.18 08:40:31.752151 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): The attach thread is shutdown 2025.06.18 08:40:31.752226 [ 65992 ] {} test_1.concurrent_kill_5 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.752272 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Finished preparing for shutdown 2025.06.18 08:40:31.752402 [ 65992 ] {} StorageDistributed (d): Flushing pending INSERT blocks 2025.06.18 08:40:31.752412 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found files not to remove from parent part all_2_2_0: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, columns.txt, n.cmrk2, k.bin] 2025.06.18 08:40:31.752437 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Executing log entry to mutate part all_2_2_0 to all_2_2_0_3 2025.06.18 08:40:31.752494 [ 65992 ] {} StorageDistributed (d): Pending INSERT blocks flushed, took 0 ms. 2025.06.18 08:40:31.752617 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing zookeeper lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz/1 for part all_2_2_0_3 (files to keep: [count.txt, m.bin, n.bin, k.cmrk2, default_compression_codec.txt, metadata_version.txt, serialization.json, primary.cidx, m.cmrk2, k.bin, n.cmrk2, columns.txt]) 2025.06.18 08:40:31.752680 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Start preparing for shutdown 2025.06.18 08:40:31.752748 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutating part all_2_2_0_3 with mutation commands from 1 mutations (0000000000): UPDATE k = 0 WHERE 0 2025.06.18 08:40:31.752763 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Stopped being leader 2025.06.18 08:40:31.752888 [ 65992 ] {} test_1.data_r1 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.752965 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): The attach thread is shutdown 2025.06.18 08:40:31.753042 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:31.753107 [ 65992 ] {} test_1.data_r1 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.753171 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Finished preparing for shutdown 2025.06.18 08:40:31.753215 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Start preparing for shutdown 2025.06.18 08:40:31.753258 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Stopped being leader 2025.06.18 08:40:31.753302 [ 65992 ] {} test_1.data_r2 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.753354 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): The attach thread is shutdown 2025.06.18 08:40:31.753458 [ 65992 ] {} test_1.data_r2 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.753464 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.753604 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Finished preparing for shutdown 2025.06.18 08:40:31.753694 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Start preparing for shutdown 2025.06.18 08:40:31.753759 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Stopped being leader 2025.06.18 08:40:31.753806 [ 65992 ] {} test_1.quorum1 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.753882 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): The attach thread is shutdown 2025.06.18 08:40:31.753949 [ 65992 ] {} test_1.quorum1 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.753993 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Finished preparing for shutdown 2025.06.18 08:40:31.754036 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Start preparing for shutdown 2025.06.18 08:40:31.754078 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Stopped being leader 2025.06.18 08:40:31.754118 [ 65992 ] {} test_1.r2 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.754153 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): The attach thread is shutdown 2025.06.18 08:40:31.754220 [ 65992 ] {} test_1.r2 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.754264 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Finished preparing for shutdown 2025.06.18 08:40:31.754307 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Start preparing for shutdown 2025.06.18 08:40:31.754348 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Stopped being leader 2025.06.18 08:40:31.754398 [ 65992 ] {} test_1.rmt1 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.754461 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): The attach thread is shutdown 2025.06.18 08:40:31.754587 [ 65992 ] {} test_1.rmt1 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.754670 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Finished preparing for shutdown 2025.06.18 08:40:31.754751 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Start preparing for shutdown 2025.06.18 08:40:31.754808 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Stopped being leader 2025.06.18 08:40:31.754853 [ 65992 ] {} test_1.rmt2 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.754895 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): The attach thread is shutdown 2025.06.18 08:40:31.754890 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading part all_1_1_0_3 unique id s3/yyl/zjehcvdhbccinmoamwchmliqnkrlh metadata onto disk s3_disk. 2025.06.18 08:40:31.754959 [ 65992 ] {} test_1.rmt2 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.754971 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Found 1 (2) zookeeper locks for /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_2_2_0_3/s3_tex_swajcuuqlidfowdmxkmebjnsvshoz 2025.06.18 08:40:31.755013 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Finished preparing for shutdown 2025.06.18 08:40:31.755074 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Start preparing for shutdown 2025.06.18 08:40:31.755090 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Blobs of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:31.755188 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Stopped being leader 2025.06.18 08:40:31.755083 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Set zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 2025.06.18 08:40:31.755266 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Some blobs (columns.txt, n.cmrk2, k.bin, m.cmrk2, primary.cidx, serialization.json, metadata_version.txt, default_compression_codec.txt, k.cmrk2, n.bin, m.bin, count.txt) of part all_2_2_0_3 cannot be removed 2025.06.18 08:40:31.755285 [ 65992 ] {} test_1.t_rename_alter (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.755350 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): The attach thread is shutdown 2025.06.18 08:40:31.755435 [ 65992 ] {} test_1.t_rename_alter (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.755533 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Finished preparing for shutdown 2025.06.18 08:40:31.755708 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 190 2025.06.18 08:40:31.755750 [ 66627 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_2_2_0_3 (MutateFromLogEntryTask): Mutation of part all_2_2_0_3 finished by some other replica, will download mutated part 2025.06.18 08:40:31.756107 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.756984 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Zookeeper temporary ephemeral lock /clickhouse/zero_copy/zero_copy_s3/2e0243fc-9bfd-44af-a800-63263ec63efe/all_1_1_0_3/s3_yyl_zjehcvdhbccinmoamwchmliqnkrlh/1 created 2025.06.18 08:40:31.758268 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Shutdown started 2025.06.18 08:40:31.758381 [ 66627 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Part all_2_2_0_3 should be deleted after previous attempt before fetch 2025.06.18 08:40:31.758743 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 85 2025.06.18 08:40:31.758828 [ 66292 ] {} test_1.rmt1 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000003 of type MUTATE_PART for part all_2_2_0_3 because merges and mutations are cancelled now. 2025.06.18 08:40:31.759049 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.759109 [ 66619 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe) (Fetcher): Downloading files 13 2025.06.18 08:40:31.759215 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): removePartsFinally: removing all_2_2_0_3 (state Deleting) from data_parts_indexes 2025.06.18 08:40:31.759301 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removing 1 parts from memory: Parts: [all_2_2_0_3] 2025.06.18 08:40:31.759385 [ 66302 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Removed 1 old parts 2025.06.18 08:40:31.760150 [ 66302 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0.25641027, interval: 12ms, ratio: 0.025641028, points per minute: 1282.0513) 2025.06.18 08:40:31.760738 [ 66619 ] {} RemoveRecursiveObjectStorageOperation: Can't read metadata because of an exception. Just remove it from the filesystem. Path: /var/lib/clickhouse/disks/s3_disk/store/2e0/2e0243fc-9bfd-44af-a800-63263ec63efe/tmp-fetch_all_1_1_0_3/checksums.txt, exception: Attempt to read after eof 2025.06.18 08:40:31.760817 [ 66302 ] {} test_1.rmt1 (ReplicatedMergeTreeCleanupThread): Scheduling next cleanup after 60000ms (points: 0, interval: 1ms, ratio: 0, points per minute: 0) 2025.06.18 08:40:31.761539 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 130 2025.06.18 08:40:31.761883 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.762632 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Our replica parts collected r11 2025.06.18 08:40:31.764144 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Fetching parts for replica r12: [all_0_0_0_18] 2025.06.18 08:40:31.765564 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Fetching parts for replica r14: [all_0_0_0_18] 2025.06.18 08:40:31.766834 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Fetching parts for replica r15: [all_0_0_0_18] 2025.06.18 08:40:31.766916 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): All parts found on replicas 2025.06.18 08:40:31.766985 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.767362 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 116 2025.06.18 08:40:31.767722 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.768497 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Waiting for threads to finish 2025.06.18 08:40:31.769015 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Threads finished 2025.06.18 08:40:31.769093 [ 65992 ] {} test_1.concurrent_kill_1 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.769204 [ 65992 ] {} test_1.concurrent_kill_1 (94171f7a-506b-42ba-82b6-6e867df1bcab): Shutdown finished 2025.06.18 08:40:31.769297 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Shutdown started 2025.06.18 08:40:31.769672 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 85 2025.06.18 08:40:31.769894 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.772129 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Replica r11 is not active, skipping 2025.06.18 08:40:31.773429 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Our replica parts collected r12 2025.06.18 08:40:31.774657 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Fetching parts for replica r14: [all_0_0_0_18] 2025.06.18 08:40:31.775899 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Fetching parts for replica r15: [all_0_0_0_18] 2025.06.18 08:40:31.775969 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): All parts found on replicas 2025.06.18 08:40:31.776020 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.776346 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 116 2025.06.18 08:40:31.776700 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.777418 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Waiting for threads to finish 2025.06.18 08:40:31.777891 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Threads finished 2025.06.18 08:40:31.777956 [ 65992 ] {} test_1.concurrent_kill_2 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.778039 [ 65992 ] {} test_1.concurrent_kill_2 (92c1f687-7ed1-46f5-8d58-ef0f0b6cacd0): Shutdown finished 2025.06.18 08:40:31.778112 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Shutdown started 2025.06.18 08:40:31.778460 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 85 2025.06.18 08:40:31.778730 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.781615 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Replica r11 is not active, skipping 2025.06.18 08:40:31.782309 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Replica r12 is not active, skipping 2025.06.18 08:40:31.783649 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Our replica parts collected r14 2025.06.18 08:40:31.784924 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Fetching parts for replica r15: [all_0_0_0_18] 2025.06.18 08:40:31.784970 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): All parts found on replicas 2025.06.18 08:40:31.784999 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.785255 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 116 2025.06.18 08:40:31.785623 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.786412 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Waiting for threads to finish 2025.06.18 08:40:31.786706 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Threads finished 2025.06.18 08:40:31.786747 [ 65992 ] {} test_1.concurrent_kill_4 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.786803 [ 65992 ] {} test_1.concurrent_kill_4 (ba0f4733-ccae-4924-a8ff-8870225eece6): Shutdown finished 2025.06.18 08:40:31.786853 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Shutdown started 2025.06.18 08:40:31.787107 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 85 2025.06.18 08:40:31.787359 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.789459 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Replica r11 is not active, skipping 2025.06.18 08:40:31.790012 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Replica r12 is not active, skipping 2025.06.18 08:40:31.790542 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Replica r14 is not active, skipping 2025.06.18 08:40:31.791594 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Our replica parts collected r15 2025.06.18 08:40:31.791633 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.791671 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.791973 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 116 2025.06.18 08:40:31.792376 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.793176 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Waiting for threads to finish 2025.06.18 08:40:31.793452 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Threads finished 2025.06.18 08:40:31.793490 [ 65992 ] {} test_1.concurrent_kill_5 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.793560 [ 65992 ] {} test_1.concurrent_kill_5 (8c2f689e-97e9-4327-a1e7-1dc8f9bb0a60): Shutdown finished 2025.06.18 08:40:31.794230 [ 65992 ] {} StorageDistributed (d): Flushing pending INSERT blocks 2025.06.18 08:40:31.794289 [ 65992 ] {} StorageDistributed (d): Pending INSERT blocks flushed, took 0 ms. 2025.06.18 08:40:31.794335 [ 65992 ] {} StorageDistributed (d): Joining background threads for async INSERT 2025.06.18 08:40:31.794389 [ 65992 ] {} StorageDistributed (d): Background threads for async INSERT joined 2025.06.18 08:40:31.794966 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Shutdown started 2025.06.18 08:40:31.795340 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 19 2025.06.18 08:40:31.795641 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.798492 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Our replica parts collected data_r1 2025.06.18 08:40:31.799559 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Fetching parts for replica data_r2: [all_0_49_3, all_50_93_2, all_94_101_1] 2025.06.18 08:40:31.799622 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): All parts found on replicas 2025.06.18 08:40:31.799653 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.799954 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 54 2025.06.18 08:40:31.800289 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.801024 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Waiting for threads to finish 2025.06.18 08:40:31.801296 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Threads finished 2025.06.18 08:40:31.801334 [ 65992 ] {} test_1.data_r1 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.801383 [ 65992 ] {} test_1.data_r1 (cd0456b0-6c04-4385-9a38-0cbbbb1496e7): Shutdown finished 2025.06.18 08:40:31.801429 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Shutdown started 2025.06.18 08:40:31.801746 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 19 2025.06.18 08:40:31.802080 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.804210 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Replica data_r1 is not active, skipping 2025.06.18 08:40:31.805308 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Our replica parts collected data_r2 2025.06.18 08:40:31.805359 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.805389 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.805681 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 54 2025.06.18 08:40:31.806092 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.806843 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Waiting for threads to finish 2025.06.18 08:40:31.807121 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Threads finished 2025.06.18 08:40:31.807158 [ 65992 ] {} test_1.data_r2 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.807207 [ 65992 ] {} test_1.data_r2 (9df4beba-7eb5-461d-bf4b-657bd48290a8): Shutdown finished 2025.06.18 08:40:31.809143 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Shutdown started 2025.06.18 08:40:31.809445 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 57 2025.06.18 08:40:31.809781 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.812651 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Our replica parts collected 1 2025.06.18 08:40:31.812701 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.812741 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.813004 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 86 2025.06.18 08:40:31.813344 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.814047 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Waiting for threads to finish 2025.06.18 08:40:31.814338 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Threads finished 2025.06.18 08:40:31.814375 [ 65992 ] {} test_1.quorum1 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.814427 [ 65992 ] {} test_1.quorum1 (2158dbeb-c487-43d9-8cc4-d3b0d6e2245b): Shutdown finished 2025.06.18 08:40:31.814475 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Shutdown started 2025.06.18 08:40:31.814758 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 24 2025.06.18 08:40:31.814976 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.818261 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Our replica parts collected 2 2025.06.18 08:40:31.818319 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.818353 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.818679 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 53 2025.06.18 08:40:31.819045 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.819746 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Waiting for threads to finish 2025.06.18 08:40:31.820049 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Threads finished 2025.06.18 08:40:31.820092 [ 65992 ] {} test_1.r2 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.820150 [ 65992 ] {} test_1.r2 (7048ad88-f039-43aa-b1fb-990007a5bcdb): Shutdown finished 2025.06.18 08:40:31.821219 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Shutdown started 2025.06.18 08:40:31.821554 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 22 2025.06.18 08:40:31.821836 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.824840 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Fetching parts for replica 2: [all_1_1_0_3, all_2_2_0_3] 2025.06.18 08:40:31.826290 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Our replica parts collected 1 2025.06.18 08:40:31.826350 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): All parts found on replicas 2025.06.18 08:40:31.826388 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.826724 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 51 2025.06.18 08:40:31.827083 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.827762 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Waiting for threads to finish 2025.06.18 08:40:31.885427 [ 66619 ] {} 2e0243fc-9bfd-44af-a800-63263ec63efe::all_1_1_0_3 (MutateFromLogEntryTask): Code: 236. DB::Exception: Fetching of part was cancelled. (ABORTED) 2025.06.18 08:40:31.885889 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Threads finished 2025.06.18 08:40:31.885950 [ 65992 ] {} test_1.rmt1 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.886034 [ 65992 ] {} test_1.rmt1 (2e0243fc-9bfd-44af-a800-63263ec63efe): Shutdown finished 2025.06.18 08:40:31.886094 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Shutdown started 2025.06.18 08:40:31.886490 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 22 2025.06.18 08:40:31.886784 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.889930 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Our replica parts collected 2 2025.06.18 08:40:31.890560 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Replica 1 is not active, skipping 2025.06.18 08:40:31.890599 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.890633 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.890894 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 51 2025.06.18 08:40:31.891211 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.891988 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Waiting for threads to finish 2025.06.18 08:40:31.892265 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Threads finished 2025.06.18 08:40:31.892300 [ 65992 ] {} test_1.rmt2 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.892348 [ 65992 ] {} test_1.rmt2 (4b2be74c-b043-4c29-be1e-e2afc5672375): Shutdown finished 2025.06.18 08:40:31.894733 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Shutdown started 2025.06.18 08:40:31.895083 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 40 2025.06.18 08:40:31.895327 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.898411 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Our replica parts collected 1 2025.06.18 08:40:31.898465 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.898499 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.898766 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 69 2025.06.18 08:40:31.899093 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.899849 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Waiting for threads to finish 2025.06.18 08:40:31.900142 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Threads finished 2025.06.18 08:40:31.900187 [ 65992 ] {} test_1.t_rename_alter (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.900258 [ 65992 ] {} test_1.t_rename_alter (4e11015e-c5c0-4326-ab61-54b8bd356a9e): Shutdown finished 2025.06.18 08:40:31.919734 [ 65992 ] {} HashJoin: Join data is being destroyed, 6273 bytes and 2 rows in hash table 2025.06.18 08:40:31.944924 [ 65992 ] {} HashJoin: Join data is being destroyed, 6429 bytes and 3 rows in hash table 2025.06.18 08:40:31.951746 [ 65992 ] {} DatabaseCatalog: Shutting down database test_13 2025.06.18 08:40:31.952962 [ 65992 ] {} DatabaseCatalog: Shutting down database test_15 2025.06.18 08:40:31.954103 [ 65992 ] {} DatabaseCatalog: Shutting down database test_1_db 2025.06.18 08:40:31.954605 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 118 2025.06.18 08:40:31.954997 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.956010 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Start preparing for shutdown 2025.06.18 08:40:31.956070 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Stopped being leader 2025.06.18 08:40:31.956125 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.956163 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Finished preparing for shutdown 2025.06.18 08:40:31.956196 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Start preparing for shutdown 2025.06.18 08:40:31.956222 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Stopped being leader 2025.06.18 08:40:31.956260 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.956285 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Finished preparing for shutdown 2025.06.18 08:40:31.956313 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Shutdown started 2025.06.18 08:40:31.956594 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 58 2025.06.18 08:40:31.956846 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.960277 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Our replica parts collected r1 2025.06.18 08:40:31.960337 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.960370 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.960642 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 88 2025.06.18 08:40:31.960989 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.961765 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Waiting for threads to finish 2025.06.18 08:40:31.962049 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Threads finished 2025.06.18 08:40:31.962092 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.962149 [ 65992 ] {} test_1_db.`.inner_id.9e8317db-712b-468d-9263-ac3b0fa6e085` (959bd902-bb2e-422b-83b3-85dced7f8d15): Shutdown finished 2025.06.18 08:40:31.962364 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Shutdown started 2025.06.18 08:40:31.962662 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 58 2025.06.18 08:40:31.962894 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.966001 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Our replica parts collected r1 2025.06.18 08:40:31.966039 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.966063 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.966408 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 88 2025.06.18 08:40:31.966880 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.967665 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Waiting for threads to finish 2025.06.18 08:40:31.967943 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Threads finished 2025.06.18 08:40:31.967982 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.968033 [ 65992 ] {} test_1_db.`.inner_id.b1978140-56bb-4daa-bf6b-5bbe3c64a8ac` (02fc079f-8864-4071-b4bb-fcd1b6184cae): Shutdown finished 2025.06.18 08:40:31.970953 [ 65992 ] {} DatabaseCatalog: Shutting down database test_3 2025.06.18 08:40:31.971435 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Start preparing for shutdown 2025.06.18 08:40:31.971491 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Stopped being leader 2025.06.18 08:40:31.971551 [ 65992 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.971591 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): The attach thread is shutdown 2025.06.18 08:40:31.971653 [ 65992 ] {} test_3.r_prop_table1 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.971694 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Finished preparing for shutdown 2025.06.18 08:40:31.971732 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Start preparing for shutdown 2025.06.18 08:40:31.971766 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Stopped being leader 2025.06.18 08:40:31.971801 [ 65992 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.971831 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): The attach thread is shutdown 2025.06.18 08:40:31.971882 [ 65992 ] {} test_3.r_prop_table2 (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.971918 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Finished preparing for shutdown 2025.06.18 08:40:31.971954 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Start preparing for shutdown 2025.06.18 08:40:31.971987 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Stopped being leader 2025.06.18 08:40:31.972020 [ 65992 ] {} test_3.test_table_replicated (ReplicatedMergeTreeAttachThread): Attach thread finished 2025.06.18 08:40:31.972048 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): The attach thread is shutdown 2025.06.18 08:40:31.972097 [ 65992 ] {} test_3.test_table_replicated (ReplicatedMergeTreeRestartingThread): Restarting thread finished 2025.06.18 08:40:31.972131 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Finished preparing for shutdown 2025.06.18 08:40:31.973057 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Shutdown started 2025.06.18 08:40:31.973395 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 42 2025.06.18 08:40:31.973651 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.976449 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Fetching parts for replica 2: [all_0_2_1] 2025.06.18 08:40:31.977320 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Our replica parts collected 1 2025.06.18 08:40:31.977373 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): All parts found on replicas 2025.06.18 08:40:31.977404 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.977625 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 71 2025.06.18 08:40:31.978001 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.978673 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Waiting for threads to finish 2025.06.18 08:40:31.978924 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Threads finished 2025.06.18 08:40:31.978959 [ 65992 ] {} test_3.r_prop_table1 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.979007 [ 65992 ] {} test_3.r_prop_table1 (69c94d68-13dd-40b1-ae3d-b14cdb36815d): Shutdown finished 2025.06.18 08:40:31.979049 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Shutdown started 2025.06.18 08:40:31.979278 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 42 2025.06.18 08:40:31.979507 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.981858 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Our replica parts collected 2 2025.06.18 08:40:31.982509 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Replica 1 is not active, skipping 2025.06.18 08:40:31.982561 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.982591 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.982845 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 71 2025.06.18 08:40:31.983164 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.983880 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Waiting for threads to finish 2025.06.18 08:40:31.984143 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Threads finished 2025.06.18 08:40:31.984178 [ 65992 ] {} test_3.r_prop_table2 (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.984223 [ 65992 ] {} test_3.r_prop_table2 (9d890b89-f8c0-4719-a94a-d64c080fafdd): Shutdown finished 2025.06.18 08:40:31.986375 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Shutdown started 2025.06.18 08:40:31.986669 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 47 2025.06.18 08:40:31.986908 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.989201 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Our replica parts collected 1_replica 2025.06.18 08:40:31.989244 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Has no active replicas, will no try to wait for fetch 2025.06.18 08:40:31.989272 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Will not wait for unique parts to be fetched because we don't have any unique parts 2025.06.18 08:40:31.989481 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 84 2025.06.18 08:40:31.989832 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:31.990534 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Waiting for threads to finish 2025.06.18 08:40:31.990816 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Threads finished 2025.06.18 08:40:31.990876 [ 65992 ] {} test_3.test_table_replicated (PartMovesBetweenShardsOrchestrator): PartMovesBetweenShardsOrchestrator thread finished 2025.06.18 08:40:31.990928 [ 65992 ] {} test_3.test_table_replicated (2505889b-5cfd-4987-8ccf-6fbac334529e): Shutdown finished 2025.06.18 08:40:32.001494 [ 65992 ] {} DatabaseCatalog: Shutting down database test_5ri8lnpr 2025.06.18 08:40:32.001899 [ 65992 ] {} DatabaseCatalog: Shutting down database test_7 2025.06.18 08:40:32.002743 [ 65992 ] {} DatabaseCatalog: Shutting down database test_i227bf47 2025.06.18 08:40:32.003092 [ 65992 ] {} DatabaseCatalog: Shutting down database test_qcf18570 2025.06.18 08:40:32.003531 [ 66771 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.003610 [ 66766 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.003629 [ 66767 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.003769 [ 66765 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.004102 [ 66723 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081085 [ 65992 ] {} virtual void DB::StorageBuffer::flushAndPrepareForShutdown(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000001e594e03 1. ./build_docker/./src/Common/Exception.cpp:111: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000fa09495 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000761237e 3. ./contrib/llvm-project/libcxx/include/vector:438: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, unsigned long&&, unsigned long&) @ 0x000000000fb1e06c 4. ./build_docker/./src/Common/ThreadPool.cpp:259: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x000000000fb206f8 5. ./build_docker/./src/Common/ThreadPool.cpp:0: void ThreadPoolImpl>::scheduleImpl(std::function, Priority, std::optional, bool) @ 0x000000000fb19cce 6. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000000fb19a0b 7. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x00000000160df283 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x00000000195e52dc 9. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:701: DB::StorageBuffer::optimize(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr const&, bool, bool, std::vector> const&, bool, std::shared_ptr) @ 0x00000000195e4f30 10. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:596: DB::StorageBuffer::flushAndPrepareForShutdown() @ 0x00000000195e4d57 11. ./contrib/llvm-project/libcxx/include/__tree:189: DB::DatabaseWithOwnTablesBase::shutdown() @ 0x000000001712e999 12. ./build_docker/./src/Databases/DatabaseOnDisk.cpp:184: DB::DatabaseOnDisk::shutdown() @ 0x0000000017092f6b 13. ./contrib/llvm-project/libcxx/include/__tree:189: DB::DatabaseCatalog::shutdownImpl() @ 0x000000001768d0bf 14. ./build_docker/./src/Interpreters/DatabaseCatalog.cpp:867: DB::DatabaseCatalog::shutdown() @ 0x000000001769616c 15. ./build_docker/./src/Interpreters/Context.cpp:624: DB::ContextSharedPart::shutdown() @ 0x00000000175dcafd 16. ./build_docker/./src/Interpreters/Context.cpp:4783: DB::Context::shutdown() @ 0x00000000175ca482 17. ./build_docker/./programs/server/Server.cpp:0: BasicScopeGuard> const&)::$_2>::~BasicScopeGuard() @ 0x000000000fc66246 18. ./build_docker/./programs/server/Server.cpp:0: DB::Server::main(std::vector> const&) @ 0x000000000fc55dd6 19. ./build_docker/./base/poco/Util/src/Application.cpp:0: Poco::Util::Application::run() @ 0x000000001e6d9b9f 20. ./build_docker/./programs/server/Server.cpp:0: DB::Server::run() @ 0x000000000fc3b786 21. ./build_docker/./base/poco/Util/src/ServerApplication.cpp:0: Poco::Util::ServerApplication::run(int, char**) @ 0x000000001e6f83c1 22. ./build_docker/./programs/server/Server.cpp:0: mainEntryClickHouseServer(int, char**) @ 0x000000000fc385b6 23. ./build_docker/./programs/main.cpp:0: main @ 0x00000000076098e9 24. ? @ 0x00007fac84f3dd90 25. ? @ 0x00007fac84f3de40 26. _start @ 0x000000000756402e (version 24.8.14.10063.altinitytest (altinity build)) 2025.06.18 08:40:32.081476 [ 66684 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081560 [ 66787 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081682 [ 66784 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081801 [ 66787 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081774 [ 66782 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081894 [ 66781 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081879 [ 66779 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081945 [ 66787 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.081919 [ 66770 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082099 [ 66782 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082128 [ 66769 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082237 [ 66747 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082271 [ 66768 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082252 [ 66741 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082376 [ 66735 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082385 [ 66769 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.082654 [ 65992 ] {} StorageDistributed (realtimedistributed): Flushing pending INSERT blocks 2025.06.18 08:40:32.082716 [ 65992 ] {} StorageDistributed (realtimedistributed): Pending INSERT blocks flushed, took 0 ms. 2025.06.18 08:40:32.082935 [ 66734 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083097 [ 66732 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083110 [ 66729 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083210 [ 66718 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083225 [ 66730 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083269 [ 66720 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083115 [ 66733 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083321 [ 66728 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083348 [ 66732 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083460 [ 66710 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083562 [ 66718 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083626 [ 66690 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083740 [ 66772 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083788 [ 66783 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083828 [ 66718 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.083826 [ 66734 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_19): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084239 [ 66776 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084344 [ 66617 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084372 [ 66763 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084549 [ 66666 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084548 [ 66775 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084663 [ 66674 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084710 [ 66763 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084770 [ 66666 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084784 [ 66667 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.084882 [ 66668 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085014 [ 66670 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085037 [ 66668 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085057 [ 66674 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085209 [ 66670 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085367 [ 66673 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085461 [ 66677 ] {} StorageBuffer (test_qcf18570.realtimebuff__fuzz_20): Flushing buffer with 0 rows, 0 bytes, age 0 seconds, took 0 ms (direct). 2025.06.18 08:40:32.085623 [ 65992 ] {} StorageDistributed (realtimedistributed): Flushing pending INSERT blocks 2025.06.18 08:40:32.085672 [ 65992 ] {} StorageDistributed (realtimedistributed): Pending INSERT blocks flushed, took 0 ms. 2025.06.18 08:40:32.085716 [ 65992 ] {} StorageDistributed (realtimedistributed): Joining background threads for async INSERT 2025.06.18 08:40:32.085747 [ 65992 ] {} StorageDistributed (realtimedistributed): Background threads for async INSERT joined 2025.06.18 08:40:32.086758 [ 65992 ] {} DatabaseCatalog: Shutting down database test_sgwu2ec2 2025.06.18 08:40:32.086984 [ 65992 ] {} DatabaseCatalog: Shutting down database test_v4ezwkrr 2025.06.18 08:40:32.087181 [ 65992 ] {} DatabaseCatalog: Shutting down system databases 2025.06.18 08:40:32.652358 [ 65992 ] {} Context: Shutting down merges executor 2025.06.18 08:40:32.654199 [ 65992 ] {} Context: Shutting down fetches executor 2025.06.18 08:40:32.655589 [ 65992 ] {} Context: Shutting down moves executor 2025.06.18 08:40:32.656129 [ 65992 ] {} Context: Shutting down common executor 2025.06.18 08:40:32.656726 [ 65992 ] {} Context: Shutting down DDLWorker 2025.06.18 08:40:32.656849 [ 65992 ] {} Context: Shutting down caches 2025.06.18 08:40:32.658127 [ 65992 ] {} Context: Shutdown disk azure 2025.06.18 08:40:32.658180 [ 65992 ] {} DiskObjectStorage(azure): Shutting down disk azure 2025.06.18 08:40:32.658219 [ 65992 ] {} DiskObjectStorage(azure): Disk azure shut down 2025.06.18 08:40:32.658248 [ 65992 ] {} Context: Shutdown disk backups 2025.06.18 08:40:32.658274 [ 65992 ] {} Context: Shutdown disk cached_azure 2025.06.18 08:40:32.658298 [ 65992 ] {} DiskObjectStorage(azure): Shutting down disk azure 2025.06.18 08:40:32.658325 [ 65992 ] {} DiskObjectStorage(azure): Disk azure shut down 2025.06.18 08:40:32.658344 [ 65992 ] {} Context: Shutdown disk default 2025.06.18 08:40:32.658362 [ 65992 ] {} Context: Shutdown disk disk1_02961 2025.06.18 08:40:32.658393 [ 65992 ] {} Context: Shutdown disk disk2_02961 2025.06.18 08:40:32.658414 [ 65992 ] {} Context: Shutdown disk disk3_02961 2025.06.18 08:40:32.658431 [ 65992 ] {} Context: Shutdown disk disk4_02961 2025.06.18 08:40:32.658449 [ 65992 ] {} Context: Shutdown disk local_cache 2025.06.18 08:40:32.658471 [ 65992 ] {} DiskObjectStorage(local_disk): Shutting down disk local_disk 2025.06.18 08:40:32.658495 [ 65992 ] {} DiskObjectStorage(local_disk): Disk local_disk shut down 2025.06.18 08:40:32.658525 [ 65992 ] {} Context: Shutdown disk local_cache_2 2025.06.18 08:40:32.658544 [ 65992 ] {} DiskObjectStorage(local_disk): Shutting down disk local_disk 2025.06.18 08:40:32.658562 [ 65992 ] {} DiskObjectStorage(local_disk): Disk local_disk shut down 2025.06.18 08:40:32.658578 [ 65992 ] {} Context: Shutdown disk local_cache_3 2025.06.18 08:40:32.658595 [ 65992 ] {} DiskObjectStorage(local_disk_3): Shutting down disk local_disk_3 2025.06.18 08:40:32.658617 [ 65992 ] {} DiskObjectStorage(local_disk_3): Disk local_disk_3 shut down 2025.06.18 08:40:32.658635 [ 65992 ] {} Context: Shutdown disk local_disk 2025.06.18 08:40:32.658656 [ 65992 ] {} DiskObjectStorage(local_disk): Shutting down disk local_disk 2025.06.18 08:40:32.658673 [ 65992 ] {} DiskObjectStorage(local_disk): Disk local_disk shut down 2025.06.18 08:40:32.658690 [ 65992 ] {} Context: Shutdown disk local_disk_2 2025.06.18 08:40:32.658706 [ 65992 ] {} DiskObjectStorage(local_disk_2): Shutting down disk local_disk_2 2025.06.18 08:40:32.658723 [ 65992 ] {} DiskObjectStorage(local_disk_2): Disk local_disk_2 shut down 2025.06.18 08:40:32.658739 [ 65992 ] {} Context: Shutdown disk local_disk_3 2025.06.18 08:40:32.658755 [ 65992 ] {} DiskObjectStorage(local_disk_3): Shutting down disk local_disk_3 2025.06.18 08:40:32.658771 [ 65992 ] {} DiskObjectStorage(local_disk_3): Disk local_disk_3 shut down 2025.06.18 08:40:32.658787 [ 65992 ] {} Context: Shutdown disk s3_cache 2025.06.18 08:40:32.658807 [ 65992 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2025.06.18 08:40:32.658845 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2025.06.18 08:40:32.658865 [ 65992 ] {} Context: Shutdown disk s3_cache_02933 2025.06.18 08:40:32.658885 [ 65992 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2025.06.18 08:40:32.658904 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2025.06.18 08:40:32.658920 [ 65992 ] {} Context: Shutdown disk s3_cache_02944 2025.06.18 08:40:32.658940 [ 65992 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2025.06.18 08:40:32.658962 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2025.06.18 08:40:32.658979 [ 65992 ] {} Context: Shutdown disk s3_cache_multi 2025.06.18 08:40:32.658998 [ 65992 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2025.06.18 08:40:32.659016 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2025.06.18 08:40:32.659035 [ 65992 ] {} Context: Shutdown disk s3_cache_multi_2 2025.06.18 08:40:32.659051 [ 65992 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2025.06.18 08:40:32.659069 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2025.06.18 08:40:32.659084 [ 65992 ] {} Context: Shutdown disk s3_disk 2025.06.18 08:40:32.659103 [ 65992 ] {} DiskObjectStorage(s3_disk): Shutting down disk s3_disk 2025.06.18 08:40:32.659122 [ 65992 ] {} DiskObjectStorage(s3_disk): Disk s3_disk shut down 2025.06.18 08:40:32.659141 [ 65992 ] {} Context: Shutdown disk s3_disk_02944 2025.06.18 08:40:32.659169 [ 65992 ] {} DiskObjectStorage(s3_disk_02944): Shutting down disk s3_disk_02944 2025.06.18 08:40:32.659198 [ 65992 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 shut down 2025.06.18 08:40:32.659215 [ 65992 ] {} Context: Shutdown disk s3_disk_02963 2025.06.18 08:40:32.659239 [ 65992 ] {} DiskObjectStorage(s3_disk_02963): Shutting down disk s3_disk_02963 2025.06.18 08:40:32.659267 [ 65992 ] {} DiskObjectStorage(s3_disk_02963): Disk s3_disk_02963 shut down 2025.06.18 08:40:32.659285 [ 65992 ] {} Context: Shutdown disk s3_no_cache 2025.06.18 08:40:32.659309 [ 65992 ] {} DiskObjectStorage(s3_no_cache): Shutting down disk s3_no_cache 2025.06.18 08:40:32.659334 [ 65992 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache shut down 2025.06.18 08:40:32.659351 [ 65992 ] {} Context: Shutdown disk s3_plain_disk 2025.06.18 08:40:32.659375 [ 65992 ] {} DiskObjectStorage(s3_plain_disk): Shutting down disk s3_plain_disk 2025.06.18 08:40:32.659405 [ 65992 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk shut down 2025.06.18 08:40:32.659433 [ 65992 ] {} Context: Shutting down AccessControl 2025.06.18 08:40:32.697988 [ 65992 ] {} ExternalUserDefinedExecutableFunctionsLoader: Unloading 'test_function' because its configuration has been removed or detached 2025.06.18 08:40:32.705036 [ 65992 ] {} ZooKeeperClient: Finalizing session 120. finalization_started: false, queue_finished: false, reason: 'Destructor called' 2025.06.18 08:40:32.706066 [ 65999 ] {} KeeperTCPHandler: Received close event with xid 2147483647 for session id #120 2025.06.18 08:40:32.706171 [ 66579 ] {} KeeperDispatcher: Processing requests batch, size: 1, bytes: 0 2025.06.18 08:40:32.707158 [ 66585 ] {} KeeperLogStore: Flushing 1 logs 2025.06.18 08:40:32.709240 [ 65999 ] {} KeeperTCPHandler: Session #120 successfully closed 2025.06.18 08:40:32.714041 [ 65992 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.06.18 08:40:32.718094 [ 65992 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.06.18 08:40:32.751736 [ 65992 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.06.18 08:40:32.752917 [ 65992 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.06.18 08:40:32.754566 [ 65992 ] {} Application: Shut down storages. 2025.06.18 08:40:32.754607 [ 65992 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.06.18 08:40:33.078887 [ 65992 ] {} Application: Closed all listening sockets. Waiting for 2 outstanding connections. 2025.06.18 08:40:37.986815 [ 65992 ] {} Application: Closed connections to servers for tables. But 2 remain. Probably some tables of other users cannot finish their connections after context shutdown. 2025.06.18 08:40:37.986999 [ 65992 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.06.18 08:40:38.311485 [ 66579 ] {} virtual Coordination::ZooKeeperRequest::~ZooKeeperRequest(): Processing of request xid=2147483647 took 5605 ms 2025.06.18 08:40:38.312450 [ 65992 ] {} RaftInstance: shutting down raft core 2025.06.18 08:40:38.312631 [ 65992 ] {} RaftInstance: sent stop signal to the commit thread. 2025.06.18 08:40:38.312748 [ 65992 ] {} RaftInstance: cancelled all schedulers. 2025.06.18 08:40:38.312845 [ 65992 ] {} RaftInstance: commit thread stopped. 2025.06.18 08:40:38.312931 [ 65992 ] {} RaftInstance: all pending commit elements dropped. 2025.06.18 08:40:38.312995 [ 65992 ] {} RaftInstance: reset all pointers. 2025.06.18 08:40:38.313059 [ 65992 ] {} RaftInstance: joined terminated commit thread. 2025.06.18 08:40:38.313286 [ 65992 ] {} RaftInstance: sent stop signal to background append thread. 2025.06.18 08:40:38.313362 [ 66605 ] {} RaftInstance: bg append_entries thread terminated 2025.06.18 08:40:38.313670 [ 65992 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.06.18 08:40:38.313755 [ 65992 ] {} RaftInstance: clean up auto-forwarding clients 2025.06.18 08:40:38.313856 [ 65992 ] {} RaftInstance: raft_server shutdown completed. 2025.06.18 08:40:38.313922 [ 65992 ] {} RaftInstance: manually create a snapshot on 9600 2025.06.18 08:40:38.314015 [ 65992 ] {} RaftInstance: creating a snapshot for index 9600 2025.06.18 08:40:38.314091 [ 65992 ] {} RaftInstance: create snapshot idx 9600 log_term 4 2025.06.18 08:40:38.314182 [ 65992 ] {} KeeperStateMachine: Creating snapshot 9600 2025.06.18 08:40:38.314345 [ 65992 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.06.18 08:40:38.339271 [ 65992 ] {} KeeperStateMachine: Created persistent snapshot 9600 with path snapshot_9600.bin.zstd 2025.06.18 08:40:38.339378 [ 65992 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.06.18 08:40:38.339445 [ 65992 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.06.18 08:40:38.339553 [ 65992 ] {} RaftInstance: snapshot idx 9600 log_term 4 created, compact the log store if needed 2025.06.18 08:40:38.339664 [ 65992 ] {} RaftInstance: create snapshot idx 9600 log_term 4 done: 25499 us elapsed 2025.06.18 08:40:38.340500 [ 66597 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.06.18 08:40:38.340529 [ 66588 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.06.18 08:40:38.340697 [ 66599 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.06.18 08:40:38.340502 [ 66601 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.06.18 08:40:38.340534 [ 66589 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.06.18 08:40:38.340774 [ 66598 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.06.18 08:40:38.340935 [ 66593 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.06.18 08:40:38.341073 [ 66596 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.06.18 08:40:38.341187 [ 66603 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.06.18 08:40:38.341278 [ 66600 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.06.18 08:40:38.341631 [ 66594 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.06.18 08:40:38.341641 [ 66591 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.06.18 08:40:38.341847 [ 66595 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.06.18 08:40:38.341951 [ 66602 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.06.18 08:40:38.342012 [ 66590 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.06.18 08:40:38.341756 [ 66592 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.06.18 08:40:38.342396 [ 65992 ] {} KeeperLogStore: Shutting down Changelog 2025.06.18 08:40:38.342433 [ 66585 ] {} KeeperLogStore: Flushing 0 logs 2025.06.18 08:40:38.343533 [ 65992 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.06.18 08:40:38.343765 [ 65992 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.06.18 08:40:38.343847 [ 65992 ] {} KeeperDispatcher: Dispatcher shut down 2025.06.18 08:40:41.761348 [ 65992 ] {} Context: Destructing remote fs threadpool reader 2025.06.18 08:40:41.761470 [ 65992 ] {} Context: Destructing local fs threadpool reader 2025.06.18 08:40:41.761540 [ 65992 ] {} Context: Destructing local fs threadpool reader 2025.06.18 08:40:41.761587 [ 65992 ] {} Context: Destructing threadpool writer 2025.06.18 08:40:41.761910 [ 65992 ] {} Context: Destructing marks loader 2025.06.18 08:40:41.815330 [ 65992 ] {} Application: Destroyed global context. 2025.06.18 08:40:41.816144 [ 65992 ] {} Application: Waiting for background threads 2025.06.18 08:40:41.917960 [ 65992 ] {} Application: Background threads finished in 101 ms 2025.06.18 08:40:41.918555 [ 65992 ] {} KeeperLogStore: Changelog is shut down 2025.06.18 08:40:41.918601 [ 65992 ] {} KeeperLogStore: Shutting down Changelog 2025.06.18 08:40:41.939149 [ 65992 ] {} grpc: Waiting for lifeguard thread to shut down (contrib/grpc/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:321) 2025.06.18 08:40:41.939729 [ 65992 ] {} grpc: grpc_shutdown starts clean-up now (contrib/grpc/src/core/lib/surface/init.cc:192) 2025.06.18 08:40:41.942096 [ 65992 ] {} Application: shutting down 2025.06.18 08:40:41.942150 [ 65992 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.06.18 08:40:41.953746 [ 65995 ] {} BaseDaemon: Received signal -2 2025.06.18 08:40:41.953805 [ 65995 ] {} BaseDaemon: Stop SignalListener thread 2025.06.18 08:40:42.144692 [ 65989 ] {} Application: Child process exited normally with code 0.