2025.04.02 05:19:58.692208 [ 28646 ] {} Application: Will watch for the process with pid 28648 2025.04.02 05:19:58.693732 [ 28648 ] {} Application: Forked a child process to watch 2025.04.02 05:19:58.695654 [ 28648 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:19:59.219195 [ 28648 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 28648 2025.04.02 05:19:59.220093 [ 28648 ] {} Application: starting up 2025.04.02 05:19:59.220180 [ 28648 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:19:59.252652 [ 28648 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:19:59.252894 [ 28648 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:19:59.252959 [ 28648 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:19:59.252993 [ 28648 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:19:59.253017 [ 28648 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:19:59.254602 [ 28648 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:19:59.255165 [ 28648 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:19:59.255214 [ 28648 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:19:59.255391 [ 28648 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:19:59.255441 [ 28648 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:00.100713 [ 28648 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:00.103416 [ 28648 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:00.103514 [ 28648 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:00.103737 [ 28648 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:00.104685 [ 28648 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:00.274026 [ 28658 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:00.274367 [ 28648 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:00.274474 [ 28648 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:00.274534 [ 28648 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:00.274584 [ 28648 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:00.274873 [ 28648 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:00.275354 [ 28648 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:00.292852 [ 28648 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:00.293021 [ 28648 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:00.293425 [ 28648 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:00.294033 [ 28648 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:00.294172 [ 28648 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:00.295423 [ 28648 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:00.301827 [ 28648 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:00.301904 [ 28648 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:00.302013 [ 28648 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:00.302521 [ 28648 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:00.314091 [ 28648 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:00.314193 [ 28648 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:00.322323 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:00.323449 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:00.323857 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:00.324343 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:00.324753 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:00.329357 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:00.329810 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:00.330221 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:00.330626 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:00.330978 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:00.331434 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:00.331767 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:00.332112 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:00.332456 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:00.332945 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:00.333280 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:00.333647 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:00.334000 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:00.334455 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:00.334836 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:00.335220 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:00.335609 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:00.336320 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:00.337402 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:00.337742 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:00.338781 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:00.339949 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:00.340363 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:00.340699 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:00.341092 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:00.341543 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:00.341955 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:00.342469 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:00.342834 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:00.343303 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:00.343664 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:00.344140 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:00.344680 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:00.345124 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:00.346339 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:00.347023 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:00.347443 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:00.347950 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:00.348430 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:00.348860 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:00.349411 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:00.349865 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:00.350341 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:00.350832 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:00.353374 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:00.354156 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:00.355171 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:00.355809 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:00.356212 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:00.356609 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:00.357309 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:00.357763 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:00.358354 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:00.358767 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:00.359213 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:00.359635 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:00.360327 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:00.360764 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:00.361285 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:00.361964 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:00.362482 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:00.364307 [ 28648 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:00.411502 [ 28648 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:00.413381 [ 28648 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:00.448560 [ 28648 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:00.448650 [ 28648 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:00.448688 [ 28648 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:00.463790 [ 28648 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:00.463853 [ 28648 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:00.463916 [ 28648 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:00.464046 [ 28648 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:00.469985 [ 28648 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:00.476690 [ 28648 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:00.489625 [ 28648 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:00.490098 [ 28648 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:00.490274 [ 28648 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:00.493090 [ 28648 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:00.493834 [ 28648 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:00.494158 [ 28648 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:00.495282 [ 28648 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:00.495356 [ 28648 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:00.496823 [ 28648 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:00.496863 [ 28648 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:00.496887 [ 28648 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:00.496929 [ 28648 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:00.496951 [ 28648 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:00.497119 [ 28648 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:00.497197 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.574272 [ 28648 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:00.585279 [ 28648 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:00.585377 [ 28648 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:00.586435 [ 28648 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:00.586583 [ 28648 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg 2025.04.02 05:20:00.586651 [ 28648 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg 2025.04.02 05:20:00.586701 [ 28648 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg, size 4 2025.04.02 05:20:00.587239 [ 28648 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg. 2025.04.02 05:20:00.587401 [ 29229 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg 2025.04.02 05:20:00.594139 [ 29229 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg, size 4 2025.04.02 05:20:00.594815 [ 28648 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg. 2025.04.02 05:20:00.595145 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.598068 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.598161 [ 28648 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg, Version: Latest, Offset: 2 2025.04.02 05:20:00.603270 [ 28648 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg 2025.04.02 05:20:00.603340 [ 28648 ] {} deleteFileFromS3: Object with path s3/mgx/fsbeuwymrxivoupoyhakxvegbftfg was removed from S3 2025.04.02 05:20:00.603396 [ 28648 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:00.603450 [ 28648 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:00.606608 [ 28648 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:00.618310 [ 28648 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:00.618456 [ 28648 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:00.619346 [ 28648 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:00.630117 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.634588 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.634699 [ 28648 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:00.640171 [ 28648 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:00.640424 [ 28648 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:00 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326238854A0B7E x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:00.640577 [ 28648 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:00.645162 [ 28648 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:00.645220 [ 28648 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:00.645295 [ 28648 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:00.645346 [ 28648 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:00.645474 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.645554 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.645619 [ 28648 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:00.645678 [ 28648 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:00.645755 [ 28648 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:00.645814 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.645870 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.645929 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.645993 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.646057 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.649132 [ 28648 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:00.659899 [ 28648 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:00.660018 [ 28648 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:00.660987 [ 28648 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:00.668360 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/grg/lltcdewluenszueuojpvxvuodjzdk (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.671020 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/grg/lltcdewluenszueuojpvxvuodjzdk (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.671098 [ 28648 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/grg/lltcdewluenszueuojpvxvuodjzdk, Version: Latest, Offset: 2 2025.04.02 05:20:00.675746 [ 28648 ] {} deleteFileFromS3: No blob storage log, not writing blob special/grg/lltcdewluenszueuojpvxvuodjzdk 2025.04.02 05:20:00.675812 [ 28648 ] {} deleteFileFromS3: Object with path special/grg/lltcdewluenszueuojpvxvuodjzdk was removed from S3 2025.04.02 05:20:00.675857 [ 28648 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:00.675896 [ 28648 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:00.679208 [ 28648 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:00.689439 [ 28648 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:00.689539 [ 28648 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:00.690347 [ 28648 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:00.697219 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/wir/pvxuenlgexgeaxxhhmwzhrlypkyeu (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.699977 [ 28648 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/wir/pvxuenlgexgeaxxhhmwzhrlypkyeu (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:00.700058 [ 28648 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/wir/pvxuenlgexgeaxxhhmwzhrlypkyeu, Version: Latest, Offset: 2 2025.04.02 05:20:00.704826 [ 28648 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/wir/pvxuenlgexgeaxxhhmwzhrlypkyeu 2025.04.02 05:20:00.704888 [ 28648 ] {} deleteFileFromS3: Object with path test_02944/wir/pvxuenlgexgeaxxhhmwzhrlypkyeu was removed from S3 2025.04.02 05:20:00.704941 [ 28648 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:00.704978 [ 28648 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:00.705126 [ 28648 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:00.708582 [ 28648 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:00.712765 [ 28648 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:00.712877 [ 28648 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:00.714587 [ 28648 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:00.714773 [ 28648 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:00.715882 [ 28648 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:00.715948 [ 28648 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:00.715989 [ 28648 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:00.716023 [ 28648 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:00.716058 [ 28648 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:00.716689 [ 28648 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 36 entries 2025.04.02 05:20:00.716761 [ 28648 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:00.716868 [ 28648 ] {} KeeperServer: Last local log idx 36 2025.04.02 05:20:00.716919 [ 28648 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 36 2025.04.02 05:20:00.718098 [ 28648 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:00.730884 [ 28648 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:00.731429 [ 28648 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:00.731565 [ 28648 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:00.731639 [ 28648 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:00.731734 [ 28648 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:00.731798 [ 28648 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:00.731906 [ 28648 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 36 election timer allowed log store start 1, end 36 config log idx 36, prev log idx 35 -- ASYNC REPLICATION -- 2025.04.02 05:20:00.731969 [ 28648 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:00.732056 [ 28648 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:00.732131 [ 28648 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:00.735532 [ 28648 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:00.735612 [ 29256 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:00.786127 [ 29239 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:00.786368 [ 29239 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:00.786520 [ 29239 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 36, state term 36, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:00.786574 [ 28648 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:00.786600 [ 29239 ] {} RaftInstance: pre-vote term (0) is different, reset it to 36 2025.04.02 05:20:00.786985 [ 29239 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:00.790066 [ 29239 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 37, log idx 36, log term 36, priority (target 1 / mine 1) 2025.04.02 05:20:00.790147 [ 29239 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:00.790207 [ 29239 ] {} RaftInstance: state machine commit index 0, precommit index 36, last log index 36 2025.04.02 05:20:00.790293 [ 29239 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:00.790661 [ 29237 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:00.790833 [ 29239 ] {} RaftInstance: [BECOME LEADER] appended new config at 37 2025.04.02 05:20:00.791118 [ 29255 ] {} RaftInstance: config at index 1 is committed, prev config log idx 36 2025.04.02 05:20:00.791198 [ 29255 ] {} RaftInstance: skipped config 1, latest config 36 2025.04.02 05:20:00.791340 [ 29255 ] {} RaftInstance: config at index 2 is committed, prev config log idx 36 2025.04.02 05:20:00.791379 [ 29255 ] {} RaftInstance: skipped config 2, latest config 36 2025.04.02 05:20:00.791445 [ 29255 ] {} RaftInstance: config at index 3 is committed, prev config log idx 36 2025.04.02 05:20:00.791484 [ 29255 ] {} RaftInstance: skipped config 3, latest config 36 2025.04.02 05:20:00.791543 [ 29255 ] {} RaftInstance: config at index 4 is committed, prev config log idx 36 2025.04.02 05:20:00.791575 [ 29255 ] {} RaftInstance: skipped config 4, latest config 36 2025.04.02 05:20:00.791665 [ 29255 ] {} RaftInstance: config at index 5 is committed, prev config log idx 36 2025.04.02 05:20:00.791698 [ 29255 ] {} RaftInstance: skipped config 5, latest config 36 2025.04.02 05:20:00.791759 [ 29255 ] {} RaftInstance: config at index 6 is committed, prev config log idx 36 2025.04.02 05:20:00.791789 [ 29255 ] {} RaftInstance: skipped config 6, latest config 36 2025.04.02 05:20:00.791847 [ 29255 ] {} RaftInstance: config at index 7 is committed, prev config log idx 36 2025.04.02 05:20:00.791877 [ 29255 ] {} RaftInstance: skipped config 7, latest config 36 2025.04.02 05:20:00.791938 [ 29255 ] {} RaftInstance: config at index 8 is committed, prev config log idx 36 2025.04.02 05:20:00.791985 [ 29255 ] {} RaftInstance: skipped config 8, latest config 36 2025.04.02 05:20:00.792047 [ 29255 ] {} RaftInstance: config at index 9 is committed, prev config log idx 36 2025.04.02 05:20:00.792075 [ 29255 ] {} RaftInstance: skipped config 9, latest config 36 2025.04.02 05:20:00.792131 [ 29255 ] {} RaftInstance: config at index 10 is committed, prev config log idx 36 2025.04.02 05:20:00.792160 [ 29255 ] {} RaftInstance: skipped config 10, latest config 36 2025.04.02 05:20:00.792220 [ 29255 ] {} RaftInstance: config at index 11 is committed, prev config log idx 36 2025.04.02 05:20:00.792270 [ 29255 ] {} RaftInstance: skipped config 11, latest config 36 2025.04.02 05:20:00.792330 [ 29255 ] {} RaftInstance: config at index 12 is committed, prev config log idx 36 2025.04.02 05:20:00.792359 [ 29255 ] {} RaftInstance: skipped config 12, latest config 36 2025.04.02 05:20:00.792415 [ 29255 ] {} RaftInstance: config at index 13 is committed, prev config log idx 36 2025.04.02 05:20:00.792457 [ 29255 ] {} RaftInstance: skipped config 13, latest config 36 2025.04.02 05:20:00.792514 [ 29255 ] {} RaftInstance: config at index 14 is committed, prev config log idx 36 2025.04.02 05:20:00.792544 [ 29255 ] {} RaftInstance: skipped config 14, latest config 36 2025.04.02 05:20:00.792605 [ 29255 ] {} RaftInstance: config at index 15 is committed, prev config log idx 36 2025.04.02 05:20:00.792633 [ 29255 ] {} RaftInstance: skipped config 15, latest config 36 2025.04.02 05:20:00.792701 [ 29255 ] {} RaftInstance: config at index 16 is committed, prev config log idx 36 2025.04.02 05:20:00.792731 [ 29255 ] {} RaftInstance: skipped config 16, latest config 36 2025.04.02 05:20:00.792782 [ 29255 ] {} RaftInstance: config at index 17 is committed, prev config log idx 36 2025.04.02 05:20:00.792810 [ 29255 ] {} RaftInstance: skipped config 17, latest config 36 2025.04.02 05:20:00.792863 [ 29255 ] {} RaftInstance: config at index 18 is committed, prev config log idx 36 2025.04.02 05:20:00.792895 [ 29255 ] {} RaftInstance: skipped config 18, latest config 36 2025.04.02 05:20:00.792948 [ 29255 ] {} RaftInstance: config at index 19 is committed, prev config log idx 36 2025.04.02 05:20:00.792978 [ 29255 ] {} RaftInstance: skipped config 19, latest config 36 2025.04.02 05:20:00.793030 [ 29255 ] {} RaftInstance: config at index 20 is committed, prev config log idx 36 2025.04.02 05:20:00.793058 [ 29255 ] {} RaftInstance: skipped config 20, latest config 36 2025.04.02 05:20:00.793115 [ 29255 ] {} RaftInstance: config at index 21 is committed, prev config log idx 36 2025.04.02 05:20:00.793144 [ 29255 ] {} RaftInstance: skipped config 21, latest config 36 2025.04.02 05:20:00.793201 [ 29255 ] {} RaftInstance: config at index 22 is committed, prev config log idx 36 2025.04.02 05:20:00.793238 [ 29255 ] {} RaftInstance: skipped config 22, latest config 36 2025.04.02 05:20:00.793327 [ 29255 ] {} RaftInstance: config at index 23 is committed, prev config log idx 36 2025.04.02 05:20:00.793363 [ 29255 ] {} RaftInstance: skipped config 23, latest config 36 2025.04.02 05:20:00.793425 [ 29255 ] {} RaftInstance: config at index 24 is committed, prev config log idx 36 2025.04.02 05:20:00.793454 [ 29255 ] {} RaftInstance: skipped config 24, latest config 36 2025.04.02 05:20:00.793506 [ 29255 ] {} RaftInstance: config at index 25 is committed, prev config log idx 36 2025.04.02 05:20:00.793539 [ 29255 ] {} RaftInstance: skipped config 25, latest config 36 2025.04.02 05:20:00.793592 [ 29255 ] {} RaftInstance: config at index 26 is committed, prev config log idx 36 2025.04.02 05:20:00.793619 [ 29255 ] {} RaftInstance: skipped config 26, latest config 36 2025.04.02 05:20:00.793670 [ 29255 ] {} RaftInstance: config at index 27 is committed, prev config log idx 36 2025.04.02 05:20:00.793700 [ 29255 ] {} RaftInstance: skipped config 27, latest config 36 2025.04.02 05:20:00.793755 [ 29255 ] {} RaftInstance: config at index 28 is committed, prev config log idx 36 2025.04.02 05:20:00.793786 [ 29255 ] {} RaftInstance: skipped config 28, latest config 36 2025.04.02 05:20:00.793844 [ 29255 ] {} RaftInstance: config at index 29 is committed, prev config log idx 36 2025.04.02 05:20:00.793874 [ 29255 ] {} RaftInstance: skipped config 29, latest config 36 2025.04.02 05:20:00.793925 [ 29255 ] {} RaftInstance: config at index 30 is committed, prev config log idx 36 2025.04.02 05:20:00.793957 [ 29255 ] {} RaftInstance: skipped config 30, latest config 36 2025.04.02 05:20:00.794032 [ 29255 ] {} RaftInstance: config at index 31 is committed, prev config log idx 36 2025.04.02 05:20:00.794092 [ 29255 ] {} RaftInstance: skipped config 31, latest config 36 2025.04.02 05:20:00.794164 [ 29255 ] {} RaftInstance: config at index 32 is committed, prev config log idx 36 2025.04.02 05:20:00.794193 [ 29255 ] {} RaftInstance: skipped config 32, latest config 36 2025.04.02 05:20:00.794263 [ 29255 ] {} RaftInstance: config at index 33 is committed, prev config log idx 36 2025.04.02 05:20:00.794295 [ 29255 ] {} RaftInstance: skipped config 33, latest config 36 2025.04.02 05:20:00.794346 [ 29255 ] {} RaftInstance: config at index 34 is committed, prev config log idx 36 2025.04.02 05:20:00.794373 [ 29255 ] {} RaftInstance: skipped config 34, latest config 36 2025.04.02 05:20:00.794460 [ 29255 ] {} RaftInstance: config at index 35 is committed, prev config log idx 36 2025.04.02 05:20:00.794493 [ 29255 ] {} RaftInstance: skipped config 35, latest config 36 2025.04.02 05:20:00.794544 [ 29255 ] {} RaftInstance: config at index 36 is committed, prev config log idx 36 2025.04.02 05:20:00.794574 [ 29255 ] {} RaftInstance: skipped config 36, latest config 36 2025.04.02 05:20:00.794640 [ 29255 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:00.794678 [ 29255 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:00.794728 [ 29255 ] {} RaftInstance: config at index 37 is committed, prev config log idx 36 2025.04.02 05:20:00.794779 [ 29255 ] {} RaftInstance: new config log idx 37, prev log idx 36, cur config log idx 36, prev log idx 35 2025.04.02 05:20:00.794874 [ 29255 ] {} RaftInstance: new configuration: log idx 37, prev log idx 36 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 37 2025.04.02 05:20:00.795054 [ 28648 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:00.795900 [ 28648 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:00.797933 [ 28648 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:00.798309 [ 28648 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:00.813610 [ 28648 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:00.813745 [ 28648 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:00.815145 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:00.815641 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:00.816287 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:00.816607 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:00.816902 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:00.817161 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:00.817441 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:00.817719 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:00.821856 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:00.822425 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:00.822882 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:00.823393 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:00.823880 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:00.824365 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:00.824797 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:00.825344 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:00.825887 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:00.826500 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:00.826961 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:00.827473 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:00.827937 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:00.828583 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:00.829649 [ 28648 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:00.841359 [ 28648 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:00.841764 [ 28648 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:00.852016 [ 28648 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:00.852182 [ 28648 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:00.857001 [ 28648 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:00.859052 [ 28648 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:00.859922 [ 28648 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:00.860386 [ 29261 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:00.868951 [ 28648 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:00.872068 [ 28648 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:00.877855 [ 28648 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:00.880547 [ 28648 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:00.886056 [ 28648 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:00.888189 [ 28648 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:00.889660 [ 28648 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:00.890844 [ 28648 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:00.890934 [ 28648 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:00.891070 [ 28659 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:00.892158 [ 28659 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:05.199556 [ 28648 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:05.199976 [ 28648 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:05.200358 [ 28648 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:05.200423 [ 28648 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:05.200571 [ 28658 ] {} CancellationChecker: Execution took 4926 ms. 2025.04.02 05:20:05.200824 [ 28648 ] {} Application: Shutting down storages. 2025.04.02 05:20:05.200872 [ 28648 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:05.202066 [ 28648 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:05.202118 [ 28648 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:05.202145 [ 28648 ] {} Context: Shutting down named sessions 2025.04.02 05:20:05.202206 [ 28648 ] {} Context: Shutting down database catalog 2025.04.02 05:20:05.202241 [ 28648 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:05.202313 [ 28648 ] {} Context: Shutting down merges executor 2025.04.02 05:20:05.202858 [ 28648 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:05.203342 [ 28648 ] {} Context: Shutting down moves executor 2025.04.02 05:20:05.203536 [ 28648 ] {} Context: Shutting down common executor 2025.04.02 05:20:05.203760 [ 28648 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:05.203785 [ 28648 ] {} Context: Shutting down caches 2025.04.02 05:20:05.203821 [ 28648 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:05.204060 [ 28648 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:05.206423 [ 28648 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:05.218276 [ 28648 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:05.218626 [ 28648 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:05.219162 [ 28648 ] {} Application: Shut down storages. 2025.04.02 05:20:05.219213 [ 28648 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:05.304236 [ 28648 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:05.304378 [ 28648 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:05.304430 [ 28648 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:05.797979 [ 28648 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:05.798121 [ 28648 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:05.798989 [ 28648 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:05.799054 [ 28648 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:05.799106 [ 28648 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:05.799164 [ 28648 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:05.799214 [ 28648 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:05.799368 [ 28648 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:05.799396 [ 29256 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:05.799613 [ 28648 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:05.799701 [ 28648 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:05.799760 [ 28648 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:05.800111 [ 29242 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:20:05.800486 [ 29253 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:20:05.800442 [ 29240 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:05.800559 [ 29250 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:20:05.800479 [ 29241 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:05.800747 [ 29239 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:05.800662 [ 29242 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:05.800603 [ 29244 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:05.800611 [ 29247 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:05.800925 [ 29252 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:05.800926 [ 29245 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:05.800624 [ 29248 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:05.800644 [ 29246 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:05.800648 [ 29251 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:05.800883 [ 29243 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:20:05.800913 [ 29249 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:05.800865 [ 29254 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:05.801538 [ 28648 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:05.801591 [ 29237 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:05.801726 [ 29238 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:20:05.802322 [ 28648 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:05.802455 [ 28648 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:05.802493 [ 28648 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:05.802555 [ 28648 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:05.802615 [ 28648 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:05.802760 [ 28648 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:05.802809 [ 28648 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:05.806346 [ 28648 ] {} Application: Destroyed global context. 2025.04.02 05:20:05.806883 [ 28648 ] {} Application: Waiting for background threads 2025.04.02 05:20:05.872580 [ 28648 ] {} Application: Background threads finished in 65 ms 2025.04.02 05:20:05.873103 [ 28648 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:05.873155 [ 28648 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:05.885982 [ 28648 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:05.886283 [ 28648 ] {} Application: shutting down 2025.04.02 05:20:05.886322 [ 28648 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:05.893364 [ 28651 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:05.893464 [ 28651 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:05.977718 [ 28646 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:06.378783 [ 29368 ] {} Application: Will watch for the process with pid 29370 2025.04.02 05:20:06.379600 [ 29370 ] {} Application: Forked a child process to watch 2025.04.02 05:20:06.380605 [ 29370 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:06.914780 [ 29370 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 29370 2025.04.02 05:20:06.915707 [ 29370 ] {} Application: starting up 2025.04.02 05:20:06.915791 [ 29370 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:06.950076 [ 29370 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:06.950356 [ 29370 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:06.950452 [ 29370 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:06.950493 [ 29370 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:06.950520 [ 29370 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:06.952065 [ 29370 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:06.952548 [ 29370 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:06.952598 [ 29370 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:06.952762 [ 29370 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:06.952811 [ 29370 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:07.799686 [ 29370 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:07.801965 [ 29370 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:07.802040 [ 29370 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:07.802196 [ 29370 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:07.802891 [ 29370 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:07.967570 [ 29380 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:07.967981 [ 29370 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:07.968066 [ 29370 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:07.968126 [ 29370 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:07.968168 [ 29370 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:07.968482 [ 29370 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:07.969001 [ 29370 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:07.987114 [ 29370 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:07.987292 [ 29370 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:07.987680 [ 29370 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:07.988313 [ 29370 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:07.988422 [ 29370 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:07.989569 [ 29370 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:07.995084 [ 29370 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:07.995147 [ 29370 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:07.995249 [ 29370 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:07.995701 [ 29370 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:08.007643 [ 29370 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:08.007744 [ 29370 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:08.016305 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:08.017488 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:08.017920 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:08.018512 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:08.018981 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:08.023786 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:08.024372 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:08.024788 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:08.025169 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:08.025529 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:08.025997 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:08.026345 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:08.026727 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:08.027055 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:08.027645 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:08.027980 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:08.028364 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:08.028720 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:08.029116 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:08.029492 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:08.029867 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:08.030236 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:08.030985 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:08.032077 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:08.032426 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:08.033428 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:08.034733 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:08.035143 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:08.035539 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:08.035910 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:08.036299 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:08.036740 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:08.037280 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:08.037736 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:08.038316 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:08.038750 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:08.039277 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:08.039802 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:08.040238 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:08.041491 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:08.042140 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:08.042582 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:08.043031 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:08.043475 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:08.043921 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:08.044502 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:08.044917 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:08.045436 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:08.045910 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:08.048552 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:08.049438 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:08.050579 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:08.051291 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:08.051730 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:08.052136 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:08.052864 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:08.053378 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:08.053985 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:08.054508 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:08.054981 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:08.055417 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:08.056107 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:08.056570 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:08.057151 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:08.057866 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:08.058367 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:08.060226 [ 29370 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:08.108984 [ 29370 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:08.111297 [ 29370 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:08.148894 [ 29370 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:08.149000 [ 29370 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:08.149043 [ 29370 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:08.164694 [ 29370 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:08.164766 [ 29370 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:08.164818 [ 29370 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:08.164950 [ 29370 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:08.170984 [ 29370 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:08.176745 [ 29370 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:08.188876 [ 29370 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:08.189293 [ 29370 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:08.189442 [ 29370 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:08.191807 [ 29370 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:08.192485 [ 29370 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:08.192772 [ 29370 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:08.193867 [ 29370 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:08.193933 [ 29370 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:08.195486 [ 29370 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:08.195536 [ 29370 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:08.195560 [ 29370 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:08.195601 [ 29370 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:08.195625 [ 29370 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:08.195797 [ 29370 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:08.195857 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.266311 [ 29370 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:08.276214 [ 29370 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:08.276340 [ 29370 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:08.277305 [ 29370 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:08.277448 [ 29370 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz 2025.04.02 05:20:08.277515 [ 29370 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz 2025.04.02 05:20:08.277563 [ 29370 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz, size 4 2025.04.02 05:20:08.278065 [ 29370 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz. 2025.04.02 05:20:08.278219 [ 29951 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz 2025.04.02 05:20:08.284774 [ 29951 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz, size 4 2025.04.02 05:20:08.285430 [ 29370 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz. 2025.04.02 05:20:08.285731 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.288596 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.288678 [ 29370 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz, Version: Latest, Offset: 2 2025.04.02 05:20:08.293899 [ 29370 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz 2025.04.02 05:20:08.293975 [ 29370 ] {} deleteFileFromS3: Object with path s3/msr/nwclcqklrlwkxqnllnmpchbrzncdz was removed from S3 2025.04.02 05:20:08.294051 [ 29370 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:08.294108 [ 29370 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:08.297110 [ 29370 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:08.306821 [ 29370 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:08.306910 [ 29370 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:08.307478 [ 29370 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:08.316595 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.321065 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.321151 [ 29370 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:08.327120 [ 29370 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:08.327339 [ 29370 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:08 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832623A4F76F84A x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:08.327484 [ 29370 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:08.331955 [ 29370 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:08.332011 [ 29370 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:08.332078 [ 29370 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:08.332130 [ 29370 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:08.332274 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.332351 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.332412 [ 29370 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:08.332465 [ 29370 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:08.332538 [ 29370 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:08.332593 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.332643 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.332698 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.332759 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.332818 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.335800 [ 29370 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:08.345958 [ 29370 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:08.346037 [ 29370 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:08.346882 [ 29370 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:08.353600 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ajy/zonbyfhgzrfdiriqaazsujqnquumj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.356507 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ajy/zonbyfhgzrfdiriqaazsujqnquumj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.356601 [ 29370 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ajy/zonbyfhgzrfdiriqaazsujqnquumj, Version: Latest, Offset: 2 2025.04.02 05:20:08.361585 [ 29370 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ajy/zonbyfhgzrfdiriqaazsujqnquumj 2025.04.02 05:20:08.361655 [ 29370 ] {} deleteFileFromS3: Object with path special/ajy/zonbyfhgzrfdiriqaazsujqnquumj was removed from S3 2025.04.02 05:20:08.361701 [ 29370 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:08.361735 [ 29370 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:08.364901 [ 29370 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:08.375077 [ 29370 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:08.375175 [ 29370 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:08.376086 [ 29370 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:08.383159 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dsh/svkldgszbzhgpcibwvpcmgdxhbaep (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.386074 [ 29370 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dsh/svkldgszbzhgpcibwvpcmgdxhbaep (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:08.386150 [ 29370 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/dsh/svkldgszbzhgpcibwvpcmgdxhbaep, Version: Latest, Offset: 2 2025.04.02 05:20:08.391464 [ 29370 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/dsh/svkldgszbzhgpcibwvpcmgdxhbaep 2025.04.02 05:20:08.391543 [ 29370 ] {} deleteFileFromS3: Object with path test_02944/dsh/svkldgszbzhgpcibwvpcmgdxhbaep was removed from S3 2025.04.02 05:20:08.391605 [ 29370 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:08.391645 [ 29370 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:08.391786 [ 29370 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:08.395353 [ 29370 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:08.399734 [ 29370 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:08.399846 [ 29370 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:08.401523 [ 29370 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:08.401712 [ 29370 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:08.402958 [ 29370 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:08.403015 [ 29370 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:08.403053 [ 29370 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:08.403122 [ 29370 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:08.403162 [ 29370 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:08.403843 [ 29370 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 37 entries 2025.04.02 05:20:08.403912 [ 29370 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:08.404045 [ 29370 ] {} KeeperServer: Last local log idx 37 2025.04.02 05:20:08.404099 [ 29370 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 37 2025.04.02 05:20:08.405304 [ 29370 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:08.416685 [ 29370 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:08.417117 [ 29370 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:08.417225 [ 29370 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:08.417297 [ 29370 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:08.417374 [ 29370 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:08.417416 [ 29370 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:08.417517 [ 29370 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 37 election timer allowed log store start 1, end 37 config log idx 37, prev log idx 36 -- ASYNC REPLICATION -- 2025.04.02 05:20:08.417566 [ 29370 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:08.417631 [ 29370 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:08.417689 [ 29370 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:08.418344 [ 29370 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:08.418467 [ 29978 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:08.468852 [ 29961 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:08.469060 [ 29961 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:08.469189 [ 29961 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 37, state term 37, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:08.469280 [ 29961 ] {} RaftInstance: pre-vote term (0) is different, reset it to 37 2025.04.02 05:20:08.469499 [ 29370 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:08.469622 [ 29961 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:08.473275 [ 29961 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 38, log idx 37, log term 37, priority (target 1 / mine 1) 2025.04.02 05:20:08.473373 [ 29961 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:08.473454 [ 29961 ] {} RaftInstance: state machine commit index 0, precommit index 37, last log index 37 2025.04.02 05:20:08.473522 [ 29961 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:08.473877 [ 29959 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:08.474069 [ 29961 ] {} RaftInstance: [BECOME LEADER] appended new config at 38 2025.04.02 05:20:08.474531 [ 29977 ] {} RaftInstance: config at index 1 is committed, prev config log idx 37 2025.04.02 05:20:08.474626 [ 29977 ] {} RaftInstance: skipped config 1, latest config 37 2025.04.02 05:20:08.474763 [ 29977 ] {} RaftInstance: config at index 2 is committed, prev config log idx 37 2025.04.02 05:20:08.474808 [ 29977 ] {} RaftInstance: skipped config 2, latest config 37 2025.04.02 05:20:08.474898 [ 29977 ] {} RaftInstance: config at index 3 is committed, prev config log idx 37 2025.04.02 05:20:08.474943 [ 29977 ] {} RaftInstance: skipped config 3, latest config 37 2025.04.02 05:20:08.475004 [ 29977 ] {} RaftInstance: config at index 4 is committed, prev config log idx 37 2025.04.02 05:20:08.475034 [ 29977 ] {} RaftInstance: skipped config 4, latest config 37 2025.04.02 05:20:08.475089 [ 29977 ] {} RaftInstance: config at index 5 is committed, prev config log idx 37 2025.04.02 05:20:08.475117 [ 29977 ] {} RaftInstance: skipped config 5, latest config 37 2025.04.02 05:20:08.475174 [ 29977 ] {} RaftInstance: config at index 6 is committed, prev config log idx 37 2025.04.02 05:20:08.475201 [ 29977 ] {} RaftInstance: skipped config 6, latest config 37 2025.04.02 05:20:08.475276 [ 29977 ] {} RaftInstance: config at index 7 is committed, prev config log idx 37 2025.04.02 05:20:08.475310 [ 29977 ] {} RaftInstance: skipped config 7, latest config 37 2025.04.02 05:20:08.475366 [ 29977 ] {} RaftInstance: config at index 8 is committed, prev config log idx 37 2025.04.02 05:20:08.475410 [ 29977 ] {} RaftInstance: skipped config 8, latest config 37 2025.04.02 05:20:08.475466 [ 29977 ] {} RaftInstance: config at index 9 is committed, prev config log idx 37 2025.04.02 05:20:08.475493 [ 29977 ] {} RaftInstance: skipped config 9, latest config 37 2025.04.02 05:20:08.475546 [ 29977 ] {} RaftInstance: config at index 10 is committed, prev config log idx 37 2025.04.02 05:20:08.475575 [ 29977 ] {} RaftInstance: skipped config 10, latest config 37 2025.04.02 05:20:08.475632 [ 29977 ] {} RaftInstance: config at index 11 is committed, prev config log idx 37 2025.04.02 05:20:08.475660 [ 29977 ] {} RaftInstance: skipped config 11, latest config 37 2025.04.02 05:20:08.475713 [ 29977 ] {} RaftInstance: config at index 12 is committed, prev config log idx 37 2025.04.02 05:20:08.475739 [ 29977 ] {} RaftInstance: skipped config 12, latest config 37 2025.04.02 05:20:08.475805 [ 29977 ] {} RaftInstance: config at index 13 is committed, prev config log idx 37 2025.04.02 05:20:08.475839 [ 29977 ] {} RaftInstance: skipped config 13, latest config 37 2025.04.02 05:20:08.475891 [ 29977 ] {} RaftInstance: config at index 14 is committed, prev config log idx 37 2025.04.02 05:20:08.475922 [ 29977 ] {} RaftInstance: skipped config 14, latest config 37 2025.04.02 05:20:08.475980 [ 29977 ] {} RaftInstance: config at index 15 is committed, prev config log idx 37 2025.04.02 05:20:08.476006 [ 29977 ] {} RaftInstance: skipped config 15, latest config 37 2025.04.02 05:20:08.476092 [ 29977 ] {} RaftInstance: config at index 16 is committed, prev config log idx 37 2025.04.02 05:20:08.476123 [ 29977 ] {} RaftInstance: skipped config 16, latest config 37 2025.04.02 05:20:08.476168 [ 29977 ] {} RaftInstance: config at index 17 is committed, prev config log idx 37 2025.04.02 05:20:08.476192 [ 29977 ] {} RaftInstance: skipped config 17, latest config 37 2025.04.02 05:20:08.476236 [ 29977 ] {} RaftInstance: config at index 18 is committed, prev config log idx 37 2025.04.02 05:20:08.476280 [ 29977 ] {} RaftInstance: skipped config 18, latest config 37 2025.04.02 05:20:08.476327 [ 29977 ] {} RaftInstance: config at index 19 is committed, prev config log idx 37 2025.04.02 05:20:08.476350 [ 29977 ] {} RaftInstance: skipped config 19, latest config 37 2025.04.02 05:20:08.476391 [ 29977 ] {} RaftInstance: config at index 20 is committed, prev config log idx 37 2025.04.02 05:20:08.476420 [ 29977 ] {} RaftInstance: skipped config 20, latest config 37 2025.04.02 05:20:08.476473 [ 29977 ] {} RaftInstance: config at index 21 is committed, prev config log idx 37 2025.04.02 05:20:08.476496 [ 29977 ] {} RaftInstance: skipped config 21, latest config 37 2025.04.02 05:20:08.476540 [ 29977 ] {} RaftInstance: config at index 22 is committed, prev config log idx 37 2025.04.02 05:20:08.476564 [ 29977 ] {} RaftInstance: skipped config 22, latest config 37 2025.04.02 05:20:08.476607 [ 29977 ] {} RaftInstance: config at index 23 is committed, prev config log idx 37 2025.04.02 05:20:08.476634 [ 29977 ] {} RaftInstance: skipped config 23, latest config 37 2025.04.02 05:20:08.476696 [ 29977 ] {} RaftInstance: config at index 24 is committed, prev config log idx 37 2025.04.02 05:20:08.476722 [ 29977 ] {} RaftInstance: skipped config 24, latest config 37 2025.04.02 05:20:08.476765 [ 29977 ] {} RaftInstance: config at index 25 is committed, prev config log idx 37 2025.04.02 05:20:08.476821 [ 29977 ] {} RaftInstance: skipped config 25, latest config 37 2025.04.02 05:20:08.476877 [ 29977 ] {} RaftInstance: config at index 26 is committed, prev config log idx 37 2025.04.02 05:20:08.476926 [ 29977 ] {} RaftInstance: skipped config 26, latest config 37 2025.04.02 05:20:08.476973 [ 29977 ] {} RaftInstance: config at index 27 is committed, prev config log idx 37 2025.04.02 05:20:08.476997 [ 29977 ] {} RaftInstance: skipped config 27, latest config 37 2025.04.02 05:20:08.477045 [ 29977 ] {} RaftInstance: config at index 28 is committed, prev config log idx 37 2025.04.02 05:20:08.477069 [ 29977 ] {} RaftInstance: skipped config 28, latest config 37 2025.04.02 05:20:08.477118 [ 29977 ] {} RaftInstance: config at index 29 is committed, prev config log idx 37 2025.04.02 05:20:08.477143 [ 29977 ] {} RaftInstance: skipped config 29, latest config 37 2025.04.02 05:20:08.477185 [ 29977 ] {} RaftInstance: config at index 30 is committed, prev config log idx 37 2025.04.02 05:20:08.477210 [ 29977 ] {} RaftInstance: skipped config 30, latest config 37 2025.04.02 05:20:08.477271 [ 29977 ] {} RaftInstance: config at index 31 is committed, prev config log idx 37 2025.04.02 05:20:08.477301 [ 29977 ] {} RaftInstance: skipped config 31, latest config 37 2025.04.02 05:20:08.477349 [ 29977 ] {} RaftInstance: config at index 32 is committed, prev config log idx 37 2025.04.02 05:20:08.477372 [ 29977 ] {} RaftInstance: skipped config 32, latest config 37 2025.04.02 05:20:08.477418 [ 29977 ] {} RaftInstance: config at index 33 is committed, prev config log idx 37 2025.04.02 05:20:08.477442 [ 29977 ] {} RaftInstance: skipped config 33, latest config 37 2025.04.02 05:20:08.477483 [ 29977 ] {} RaftInstance: config at index 34 is committed, prev config log idx 37 2025.04.02 05:20:08.477522 [ 29977 ] {} RaftInstance: skipped config 34, latest config 37 2025.04.02 05:20:08.477568 [ 29977 ] {} RaftInstance: config at index 35 is committed, prev config log idx 37 2025.04.02 05:20:08.477593 [ 29977 ] {} RaftInstance: skipped config 35, latest config 37 2025.04.02 05:20:08.477636 [ 29977 ] {} RaftInstance: config at index 36 is committed, prev config log idx 37 2025.04.02 05:20:08.477660 [ 29977 ] {} RaftInstance: skipped config 36, latest config 37 2025.04.02 05:20:08.477704 [ 29977 ] {} RaftInstance: config at index 37 is committed, prev config log idx 37 2025.04.02 05:20:08.477726 [ 29977 ] {} RaftInstance: skipped config 37, latest config 37 2025.04.02 05:20:08.477791 [ 29977 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:08.477828 [ 29977 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:08.477893 [ 29977 ] {} RaftInstance: config at index 38 is committed, prev config log idx 37 2025.04.02 05:20:08.477949 [ 29977 ] {} RaftInstance: new config log idx 38, prev log idx 37, cur config log idx 37, prev log idx 36 2025.04.02 05:20:08.478025 [ 29977 ] {} RaftInstance: new configuration: log idx 38, prev log idx 37 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 38 2025.04.02 05:20:08.478219 [ 29370 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:08.479160 [ 29370 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:08.481030 [ 29370 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:08.481515 [ 29370 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:08.493596 [ 29370 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:08.493702 [ 29370 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:08.494855 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:08.495269 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:08.495802 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:08.496068 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:08.496329 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:08.496575 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:08.496888 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:08.497230 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:08.501507 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:08.501977 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:08.502414 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:08.502843 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:08.503243 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:08.503649 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:08.504040 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:08.504507 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:08.504989 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:08.505515 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:08.505933 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:08.506480 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:08.506899 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:08.507435 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:08.508411 [ 29370 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:08.516906 [ 29370 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:08.517146 [ 29370 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:08.523896 [ 29370 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:08.524009 [ 29370 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:08.527014 [ 29370 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:08.528284 [ 29370 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:08.528924 [ 29370 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:08.529625 [ 29984 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:08.537398 [ 29370 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:08.540416 [ 29370 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:08.546662 [ 29370 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:08.549676 [ 29370 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:08.555913 [ 29370 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:08.557871 [ 29370 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:08.559349 [ 29370 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:08.560478 [ 29370 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:08.560570 [ 29370 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:08.560641 [ 29381 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:08.561468 [ 29381 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:13.275749 [ 29370 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:13.276174 [ 29370 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:13.276557 [ 29370 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:13.276615 [ 29370 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:13.276747 [ 29380 ] {} CancellationChecker: Execution took 5309 ms. 2025.04.02 05:20:13.277019 [ 29370 ] {} Application: Shutting down storages. 2025.04.02 05:20:13.277082 [ 29370 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:13.278553 [ 29370 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:13.278607 [ 29370 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:13.278635 [ 29370 ] {} Context: Shutting down named sessions 2025.04.02 05:20:13.278696 [ 29370 ] {} Context: Shutting down database catalog 2025.04.02 05:20:13.278735 [ 29370 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:13.278792 [ 29370 ] {} Context: Shutting down merges executor 2025.04.02 05:20:13.279249 [ 29370 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:13.279772 [ 29370 ] {} Context: Shutting down moves executor 2025.04.02 05:20:13.280020 [ 29370 ] {} Context: Shutting down common executor 2025.04.02 05:20:13.280381 [ 29370 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:13.280422 [ 29370 ] {} Context: Shutting down caches 2025.04.02 05:20:13.280465 [ 29370 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:13.280764 [ 29370 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:13.283602 [ 29370 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:13.292865 [ 29370 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:13.293164 [ 29370 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:13.293800 [ 29370 ] {} Application: Shut down storages. 2025.04.02 05:20:13.293855 [ 29370 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:13.488240 [ 29370 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:13.488404 [ 29370 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:13.489165 [ 29370 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:13.981302 [ 29370 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:13.981439 [ 29370 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:13.981510 [ 29370 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:13.981558 [ 29370 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:13.981597 [ 29370 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:13.981636 [ 29370 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:13.981675 [ 29370 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:13.981786 [ 29370 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:13.981806 [ 29978 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:13.981945 [ 29370 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:13.981995 [ 29370 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:13.982042 [ 29370 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:13.982469 [ 29962 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:13.982499 [ 29964 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:13.982562 [ 29968 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:13.982553 [ 29965 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:13.982935 [ 29961 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:13.982792 [ 29973 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:13.982790 [ 29972 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:13.982791 [ 29967 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:13.982793 [ 29970 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:13.983086 [ 29963 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:13.983097 [ 29974 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:20:13.983174 [ 29966 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:13.982851 [ 29976 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:13.982795 [ 29971 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:13.982790 [ 29969 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:20:13.982854 [ 29975 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:13.983664 [ 29370 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:13.983714 [ 29959 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:13.984306 [ 29370 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:13.984452 [ 29370 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:13.984496 [ 29370 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:13.984565 [ 29370 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:13.984616 [ 29370 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:13.984744 [ 29370 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:13.984782 [ 29370 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:13.988034 [ 29370 ] {} Application: Destroyed global context. 2025.04.02 05:20:13.988529 [ 29370 ] {} Application: Waiting for background threads 2025.04.02 05:20:14.054628 [ 29370 ] {} Application: Background threads finished in 66 ms 2025.04.02 05:20:14.055337 [ 29370 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:14.055398 [ 29370 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:14.069076 [ 29370 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:14.069374 [ 29370 ] {} Application: shutting down 2025.04.02 05:20:14.069413 [ 29370 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:14.075686 [ 29373 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:14.075818 [ 29373 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:14.188534 [ 29368 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:14.575882 [ 30095 ] {} Application: Will watch for the process with pid 30097 2025.04.02 05:20:14.577177 [ 30097 ] {} Application: Forked a child process to watch 2025.04.02 05:20:14.578779 [ 30097 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:15.141357 [ 30097 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 30097 2025.04.02 05:20:15.142367 [ 30097 ] {} Application: starting up 2025.04.02 05:20:15.142487 [ 30097 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:15.175544 [ 30097 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:15.175762 [ 30097 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:15.175824 [ 30097 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:15.175857 [ 30097 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:15.175878 [ 30097 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:15.177470 [ 30097 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:15.177933 [ 30097 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:15.177984 [ 30097 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:15.178175 [ 30097 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:15.178307 [ 30097 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:16.023239 [ 30097 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:16.025514 [ 30097 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:16.025593 [ 30097 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:16.025793 [ 30097 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:16.026647 [ 30097 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:16.195529 [ 30109 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:16.195958 [ 30097 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:16.196039 [ 30097 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:16.196111 [ 30097 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:16.196191 [ 30097 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:16.196516 [ 30097 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:16.197052 [ 30097 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:16.213078 [ 30097 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:16.213170 [ 30097 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:16.213488 [ 30097 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:16.213938 [ 30097 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:16.214023 [ 30097 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:16.215066 [ 30097 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:16.220312 [ 30097 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:16.220374 [ 30097 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:16.220472 [ 30097 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:16.220922 [ 30097 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:16.232971 [ 30097 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:16.233067 [ 30097 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:16.240751 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:16.241681 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:16.242026 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:16.242517 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:16.242965 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:16.247334 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:16.247747 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:16.248117 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:16.248557 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:16.248937 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:16.249384 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:16.249708 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:16.250049 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:16.250403 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:16.250927 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:16.251246 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:16.251639 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:16.251986 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:16.252442 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:16.252792 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:16.253193 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:16.253580 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:16.254298 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:16.255396 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:16.255753 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:16.256790 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:16.257964 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:16.258368 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:16.258728 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:16.259130 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:16.259543 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:16.259962 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:16.260462 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:16.260855 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:16.261406 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:16.261813 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:16.262360 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:16.262884 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:16.263325 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:16.264490 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:16.265102 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:16.265600 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:16.266094 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:16.266559 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:16.267026 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:16.267588 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:16.268063 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:16.268584 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:16.269089 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:16.271693 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:16.272501 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:16.273519 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:16.274124 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:16.274557 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:16.275041 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:16.275764 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:16.276219 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:16.276780 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:16.277207 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:16.277673 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:16.278099 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:16.278758 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:16.279188 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:16.279744 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:16.280462 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:16.280936 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:16.282923 [ 30097 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:16.329084 [ 30097 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:16.330698 [ 30097 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:16.365992 [ 30097 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:16.366064 [ 30097 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:16.366099 [ 30097 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:16.381365 [ 30097 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:16.381410 [ 30097 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:16.381460 [ 30097 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:16.381574 [ 30097 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:16.387072 [ 30097 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:16.393130 [ 30097 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:16.404816 [ 30097 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:16.405180 [ 30097 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:16.405324 [ 30097 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:16.407389 [ 30097 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:16.407958 [ 30097 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:16.408189 [ 30097 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:16.409180 [ 30097 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:16.409253 [ 30097 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:16.410812 [ 30097 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:16.410850 [ 30097 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:16.410873 [ 30097 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:16.410915 [ 30097 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:16.410939 [ 30097 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:16.411114 [ 30097 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:16.411172 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.479919 [ 30097 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:16.489826 [ 30097 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:16.489886 [ 30097 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:16.490799 [ 30097 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:16.490921 [ 30097 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci 2025.04.02 05:20:16.490983 [ 30097 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci 2025.04.02 05:20:16.491031 [ 30097 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci, size 4 2025.04.02 05:20:16.491524 [ 30097 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci. 2025.04.02 05:20:16.491635 [ 30678 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci 2025.04.02 05:20:16.497533 [ 30678 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci, size 4 2025.04.02 05:20:16.498022 [ 30097 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/gdw/xaendcexeuulxczzwqwlkbvkxogci. 2025.04.02 05:20:16.498235 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gdw/xaendcexeuulxczzwqwlkbvkxogci (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.500777 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gdw/xaendcexeuulxczzwqwlkbvkxogci (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.500866 [ 30097 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/gdw/xaendcexeuulxczzwqwlkbvkxogci, Version: Latest, Offset: 2 2025.04.02 05:20:16.506533 [ 30097 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/gdw/xaendcexeuulxczzwqwlkbvkxogci 2025.04.02 05:20:16.506585 [ 30097 ] {} deleteFileFromS3: Object with path s3/gdw/xaendcexeuulxczzwqwlkbvkxogci was removed from S3 2025.04.02 05:20:16.506632 [ 30097 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:16.506680 [ 30097 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:16.510081 [ 30097 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:16.520981 [ 30097 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:16.521068 [ 30097 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:16.521769 [ 30097 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:16.531197 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.536624 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.536712 [ 30097 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:16.543553 [ 30097 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:16.543751 [ 30097 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:16 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832623C392FBD95 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:16.543908 [ 30097 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:16.549847 [ 30097 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:16.549912 [ 30097 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:16.549962 [ 30097 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:16.550009 [ 30097 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:16.550140 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.550214 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.550295 [ 30097 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:16.550353 [ 30097 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:16.550466 [ 30097 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:16.550529 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.550582 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.550639 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.550712 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.550848 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.554176 [ 30097 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:16.564491 [ 30097 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:16.564566 [ 30097 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:16.565253 [ 30097 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:16.572970 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/rgh/oymxtjbymnzbdlydvxfrtljycwwok (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.576167 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/rgh/oymxtjbymnzbdlydvxfrtljycwwok (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.576236 [ 30097 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/rgh/oymxtjbymnzbdlydvxfrtljycwwok, Version: Latest, Offset: 2 2025.04.02 05:20:16.582487 [ 30097 ] {} deleteFileFromS3: No blob storage log, not writing blob special/rgh/oymxtjbymnzbdlydvxfrtljycwwok 2025.04.02 05:20:16.582565 [ 30097 ] {} deleteFileFromS3: Object with path special/rgh/oymxtjbymnzbdlydvxfrtljycwwok was removed from S3 2025.04.02 05:20:16.582627 [ 30097 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:16.582684 [ 30097 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:16.586724 [ 30097 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:16.596809 [ 30097 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:16.596915 [ 30097 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:16.597699 [ 30097 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:16.604187 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/lbl/qazguyrvzlutuqhglowpdkbhhjftc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.607390 [ 30097 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/lbl/qazguyrvzlutuqhglowpdkbhhjftc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:16.607468 [ 30097 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/lbl/qazguyrvzlutuqhglowpdkbhhjftc, Version: Latest, Offset: 2 2025.04.02 05:20:16.613447 [ 30097 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/lbl/qazguyrvzlutuqhglowpdkbhhjftc 2025.04.02 05:20:16.613495 [ 30097 ] {} deleteFileFromS3: Object with path test_02944/lbl/qazguyrvzlutuqhglowpdkbhhjftc was removed from S3 2025.04.02 05:20:16.613551 [ 30097 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:16.613587 [ 30097 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:16.613740 [ 30097 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:16.617253 [ 30097 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:16.622475 [ 30097 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:16.622588 [ 30097 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:16.624216 [ 30097 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:16.624406 [ 30097 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:16.625670 [ 30097 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:16.625766 [ 30097 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:16.625806 [ 30097 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:16.625871 [ 30097 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:16.625910 [ 30097 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:16.626618 [ 30097 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 38 entries 2025.04.02 05:20:16.626688 [ 30097 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:16.626867 [ 30097 ] {} KeeperServer: Last local log idx 38 2025.04.02 05:20:16.626919 [ 30097 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 38 2025.04.02 05:20:16.628093 [ 30097 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:16.640052 [ 30097 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:16.640516 [ 30097 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:16.640624 [ 30097 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:16.640681 [ 30097 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:16.640751 [ 30097 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:16.640792 [ 30097 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:16.640871 [ 30097 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 38 election timer allowed log store start 1, end 38 config log idx 38, prev log idx 37 -- ASYNC REPLICATION -- 2025.04.02 05:20:16.640913 [ 30097 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:16.640976 [ 30097 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:16.641043 [ 30097 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:16.641783 [ 30097 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:16.641943 [ 30705 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:16.692443 [ 30688 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:16.692678 [ 30688 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:16.692788 [ 30688 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 38, state term 38, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:16.692874 [ 30688 ] {} RaftInstance: pre-vote term (0) is different, reset it to 38 2025.04.02 05:20:16.692929 [ 30097 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:16.693300 [ 30688 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:16.696756 [ 30688 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 39, log idx 38, log term 38, priority (target 1 / mine 1) 2025.04.02 05:20:16.696870 [ 30688 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:16.696958 [ 30688 ] {} RaftInstance: state machine commit index 0, precommit index 38, last log index 38 2025.04.02 05:20:16.697040 [ 30688 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:16.697380 [ 30686 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:16.697558 [ 30688 ] {} RaftInstance: [BECOME LEADER] appended new config at 39 2025.04.02 05:20:16.697835 [ 30704 ] {} RaftInstance: config at index 1 is committed, prev config log idx 38 2025.04.02 05:20:16.697900 [ 30704 ] {} RaftInstance: skipped config 1, latest config 38 2025.04.02 05:20:16.698006 [ 30704 ] {} RaftInstance: config at index 2 is committed, prev config log idx 38 2025.04.02 05:20:16.698040 [ 30704 ] {} RaftInstance: skipped config 2, latest config 38 2025.04.02 05:20:16.698101 [ 30704 ] {} RaftInstance: config at index 3 is committed, prev config log idx 38 2025.04.02 05:20:16.698144 [ 30704 ] {} RaftInstance: skipped config 3, latest config 38 2025.04.02 05:20:16.698203 [ 30704 ] {} RaftInstance: config at index 4 is committed, prev config log idx 38 2025.04.02 05:20:16.698246 [ 30704 ] {} RaftInstance: skipped config 4, latest config 38 2025.04.02 05:20:16.698324 [ 30704 ] {} RaftInstance: config at index 5 is committed, prev config log idx 38 2025.04.02 05:20:16.698357 [ 30704 ] {} RaftInstance: skipped config 5, latest config 38 2025.04.02 05:20:16.698433 [ 30704 ] {} RaftInstance: config at index 6 is committed, prev config log idx 38 2025.04.02 05:20:16.698464 [ 30704 ] {} RaftInstance: skipped config 6, latest config 38 2025.04.02 05:20:16.698520 [ 30704 ] {} RaftInstance: config at index 7 is committed, prev config log idx 38 2025.04.02 05:20:16.698548 [ 30704 ] {} RaftInstance: skipped config 7, latest config 38 2025.04.02 05:20:16.698601 [ 30704 ] {} RaftInstance: config at index 8 is committed, prev config log idx 38 2025.04.02 05:20:16.698644 [ 30704 ] {} RaftInstance: skipped config 8, latest config 38 2025.04.02 05:20:16.698692 [ 30704 ] {} RaftInstance: config at index 9 is committed, prev config log idx 38 2025.04.02 05:20:16.698724 [ 30704 ] {} RaftInstance: skipped config 9, latest config 38 2025.04.02 05:20:16.698786 [ 30704 ] {} RaftInstance: config at index 10 is committed, prev config log idx 38 2025.04.02 05:20:16.698811 [ 30704 ] {} RaftInstance: skipped config 10, latest config 38 2025.04.02 05:20:16.698862 [ 30704 ] {} RaftInstance: config at index 11 is committed, prev config log idx 38 2025.04.02 05:20:16.698887 [ 30704 ] {} RaftInstance: skipped config 11, latest config 38 2025.04.02 05:20:16.698933 [ 30704 ] {} RaftInstance: config at index 12 is committed, prev config log idx 38 2025.04.02 05:20:16.698956 [ 30704 ] {} RaftInstance: skipped config 12, latest config 38 2025.04.02 05:20:16.699001 [ 30704 ] {} RaftInstance: config at index 13 is committed, prev config log idx 38 2025.04.02 05:20:16.699031 [ 30704 ] {} RaftInstance: skipped config 13, latest config 38 2025.04.02 05:20:16.699073 [ 30704 ] {} RaftInstance: config at index 14 is committed, prev config log idx 38 2025.04.02 05:20:16.699096 [ 30704 ] {} RaftInstance: skipped config 14, latest config 38 2025.04.02 05:20:16.699146 [ 30704 ] {} RaftInstance: config at index 15 is committed, prev config log idx 38 2025.04.02 05:20:16.699171 [ 30704 ] {} RaftInstance: skipped config 15, latest config 38 2025.04.02 05:20:16.699227 [ 30704 ] {} RaftInstance: config at index 16 is committed, prev config log idx 38 2025.04.02 05:20:16.699253 [ 30704 ] {} RaftInstance: skipped config 16, latest config 38 2025.04.02 05:20:16.699324 [ 30704 ] {} RaftInstance: config at index 17 is committed, prev config log idx 38 2025.04.02 05:20:16.699350 [ 30704 ] {} RaftInstance: skipped config 17, latest config 38 2025.04.02 05:20:16.699394 [ 30704 ] {} RaftInstance: config at index 18 is committed, prev config log idx 38 2025.04.02 05:20:16.699433 [ 30704 ] {} RaftInstance: skipped config 18, latest config 38 2025.04.02 05:20:16.699486 [ 30704 ] {} RaftInstance: config at index 19 is committed, prev config log idx 38 2025.04.02 05:20:16.699510 [ 30704 ] {} RaftInstance: skipped config 19, latest config 38 2025.04.02 05:20:16.699554 [ 30704 ] {} RaftInstance: config at index 20 is committed, prev config log idx 38 2025.04.02 05:20:16.699577 [ 30704 ] {} RaftInstance: skipped config 20, latest config 38 2025.04.02 05:20:16.699625 [ 30704 ] {} RaftInstance: config at index 21 is committed, prev config log idx 38 2025.04.02 05:20:16.699650 [ 30704 ] {} RaftInstance: skipped config 21, latest config 38 2025.04.02 05:20:16.699694 [ 30704 ] {} RaftInstance: config at index 22 is committed, prev config log idx 38 2025.04.02 05:20:16.699717 [ 30704 ] {} RaftInstance: skipped config 22, latest config 38 2025.04.02 05:20:16.699784 [ 30704 ] {} RaftInstance: config at index 23 is committed, prev config log idx 38 2025.04.02 05:20:16.699812 [ 30704 ] {} RaftInstance: skipped config 23, latest config 38 2025.04.02 05:20:16.699875 [ 30704 ] {} RaftInstance: config at index 24 is committed, prev config log idx 38 2025.04.02 05:20:16.699904 [ 30704 ] {} RaftInstance: skipped config 24, latest config 38 2025.04.02 05:20:16.699957 [ 30704 ] {} RaftInstance: config at index 25 is committed, prev config log idx 38 2025.04.02 05:20:16.700011 [ 30704 ] {} RaftInstance: skipped config 25, latest config 38 2025.04.02 05:20:16.700061 [ 30704 ] {} RaftInstance: config at index 26 is committed, prev config log idx 38 2025.04.02 05:20:16.700085 [ 30704 ] {} RaftInstance: skipped config 26, latest config 38 2025.04.02 05:20:16.700160 [ 30704 ] {} RaftInstance: config at index 27 is committed, prev config log idx 38 2025.04.02 05:20:16.700204 [ 30704 ] {} RaftInstance: skipped config 27, latest config 38 2025.04.02 05:20:16.700276 [ 30704 ] {} RaftInstance: config at index 28 is committed, prev config log idx 38 2025.04.02 05:20:16.700305 [ 30704 ] {} RaftInstance: skipped config 28, latest config 38 2025.04.02 05:20:16.700354 [ 30704 ] {} RaftInstance: config at index 29 is committed, prev config log idx 38 2025.04.02 05:20:16.700382 [ 30704 ] {} RaftInstance: skipped config 29, latest config 38 2025.04.02 05:20:16.700426 [ 30704 ] {} RaftInstance: config at index 30 is committed, prev config log idx 38 2025.04.02 05:20:16.700456 [ 30704 ] {} RaftInstance: skipped config 30, latest config 38 2025.04.02 05:20:16.700504 [ 30704 ] {} RaftInstance: config at index 31 is committed, prev config log idx 38 2025.04.02 05:20:16.700533 [ 30704 ] {} RaftInstance: skipped config 31, latest config 38 2025.04.02 05:20:16.700578 [ 30704 ] {} RaftInstance: config at index 32 is committed, prev config log idx 38 2025.04.02 05:20:16.700602 [ 30704 ] {} RaftInstance: skipped config 32, latest config 38 2025.04.02 05:20:16.700649 [ 30704 ] {} RaftInstance: config at index 33 is committed, prev config log idx 38 2025.04.02 05:20:16.700672 [ 30704 ] {} RaftInstance: skipped config 33, latest config 38 2025.04.02 05:20:16.700714 [ 30704 ] {} RaftInstance: config at index 34 is committed, prev config log idx 38 2025.04.02 05:20:16.700739 [ 30704 ] {} RaftInstance: skipped config 34, latest config 38 2025.04.02 05:20:16.700792 [ 30704 ] {} RaftInstance: config at index 35 is committed, prev config log idx 38 2025.04.02 05:20:16.700819 [ 30704 ] {} RaftInstance: skipped config 35, latest config 38 2025.04.02 05:20:16.700864 [ 30704 ] {} RaftInstance: config at index 36 is committed, prev config log idx 38 2025.04.02 05:20:16.700889 [ 30704 ] {} RaftInstance: skipped config 36, latest config 38 2025.04.02 05:20:16.700933 [ 30704 ] {} RaftInstance: config at index 37 is committed, prev config log idx 38 2025.04.02 05:20:16.700958 [ 30704 ] {} RaftInstance: skipped config 37, latest config 38 2025.04.02 05:20:16.701007 [ 30704 ] {} RaftInstance: config at index 38 is committed, prev config log idx 38 2025.04.02 05:20:16.701031 [ 30704 ] {} RaftInstance: skipped config 38, latest config 38 2025.04.02 05:20:16.701088 [ 30704 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:16.701120 [ 30704 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:16.701159 [ 30704 ] {} RaftInstance: config at index 39 is committed, prev config log idx 38 2025.04.02 05:20:16.701206 [ 30704 ] {} RaftInstance: new config log idx 39, prev log idx 38, cur config log idx 38, prev log idx 37 2025.04.02 05:20:16.701320 [ 30704 ] {} RaftInstance: new configuration: log idx 39, prev log idx 38 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 39 2025.04.02 05:20:16.701500 [ 30097 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:16.702734 [ 30097 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:16.705622 [ 30097 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:16.706236 [ 30097 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:16.721597 [ 30097 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:16.721664 [ 30097 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:16.722791 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:16.723192 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:16.723773 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:16.724058 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:16.724316 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:16.724549 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:16.724778 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:16.725115 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:16.729499 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:16.730108 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:16.730681 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:16.731107 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:16.731505 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:16.731912 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:16.732341 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:16.732853 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:16.733329 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:16.733855 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:16.734255 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:16.734758 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:16.735157 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:16.735702 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:16.736611 [ 30097 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:16.744964 [ 30097 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:16.745149 [ 30097 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:16.751838 [ 30097 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:16.751916 [ 30097 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:16.754820 [ 30097 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:16.755997 [ 30097 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:16.756719 [ 30097 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:16.757402 [ 30711 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:16.765057 [ 30097 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:16.768231 [ 30097 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:16.773906 [ 30097 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:16.776609 [ 30097 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:16.782886 [ 30097 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:16.784921 [ 30097 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:16.786530 [ 30097 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:16.787823 [ 30097 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:16.787899 [ 30097 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:16.788079 [ 30110 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:16.789428 [ 30110 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:21.398681 [ 30097 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:21.399383 [ 30097 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:21.400013 [ 30097 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:21.400111 [ 30097 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:21.400369 [ 30109 ] {} CancellationChecker: Execution took 5204 ms. 2025.04.02 05:20:21.400697 [ 30097 ] {} Application: Shutting down storages. 2025.04.02 05:20:21.400797 [ 30097 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:21.402522 [ 30097 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:21.402630 [ 30097 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:21.402680 [ 30097 ] {} Context: Shutting down named sessions 2025.04.02 05:20:21.402760 [ 30097 ] {} Context: Shutting down database catalog 2025.04.02 05:20:21.402819 [ 30097 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:21.402901 [ 30097 ] {} Context: Shutting down merges executor 2025.04.02 05:20:21.403463 [ 30097 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:21.403947 [ 30097 ] {} Context: Shutting down moves executor 2025.04.02 05:20:21.404220 [ 30097 ] {} Context: Shutting down common executor 2025.04.02 05:20:21.404493 [ 30097 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:21.404538 [ 30097 ] {} Context: Shutting down caches 2025.04.02 05:20:21.404598 [ 30097 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:21.404898 [ 30097 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:21.407565 [ 30097 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:21.420528 [ 30097 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:21.420959 [ 30097 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:21.421453 [ 30097 ] {} Application: Shut down storages. 2025.04.02 05:20:21.421519 [ 30097 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:21.712797 [ 30097 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:21.712941 [ 30097 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:21.713010 [ 30097 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:22.204840 [ 30097 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:22.204984 [ 30097 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:22.205057 [ 30097 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:22.205105 [ 30097 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:22.205148 [ 30097 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:22.205190 [ 30097 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:22.205242 [ 30097 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:22.205376 [ 30097 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:22.205402 [ 30705 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:22.205543 [ 30097 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:22.205596 [ 30097 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:22.205639 [ 30097 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:22.205949 [ 30691 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:20:22.206128 [ 30688 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:22.206282 [ 30692 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:22.206354 [ 30689 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:20:22.206209 [ 30690 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:22.206695 [ 30691 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:22.206712 [ 30703 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:22.206712 [ 30694 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:22.206958 [ 30695 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:20:22.206918 [ 30693 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:22.206719 [ 30701 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:22.206907 [ 30702 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:22.207281 [ 30700 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:22.206800 [ 30697 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:22.207002 [ 30698 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:22.207421 [ 30696 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:22.207434 [ 30699 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:22.207906 [ 30097 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:22.207984 [ 30686 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:22.208134 [ 30687 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:20:22.208819 [ 30097 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:22.208972 [ 30097 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:22.209017 [ 30097 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:22.209099 [ 30097 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:22.209210 [ 30097 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:22.209417 [ 30097 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:22.209479 [ 30097 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:22.213123 [ 30097 ] {} Application: Destroyed global context. 2025.04.02 05:20:22.213704 [ 30097 ] {} Application: Waiting for background threads 2025.04.02 05:20:22.274237 [ 30097 ] {} Application: Background threads finished in 60 ms 2025.04.02 05:20:22.274862 [ 30097 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:22.274927 [ 30097 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:22.288534 [ 30097 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:22.288773 [ 30097 ] {} Application: shutting down 2025.04.02 05:20:22.288814 [ 30097 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:22.295237 [ 30100 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:22.295531 [ 30100 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:22.395107 [ 30095 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:22.706644 [ 30822 ] {} Application: Will watch for the process with pid 30824 2025.04.02 05:20:22.707703 [ 30824 ] {} Application: Forked a child process to watch 2025.04.02 05:20:22.708856 [ 30824 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:23.204989 [ 30824 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 30824 2025.04.02 05:20:23.205991 [ 30824 ] {} Application: starting up 2025.04.02 05:20:23.206082 [ 30824 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:23.240017 [ 30824 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:23.240258 [ 30824 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:23.240336 [ 30824 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:23.240372 [ 30824 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:23.240395 [ 30824 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:23.241598 [ 30824 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:23.242018 [ 30824 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:23.242065 [ 30824 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:23.242285 [ 30824 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:23.242341 [ 30824 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:24.097104 [ 30824 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:24.099193 [ 30824 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:24.099252 [ 30824 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:24.099422 [ 30824 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:24.100024 [ 30824 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:24.259192 [ 30833 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:24.259577 [ 30824 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:24.259632 [ 30824 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:24.259680 [ 30824 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:24.259717 [ 30824 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:24.260022 [ 30824 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:24.260495 [ 30824 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:24.277981 [ 30824 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:24.278104 [ 30824 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:24.278474 [ 30824 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:24.279020 [ 30824 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:24.279114 [ 30824 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:24.280127 [ 30824 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:24.285550 [ 30824 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:24.285609 [ 30824 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:24.285699 [ 30824 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:24.286114 [ 30824 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:24.297178 [ 30824 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:24.297244 [ 30824 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:24.304959 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:24.306041 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:24.306514 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:24.306986 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:24.307411 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:24.311883 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:24.312294 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:24.312676 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:24.313057 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:24.313404 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:24.313834 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:24.314168 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:24.314555 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:24.314904 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:24.315423 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:24.315748 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:24.316133 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:24.316501 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:24.316903 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:24.317279 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:24.317665 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:24.318044 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:24.318795 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:24.319869 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:24.320211 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:24.321209 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:24.322348 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:24.322765 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:24.323113 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:24.323561 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:24.323959 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:24.324367 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:24.324843 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:24.325213 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:24.325701 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:24.326074 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:24.326582 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:24.327083 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:24.327579 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:24.328762 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:24.329404 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:24.329802 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:24.330249 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:24.330736 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:24.331174 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:24.331768 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:24.332196 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:24.332676 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:24.333183 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:24.335820 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:24.336697 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:24.337696 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:24.338348 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:24.338787 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:24.339186 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:24.339911 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:24.340381 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:24.340963 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:24.341373 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:24.341826 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:24.342239 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:24.342921 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:24.343386 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:24.343912 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:24.344633 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:24.345118 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:24.347050 [ 30824 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:24.394198 [ 30824 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:24.396006 [ 30824 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:24.432111 [ 30824 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:24.432193 [ 30824 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:24.432235 [ 30824 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:24.447415 [ 30824 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:24.447466 [ 30824 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:24.447516 [ 30824 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:24.447633 [ 30824 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:24.453629 [ 30824 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:24.459617 [ 30824 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:24.470829 [ 30824 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:24.471215 [ 30824 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:24.471351 [ 30824 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:24.473444 [ 30824 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:24.474044 [ 30824 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:24.474330 [ 30824 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:24.475344 [ 30824 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:24.475410 [ 30824 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:24.476995 [ 30824 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:24.477043 [ 30824 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:24.477074 [ 30824 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:24.477129 [ 30824 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:24.477161 [ 30824 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:24.477406 [ 30824 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:24.477480 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.545926 [ 30824 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:24.555503 [ 30824 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:24.555571 [ 30824 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:24.556476 [ 30824 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:24.556597 [ 30824 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj 2025.04.02 05:20:24.556660 [ 30824 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj 2025.04.02 05:20:24.556719 [ 30824 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj, size 4 2025.04.02 05:20:24.557236 [ 30824 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj. 2025.04.02 05:20:24.557406 [ 31405 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj 2025.04.02 05:20:24.563735 [ 31405 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj, size 4 2025.04.02 05:20:24.564299 [ 30824 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/zey/fjndrkeobdaklfucylxyxphohppxj. 2025.04.02 05:20:24.564519 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zey/fjndrkeobdaklfucylxyxphohppxj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.567438 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zey/fjndrkeobdaklfucylxyxphohppxj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.567515 [ 30824 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/zey/fjndrkeobdaklfucylxyxphohppxj, Version: Latest, Offset: 2 2025.04.02 05:20:24.573523 [ 30824 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/zey/fjndrkeobdaklfucylxyxphohppxj 2025.04.02 05:20:24.573643 [ 30824 ] {} deleteFileFromS3: Object with path s3/zey/fjndrkeobdaklfucylxyxphohppxj was removed from S3 2025.04.02 05:20:24.573752 [ 30824 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:24.573853 [ 30824 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:24.578672 [ 30824 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:24.595094 [ 30824 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:24.595196 [ 30824 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:24.596032 [ 30824 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:24.605726 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.612506 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.612653 [ 30824 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:24.620575 [ 30824 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:24.620874 [ 30824 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:24 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832623E1A9F5F72 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:24.621126 [ 30824 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:24.627344 [ 30824 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:24.627432 [ 30824 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:24.627521 [ 30824 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:24.627592 [ 30824 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:24.627748 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.627841 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.627939 [ 30824 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:24.628018 [ 30824 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:24.628111 [ 30824 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:24.628188 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.628280 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.628398 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.628477 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.628560 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.633560 [ 30824 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:24.649453 [ 30824 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:24.649582 [ 30824 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:24.650709 [ 30824 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:24.658421 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/izr/cqmrlldghobvfnhrfwjhxkbccwibc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.661968 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/izr/cqmrlldghobvfnhrfwjhxkbccwibc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.662079 [ 30824 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/izr/cqmrlldghobvfnhrfwjhxkbccwibc, Version: Latest, Offset: 2 2025.04.02 05:20:24.669570 [ 30824 ] {} deleteFileFromS3: No blob storage log, not writing blob special/izr/cqmrlldghobvfnhrfwjhxkbccwibc 2025.04.02 05:20:24.669663 [ 30824 ] {} deleteFileFromS3: Object with path special/izr/cqmrlldghobvfnhrfwjhxkbccwibc was removed from S3 2025.04.02 05:20:24.669727 [ 30824 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:24.669775 [ 30824 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:24.674851 [ 30824 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:24.690695 [ 30824 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:24.690802 [ 30824 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:24.691897 [ 30824 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:24.698343 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vmx/jtkudyldbbvfpwdhdsxsuoybkhcml (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.702152 [ 30824 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vmx/jtkudyldbbvfpwdhdsxsuoybkhcml (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:24.702294 [ 30824 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/vmx/jtkudyldbbvfpwdhdsxsuoybkhcml, Version: Latest, Offset: 2 2025.04.02 05:20:24.709401 [ 30824 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/vmx/jtkudyldbbvfpwdhdsxsuoybkhcml 2025.04.02 05:20:24.709518 [ 30824 ] {} deleteFileFromS3: Object with path test_02944/vmx/jtkudyldbbvfpwdhdsxsuoybkhcml was removed from S3 2025.04.02 05:20:24.709589 [ 30824 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:24.709640 [ 30824 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:24.709822 [ 30824 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:24.714187 [ 30824 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:24.719024 [ 30824 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:24.719181 [ 30824 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:24.721391 [ 30824 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:24.721616 [ 30824 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:24.722864 [ 30824 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:24.722948 [ 30824 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:24.723000 [ 30824 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:24.723057 [ 30824 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:24.723105 [ 30824 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:24.723959 [ 30824 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 39 entries 2025.04.02 05:20:24.724054 [ 30824 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:24.724190 [ 30824 ] {} KeeperServer: Last local log idx 39 2025.04.02 05:20:24.724251 [ 30824 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 39 2025.04.02 05:20:24.726032 [ 30824 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:24.740083 [ 30824 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:24.740624 [ 30824 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:24.740744 [ 30824 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:24.740817 [ 30824 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:24.740921 [ 30824 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:24.740981 [ 30824 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:24.741088 [ 30824 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 39 election timer allowed log store start 1, end 39 config log idx 39, prev log idx 38 -- ASYNC REPLICATION -- 2025.04.02 05:20:24.741147 [ 30824 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:24.741236 [ 30824 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:24.741389 [ 30824 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:24.742201 [ 30824 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:24.742311 [ 31432 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:24.792933 [ 31415 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:24.793209 [ 31415 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:24.793389 [ 31415 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 39, state term 39, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:24.793420 [ 30824 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:24.793469 [ 31415 ] {} RaftInstance: pre-vote term (0) is different, reset it to 39 2025.04.02 05:20:24.793886 [ 31415 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:24.799099 [ 31415 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 40, log idx 39, log term 39, priority (target 1 / mine 1) 2025.04.02 05:20:24.799209 [ 31415 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:24.799302 [ 31415 ] {} RaftInstance: state machine commit index 0, precommit index 39, last log index 39 2025.04.02 05:20:24.799383 [ 31415 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:24.799800 [ 31413 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:24.800017 [ 31415 ] {} RaftInstance: [BECOME LEADER] appended new config at 40 2025.04.02 05:20:24.800414 [ 31431 ] {} RaftInstance: config at index 1 is committed, prev config log idx 39 2025.04.02 05:20:24.800522 [ 31431 ] {} RaftInstance: skipped config 1, latest config 39 2025.04.02 05:20:24.800640 [ 31431 ] {} RaftInstance: config at index 2 is committed, prev config log idx 39 2025.04.02 05:20:24.800679 [ 31431 ] {} RaftInstance: skipped config 2, latest config 39 2025.04.02 05:20:24.800753 [ 31431 ] {} RaftInstance: config at index 3 is committed, prev config log idx 39 2025.04.02 05:20:24.800798 [ 31431 ] {} RaftInstance: skipped config 3, latest config 39 2025.04.02 05:20:24.800872 [ 31431 ] {} RaftInstance: config at index 4 is committed, prev config log idx 39 2025.04.02 05:20:24.800910 [ 31431 ] {} RaftInstance: skipped config 4, latest config 39 2025.04.02 05:20:24.800980 [ 31431 ] {} RaftInstance: config at index 5 is committed, prev config log idx 39 2025.04.02 05:20:24.801022 [ 31431 ] {} RaftInstance: skipped config 5, latest config 39 2025.04.02 05:20:24.801094 [ 31431 ] {} RaftInstance: config at index 6 is committed, prev config log idx 39 2025.04.02 05:20:24.801134 [ 31431 ] {} RaftInstance: skipped config 6, latest config 39 2025.04.02 05:20:24.801208 [ 31431 ] {} RaftInstance: config at index 7 is committed, prev config log idx 39 2025.04.02 05:20:24.801243 [ 31431 ] {} RaftInstance: skipped config 7, latest config 39 2025.04.02 05:20:24.801331 [ 31431 ] {} RaftInstance: config at index 8 is committed, prev config log idx 39 2025.04.02 05:20:24.801399 [ 31431 ] {} RaftInstance: skipped config 8, latest config 39 2025.04.02 05:20:24.801477 [ 31431 ] {} RaftInstance: config at index 9 is committed, prev config log idx 39 2025.04.02 05:20:24.801510 [ 31431 ] {} RaftInstance: skipped config 9, latest config 39 2025.04.02 05:20:24.801580 [ 31431 ] {} RaftInstance: config at index 10 is committed, prev config log idx 39 2025.04.02 05:20:24.801615 [ 31431 ] {} RaftInstance: skipped config 10, latest config 39 2025.04.02 05:20:24.801687 [ 31431 ] {} RaftInstance: config at index 11 is committed, prev config log idx 39 2025.04.02 05:20:24.801721 [ 31431 ] {} RaftInstance: skipped config 11, latest config 39 2025.04.02 05:20:24.801784 [ 31431 ] {} RaftInstance: config at index 12 is committed, prev config log idx 39 2025.04.02 05:20:24.801820 [ 31431 ] {} RaftInstance: skipped config 12, latest config 39 2025.04.02 05:20:24.801890 [ 31431 ] {} RaftInstance: config at index 13 is committed, prev config log idx 39 2025.04.02 05:20:24.801928 [ 31431 ] {} RaftInstance: skipped config 13, latest config 39 2025.04.02 05:20:24.801992 [ 31431 ] {} RaftInstance: config at index 14 is committed, prev config log idx 39 2025.04.02 05:20:24.802026 [ 31431 ] {} RaftInstance: skipped config 14, latest config 39 2025.04.02 05:20:24.802109 [ 31431 ] {} RaftInstance: config at index 15 is committed, prev config log idx 39 2025.04.02 05:20:24.802142 [ 31431 ] {} RaftInstance: skipped config 15, latest config 39 2025.04.02 05:20:24.802220 [ 31431 ] {} RaftInstance: config at index 16 is committed, prev config log idx 39 2025.04.02 05:20:24.802256 [ 31431 ] {} RaftInstance: skipped config 16, latest config 39 2025.04.02 05:20:24.802343 [ 31431 ] {} RaftInstance: config at index 17 is committed, prev config log idx 39 2025.04.02 05:20:24.802379 [ 31431 ] {} RaftInstance: skipped config 17, latest config 39 2025.04.02 05:20:24.802538 [ 31431 ] {} RaftInstance: config at index 18 is committed, prev config log idx 39 2025.04.02 05:20:24.802586 [ 31431 ] {} RaftInstance: skipped config 18, latest config 39 2025.04.02 05:20:24.802660 [ 31431 ] {} RaftInstance: config at index 19 is committed, prev config log idx 39 2025.04.02 05:20:24.802695 [ 31431 ] {} RaftInstance: skipped config 19, latest config 39 2025.04.02 05:20:24.802759 [ 31431 ] {} RaftInstance: config at index 20 is committed, prev config log idx 39 2025.04.02 05:20:24.802793 [ 31431 ] {} RaftInstance: skipped config 20, latest config 39 2025.04.02 05:20:24.802892 [ 31431 ] {} RaftInstance: config at index 21 is committed, prev config log idx 39 2025.04.02 05:20:24.802930 [ 31431 ] {} RaftInstance: skipped config 21, latest config 39 2025.04.02 05:20:24.802999 [ 31431 ] {} RaftInstance: config at index 22 is committed, prev config log idx 39 2025.04.02 05:20:24.803056 [ 31431 ] {} RaftInstance: skipped config 22, latest config 39 2025.04.02 05:20:24.803127 [ 31431 ] {} RaftInstance: config at index 23 is committed, prev config log idx 39 2025.04.02 05:20:24.803165 [ 31431 ] {} RaftInstance: skipped config 23, latest config 39 2025.04.02 05:20:24.803238 [ 31431 ] {} RaftInstance: config at index 24 is committed, prev config log idx 39 2025.04.02 05:20:24.803288 [ 31431 ] {} RaftInstance: skipped config 24, latest config 39 2025.04.02 05:20:24.803356 [ 31431 ] {} RaftInstance: config at index 25 is committed, prev config log idx 39 2025.04.02 05:20:24.803405 [ 31431 ] {} RaftInstance: skipped config 25, latest config 39 2025.04.02 05:20:24.803488 [ 31431 ] {} RaftInstance: config at index 26 is committed, prev config log idx 39 2025.04.02 05:20:24.803523 [ 31431 ] {} RaftInstance: skipped config 26, latest config 39 2025.04.02 05:20:24.803589 [ 31431 ] {} RaftInstance: config at index 27 is committed, prev config log idx 39 2025.04.02 05:20:24.803623 [ 31431 ] {} RaftInstance: skipped config 27, latest config 39 2025.04.02 05:20:24.803691 [ 31431 ] {} RaftInstance: config at index 28 is committed, prev config log idx 39 2025.04.02 05:20:24.803725 [ 31431 ] {} RaftInstance: skipped config 28, latest config 39 2025.04.02 05:20:24.803823 [ 31431 ] {} RaftInstance: config at index 29 is committed, prev config log idx 39 2025.04.02 05:20:24.803862 [ 31431 ] {} RaftInstance: skipped config 29, latest config 39 2025.04.02 05:20:24.803928 [ 31431 ] {} RaftInstance: config at index 30 is committed, prev config log idx 39 2025.04.02 05:20:24.803965 [ 31431 ] {} RaftInstance: skipped config 30, latest config 39 2025.04.02 05:20:24.804031 [ 31431 ] {} RaftInstance: config at index 31 is committed, prev config log idx 39 2025.04.02 05:20:24.804071 [ 31431 ] {} RaftInstance: skipped config 31, latest config 39 2025.04.02 05:20:24.804178 [ 31431 ] {} RaftInstance: config at index 32 is committed, prev config log idx 39 2025.04.02 05:20:24.804215 [ 31431 ] {} RaftInstance: skipped config 32, latest config 39 2025.04.02 05:20:24.804314 [ 31431 ] {} RaftInstance: config at index 33 is committed, prev config log idx 39 2025.04.02 05:20:24.804363 [ 31431 ] {} RaftInstance: skipped config 33, latest config 39 2025.04.02 05:20:24.804486 [ 31431 ] {} RaftInstance: config at index 34 is committed, prev config log idx 39 2025.04.02 05:20:24.804521 [ 31431 ] {} RaftInstance: skipped config 34, latest config 39 2025.04.02 05:20:24.804587 [ 31431 ] {} RaftInstance: config at index 35 is committed, prev config log idx 39 2025.04.02 05:20:24.804624 [ 31431 ] {} RaftInstance: skipped config 35, latest config 39 2025.04.02 05:20:24.804687 [ 31431 ] {} RaftInstance: config at index 36 is committed, prev config log idx 39 2025.04.02 05:20:24.804724 [ 31431 ] {} RaftInstance: skipped config 36, latest config 39 2025.04.02 05:20:24.804816 [ 31431 ] {} RaftInstance: config at index 37 is committed, prev config log idx 39 2025.04.02 05:20:24.804851 [ 31431 ] {} RaftInstance: skipped config 37, latest config 39 2025.04.02 05:20:24.804936 [ 31431 ] {} RaftInstance: config at index 38 is committed, prev config log idx 39 2025.04.02 05:20:24.804972 [ 31431 ] {} RaftInstance: skipped config 38, latest config 39 2025.04.02 05:20:24.805040 [ 31431 ] {} RaftInstance: config at index 39 is committed, prev config log idx 39 2025.04.02 05:20:24.805080 [ 31431 ] {} RaftInstance: skipped config 39, latest config 39 2025.04.02 05:20:24.805165 [ 31431 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:24.805214 [ 31431 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:24.805353 [ 31431 ] {} RaftInstance: config at index 40 is committed, prev config log idx 39 2025.04.02 05:20:24.805453 [ 31431 ] {} RaftInstance: new config log idx 40, prev log idx 39, cur config log idx 39, prev log idx 38 2025.04.02 05:20:24.805580 [ 31431 ] {} RaftInstance: new configuration: log idx 40, prev log idx 39 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 40 2025.04.02 05:20:24.805872 [ 30824 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:24.806955 [ 30824 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:24.808898 [ 30824 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:24.809382 [ 30824 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:24.826368 [ 30824 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:24.826514 [ 30824 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:24.827785 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:24.828194 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:24.828765 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:24.829051 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:24.829307 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:24.829523 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:24.829832 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:24.830207 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:24.833962 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:24.834324 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:24.834654 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:24.834969 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:24.835325 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:24.835669 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:24.836028 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:24.836476 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:24.836837 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:24.837309 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:24.837672 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:24.838030 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:24.838377 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:24.838869 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:24.839674 [ 30824 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:24.847251 [ 30824 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:24.847517 [ 30824 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:24.854681 [ 30824 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:24.854862 [ 30824 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:24.858195 [ 30824 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:24.859557 [ 30824 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:24.860216 [ 30824 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:24.860645 [ 31437 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:24.869438 [ 30824 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:24.873145 [ 30824 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:24.879455 [ 30824 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:24.882799 [ 30824 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:24.889642 [ 30824 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:24.892889 [ 30824 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:24.895389 [ 30824 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:24.897555 [ 30824 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:24.897701 [ 30824 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:24.897722 [ 30834 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:24.898498 [ 30834 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:29.239618 [ 30824 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:29.240032 [ 30824 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:29.240483 [ 30824 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:29.240543 [ 30824 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:29.240722 [ 30833 ] {} CancellationChecker: Execution took 4981 ms. 2025.04.02 05:20:29.240977 [ 30824 ] {} Application: Shutting down storages. 2025.04.02 05:20:29.241028 [ 30824 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:29.242436 [ 30824 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:29.242496 [ 30824 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:29.242524 [ 30824 ] {} Context: Shutting down named sessions 2025.04.02 05:20:29.242587 [ 30824 ] {} Context: Shutting down database catalog 2025.04.02 05:20:29.242621 [ 30824 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:29.242686 [ 30824 ] {} Context: Shutting down merges executor 2025.04.02 05:20:29.243134 [ 30824 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:29.243640 [ 30824 ] {} Context: Shutting down moves executor 2025.04.02 05:20:29.243883 [ 30824 ] {} Context: Shutting down common executor 2025.04.02 05:20:29.244132 [ 30824 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:29.244188 [ 30824 ] {} Context: Shutting down caches 2025.04.02 05:20:29.244234 [ 30824 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:29.244542 [ 30824 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:29.247469 [ 30824 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:29.258107 [ 30824 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:29.258503 [ 30824 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:29.258969 [ 30824 ] {} Application: Shut down storages. 2025.04.02 05:20:29.259005 [ 30824 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:29.315283 [ 30824 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:29.315399 [ 30824 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:29.315466 [ 30824 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:29.808870 [ 30824 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:29.809049 [ 30824 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:29.811127 [ 30824 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:29.811205 [ 30824 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:29.811293 [ 30824 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:29.811353 [ 30824 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:29.811417 [ 30824 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:29.811534 [ 30824 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:29.811614 [ 31432 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:29.811814 [ 30824 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:29.811871 [ 30824 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:29.811917 [ 30824 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:29.812363 [ 31415 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:29.812265 [ 31418 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:20:29.812398 [ 31417 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:29.812418 [ 31416 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:29.812512 [ 31420 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:29.812943 [ 31418 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:29.812966 [ 31430 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:29.812968 [ 31422 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:20:29.812993 [ 31429 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:29.812998 [ 31424 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:29.813194 [ 31425 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:29.813252 [ 31421 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:29.813335 [ 31427 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:20:29.813103 [ 31423 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:29.813338 [ 31428 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:29.813291 [ 31419 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:29.813006 [ 31426 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:29.813995 [ 30824 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:29.814080 [ 31413 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:29.814238 [ 31414 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:20:29.814911 [ 30824 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:29.815066 [ 30824 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:29.815117 [ 30824 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:29.815179 [ 30824 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:29.815228 [ 30824 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:29.815383 [ 30824 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:29.815424 [ 30824 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:29.818739 [ 30824 ] {} Application: Destroyed global context. 2025.04.02 05:20:29.819214 [ 30824 ] {} Application: Waiting for background threads 2025.04.02 05:20:29.891474 [ 30824 ] {} Application: Background threads finished in 72 ms 2025.04.02 05:20:29.892089 [ 30824 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:29.892157 [ 30824 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:29.912235 [ 30824 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:29.912647 [ 30824 ] {} Application: shutting down 2025.04.02 05:20:29.912697 [ 30824 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:29.923655 [ 30827 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:29.923733 [ 30827 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:30.033719 [ 30822 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:30.890221 [ 31549 ] {} Application: Will watch for the process with pid 31551 2025.04.02 05:20:30.891921 [ 31551 ] {} Application: Forked a child process to watch 2025.04.02 05:20:30.893916 [ 31551 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:31.396518 [ 31551 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 31551 2025.04.02 05:20:31.397423 [ 31551 ] {} Application: starting up 2025.04.02 05:20:31.397529 [ 31551 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:31.438627 [ 31551 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:31.439041 [ 31551 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:31.439138 [ 31551 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:31.439191 [ 31551 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:31.439235 [ 31551 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:31.440642 [ 31551 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:31.441328 [ 31551 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:31.441393 [ 31551 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:31.441676 [ 31551 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:31.441753 [ 31551 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:32.511798 [ 31551 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:32.515047 [ 31551 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:32.515158 [ 31551 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:32.515404 [ 31551 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:32.516404 [ 31551 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:32.688076 [ 31564 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:32.688340 [ 31551 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:32.688390 [ 31551 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:32.688451 [ 31551 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:32.688501 [ 31551 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:32.688765 [ 31551 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:32.689146 [ 31551 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:32.708891 [ 31551 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:32.709061 [ 31551 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:32.709447 [ 31551 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:32.710088 [ 31551 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:32.710207 [ 31551 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:32.711355 [ 31551 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:32.717520 [ 31551 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:32.717610 [ 31551 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:32.717733 [ 31551 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:32.718206 [ 31551 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:32.731776 [ 31551 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:32.731951 [ 31551 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:32.741038 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:32.742135 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:32.742616 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:32.743182 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:32.743663 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:32.748286 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:32.748753 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:32.749160 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:32.749544 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:32.749888 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:32.750366 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:32.750721 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:32.751095 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:32.751476 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:32.751998 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:32.752368 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:32.752753 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:32.753152 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:32.753613 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:32.753990 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:32.754435 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:32.754825 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:32.755601 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:32.756655 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:32.757003 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:32.758101 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:32.759398 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:32.759817 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:32.760179 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:32.760568 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:32.760968 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:32.761398 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:32.761878 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:32.762299 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:32.762812 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:32.763226 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:32.763725 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:32.764285 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:32.764850 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:32.766057 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:32.766719 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:32.767177 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:32.767774 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:32.768234 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:32.768713 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:32.769284 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:32.769732 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:32.770201 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:32.770741 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:32.773391 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:32.774223 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:32.775287 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:32.775970 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:32.776396 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:32.776779 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:32.777560 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:32.778058 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:32.778671 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:32.779105 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:32.779587 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:32.780038 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:32.780753 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:32.781195 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:32.781725 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:32.782471 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:32.782997 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:32.784838 [ 31551 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:32.831672 [ 31551 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:32.833563 [ 31551 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:32.870265 [ 31551 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:32.870376 [ 31551 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:32.870447 [ 31551 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:32.885847 [ 31551 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:32.885944 [ 31551 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:32.886022 [ 31551 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:32.886152 [ 31551 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:32.892327 [ 31551 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:32.898473 [ 31551 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:32.910986 [ 31551 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:32.911430 [ 31551 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:32.911590 [ 31551 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:32.913848 [ 31551 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:32.914577 [ 31551 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:32.914870 [ 31551 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:32.915986 [ 31551 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:32.916065 [ 31551 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:32.917661 [ 31551 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:32.917714 [ 31551 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:32.917745 [ 31551 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:32.917788 [ 31551 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:32.917812 [ 31551 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:32.917984 [ 31551 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:32.918044 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.014633 [ 31551 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:33.029794 [ 31551 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:33.029922 [ 31551 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:33.031392 [ 31551 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:33.031575 [ 31551 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre 2025.04.02 05:20:33.031670 [ 31551 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre 2025.04.02 05:20:33.031741 [ 31551 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre, size 4 2025.04.02 05:20:33.032335 [ 31551 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre. 2025.04.02 05:20:33.032464 [ 32132 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre 2025.04.02 05:20:33.039006 [ 32132 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre, size 4 2025.04.02 05:20:33.039880 [ 31551 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/gxj/bmcqudekfpkddqaezwpnhgifxekre. 2025.04.02 05:20:33.040232 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gxj/bmcqudekfpkddqaezwpnhgifxekre (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.043920 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gxj/bmcqudekfpkddqaezwpnhgifxekre (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.044033 [ 31551 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/gxj/bmcqudekfpkddqaezwpnhgifxekre, Version: Latest, Offset: 2 2025.04.02 05:20:33.051171 [ 31551 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/gxj/bmcqudekfpkddqaezwpnhgifxekre 2025.04.02 05:20:33.051248 [ 31551 ] {} deleteFileFromS3: Object with path s3/gxj/bmcqudekfpkddqaezwpnhgifxekre was removed from S3 2025.04.02 05:20:33.051333 [ 31551 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:33.051411 [ 31551 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:33.055650 [ 31551 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:33.067254 [ 31551 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:33.067384 [ 31551 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:33.068104 [ 31551 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:33.077159 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.081812 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.081910 [ 31551 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:33.087514 [ 31551 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:33.087792 [ 31551 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:33 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326240134C8F77 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:33.087995 [ 31551 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:33.093103 [ 31551 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:33.093161 [ 31551 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:33.093215 [ 31551 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:33.093260 [ 31551 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:33.093409 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.093501 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.093593 [ 31551 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:33.093685 [ 31551 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:33.093786 [ 31551 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:33.093879 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.093958 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.094051 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.094137 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.094233 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.097227 [ 31551 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:33.106821 [ 31551 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:33.106900 [ 31551 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:33.107594 [ 31551 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:33.113705 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/iks/xckvuzrxlndkacounpblfqkftwurl (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.116105 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/iks/xckvuzrxlndkacounpblfqkftwurl (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.116177 [ 31551 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/iks/xckvuzrxlndkacounpblfqkftwurl, Version: Latest, Offset: 2 2025.04.02 05:20:33.120891 [ 31551 ] {} deleteFileFromS3: No blob storage log, not writing blob special/iks/xckvuzrxlndkacounpblfqkftwurl 2025.04.02 05:20:33.120953 [ 31551 ] {} deleteFileFromS3: Object with path special/iks/xckvuzrxlndkacounpblfqkftwurl was removed from S3 2025.04.02 05:20:33.121002 [ 31551 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:33.121037 [ 31551 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:33.124068 [ 31551 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:33.133481 [ 31551 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:33.133563 [ 31551 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:33.134285 [ 31551 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:33.140761 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/tyr/ogykxfepiwfiqikoejimcyptrhbjd (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.143454 [ 31551 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/tyr/ogykxfepiwfiqikoejimcyptrhbjd (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:33.143562 [ 31551 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/tyr/ogykxfepiwfiqikoejimcyptrhbjd, Version: Latest, Offset: 2 2025.04.02 05:20:33.150125 [ 31551 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/tyr/ogykxfepiwfiqikoejimcyptrhbjd 2025.04.02 05:20:33.150202 [ 31551 ] {} deleteFileFromS3: Object with path test_02944/tyr/ogykxfepiwfiqikoejimcyptrhbjd was removed from S3 2025.04.02 05:20:33.150263 [ 31551 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:33.150338 [ 31551 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:33.150518 [ 31551 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:33.155207 [ 31551 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:33.160467 [ 31551 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:33.160640 [ 31551 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:33.163002 [ 31551 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:33.163296 [ 31551 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:33.164463 [ 31551 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:33.164547 [ 31551 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:33.164611 [ 31551 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:33.164673 [ 31551 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:33.164737 [ 31551 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:33.165667 [ 31551 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 40 entries 2025.04.02 05:20:33.165771 [ 31551 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:33.165939 [ 31551 ] {} KeeperServer: Last local log idx 40 2025.04.02 05:20:33.166016 [ 31551 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 40 2025.04.02 05:20:33.168026 [ 31551 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:33.182097 [ 31551 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:33.182814 [ 31551 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:33.182996 [ 31551 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:33.183101 [ 31551 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:33.183230 [ 31551 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:33.183339 [ 31551 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:33.183484 [ 31551 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 40 election timer allowed log store start 1, end 40 config log idx 40, prev log idx 39 -- ASYNC REPLICATION -- 2025.04.02 05:20:33.183568 [ 31551 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:33.183692 [ 31551 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:33.183795 [ 31551 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:33.184545 [ 31551 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:33.184730 [ 32160 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:33.235031 [ 32143 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:33.235240 [ 32143 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:33.235369 [ 32143 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 40, state term 40, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:33.235441 [ 32143 ] {} RaftInstance: pre-vote term (0) is different, reset it to 40 2025.04.02 05:20:33.235665 [ 31551 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:33.235813 [ 32143 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:33.239109 [ 32143 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 41, log idx 40, log term 40, priority (target 1 / mine 1) 2025.04.02 05:20:33.239198 [ 32143 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:33.239295 [ 32143 ] {} RaftInstance: state machine commit index 0, precommit index 40, last log index 40 2025.04.02 05:20:33.239358 [ 32143 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:33.239661 [ 32141 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:33.239784 [ 32143 ] {} RaftInstance: [BECOME LEADER] appended new config at 41 2025.04.02 05:20:33.240130 [ 32159 ] {} RaftInstance: config at index 1 is committed, prev config log idx 40 2025.04.02 05:20:33.240292 [ 32159 ] {} RaftInstance: skipped config 1, latest config 40 2025.04.02 05:20:33.240468 [ 32159 ] {} RaftInstance: config at index 2 is committed, prev config log idx 40 2025.04.02 05:20:33.240538 [ 32159 ] {} RaftInstance: skipped config 2, latest config 40 2025.04.02 05:20:33.240654 [ 32159 ] {} RaftInstance: config at index 3 is committed, prev config log idx 40 2025.04.02 05:20:33.240725 [ 32159 ] {} RaftInstance: skipped config 3, latest config 40 2025.04.02 05:20:33.240831 [ 32159 ] {} RaftInstance: config at index 4 is committed, prev config log idx 40 2025.04.02 05:20:33.240885 [ 32159 ] {} RaftInstance: skipped config 4, latest config 40 2025.04.02 05:20:33.240985 [ 32159 ] {} RaftInstance: config at index 5 is committed, prev config log idx 40 2025.04.02 05:20:33.241041 [ 32159 ] {} RaftInstance: skipped config 5, latest config 40 2025.04.02 05:20:33.241142 [ 32159 ] {} RaftInstance: config at index 6 is committed, prev config log idx 40 2025.04.02 05:20:33.241197 [ 32159 ] {} RaftInstance: skipped config 6, latest config 40 2025.04.02 05:20:33.241310 [ 32159 ] {} RaftInstance: config at index 7 is committed, prev config log idx 40 2025.04.02 05:20:33.241359 [ 32159 ] {} RaftInstance: skipped config 7, latest config 40 2025.04.02 05:20:33.241459 [ 32159 ] {} RaftInstance: config at index 8 is committed, prev config log idx 40 2025.04.02 05:20:33.241537 [ 32159 ] {} RaftInstance: skipped config 8, latest config 40 2025.04.02 05:20:33.241635 [ 32159 ] {} RaftInstance: config at index 9 is committed, prev config log idx 40 2025.04.02 05:20:33.241692 [ 32159 ] {} RaftInstance: skipped config 9, latest config 40 2025.04.02 05:20:33.241785 [ 32159 ] {} RaftInstance: config at index 10 is committed, prev config log idx 40 2025.04.02 05:20:33.241835 [ 32159 ] {} RaftInstance: skipped config 10, latest config 40 2025.04.02 05:20:33.241934 [ 32159 ] {} RaftInstance: config at index 11 is committed, prev config log idx 40 2025.04.02 05:20:33.241984 [ 32159 ] {} RaftInstance: skipped config 11, latest config 40 2025.04.02 05:20:33.242070 [ 32159 ] {} RaftInstance: config at index 12 is committed, prev config log idx 40 2025.04.02 05:20:33.242114 [ 32159 ] {} RaftInstance: skipped config 12, latest config 40 2025.04.02 05:20:33.242209 [ 32159 ] {} RaftInstance: config at index 13 is committed, prev config log idx 40 2025.04.02 05:20:33.242266 [ 32159 ] {} RaftInstance: skipped config 13, latest config 40 2025.04.02 05:20:33.242419 [ 32159 ] {} RaftInstance: config at index 14 is committed, prev config log idx 40 2025.04.02 05:20:33.242476 [ 32159 ] {} RaftInstance: skipped config 14, latest config 40 2025.04.02 05:20:33.242572 [ 32159 ] {} RaftInstance: config at index 15 is committed, prev config log idx 40 2025.04.02 05:20:33.242622 [ 32159 ] {} RaftInstance: skipped config 15, latest config 40 2025.04.02 05:20:33.242735 [ 32159 ] {} RaftInstance: config at index 16 is committed, prev config log idx 40 2025.04.02 05:20:33.242786 [ 32159 ] {} RaftInstance: skipped config 16, latest config 40 2025.04.02 05:20:33.242876 [ 32159 ] {} RaftInstance: config at index 17 is committed, prev config log idx 40 2025.04.02 05:20:33.242926 [ 32159 ] {} RaftInstance: skipped config 17, latest config 40 2025.04.02 05:20:33.243025 [ 32159 ] {} RaftInstance: config at index 18 is committed, prev config log idx 40 2025.04.02 05:20:33.243082 [ 32159 ] {} RaftInstance: skipped config 18, latest config 40 2025.04.02 05:20:33.243187 [ 32159 ] {} RaftInstance: config at index 19 is committed, prev config log idx 40 2025.04.02 05:20:33.243239 [ 32159 ] {} RaftInstance: skipped config 19, latest config 40 2025.04.02 05:20:33.243344 [ 32159 ] {} RaftInstance: config at index 20 is committed, prev config log idx 40 2025.04.02 05:20:33.243393 [ 32159 ] {} RaftInstance: skipped config 20, latest config 40 2025.04.02 05:20:33.243488 [ 32159 ] {} RaftInstance: config at index 21 is committed, prev config log idx 40 2025.04.02 05:20:33.243534 [ 32159 ] {} RaftInstance: skipped config 21, latest config 40 2025.04.02 05:20:33.243621 [ 32159 ] {} RaftInstance: config at index 22 is committed, prev config log idx 40 2025.04.02 05:20:33.243676 [ 32159 ] {} RaftInstance: skipped config 22, latest config 40 2025.04.02 05:20:33.243770 [ 32159 ] {} RaftInstance: config at index 23 is committed, prev config log idx 40 2025.04.02 05:20:33.243826 [ 32159 ] {} RaftInstance: skipped config 23, latest config 40 2025.04.02 05:20:33.243929 [ 32159 ] {} RaftInstance: config at index 24 is committed, prev config log idx 40 2025.04.02 05:20:33.243980 [ 32159 ] {} RaftInstance: skipped config 24, latest config 40 2025.04.02 05:20:33.244067 [ 32159 ] {} RaftInstance: config at index 25 is committed, prev config log idx 40 2025.04.02 05:20:33.244127 [ 32159 ] {} RaftInstance: skipped config 25, latest config 40 2025.04.02 05:20:33.244220 [ 32159 ] {} RaftInstance: config at index 26 is committed, prev config log idx 40 2025.04.02 05:20:33.244285 [ 32159 ] {} RaftInstance: skipped config 26, latest config 40 2025.04.02 05:20:33.244379 [ 32159 ] {} RaftInstance: config at index 27 is committed, prev config log idx 40 2025.04.02 05:20:33.244431 [ 32159 ] {} RaftInstance: skipped config 27, latest config 40 2025.04.02 05:20:33.244524 [ 32159 ] {} RaftInstance: config at index 28 is committed, prev config log idx 40 2025.04.02 05:20:33.244571 [ 32159 ] {} RaftInstance: skipped config 28, latest config 40 2025.04.02 05:20:33.244674 [ 32159 ] {} RaftInstance: config at index 29 is committed, prev config log idx 40 2025.04.02 05:20:33.244729 [ 32159 ] {} RaftInstance: skipped config 29, latest config 40 2025.04.02 05:20:33.244817 [ 32159 ] {} RaftInstance: config at index 30 is committed, prev config log idx 40 2025.04.02 05:20:33.244874 [ 32159 ] {} RaftInstance: skipped config 30, latest config 40 2025.04.02 05:20:33.244969 [ 32159 ] {} RaftInstance: config at index 31 is committed, prev config log idx 40 2025.04.02 05:20:33.245032 [ 32159 ] {} RaftInstance: skipped config 31, latest config 40 2025.04.02 05:20:33.245129 [ 32159 ] {} RaftInstance: config at index 32 is committed, prev config log idx 40 2025.04.02 05:20:33.245181 [ 32159 ] {} RaftInstance: skipped config 32, latest config 40 2025.04.02 05:20:33.245291 [ 32159 ] {} RaftInstance: config at index 33 is committed, prev config log idx 40 2025.04.02 05:20:33.245344 [ 32159 ] {} RaftInstance: skipped config 33, latest config 40 2025.04.02 05:20:33.245435 [ 32159 ] {} RaftInstance: config at index 34 is committed, prev config log idx 40 2025.04.02 05:20:33.245486 [ 32159 ] {} RaftInstance: skipped config 34, latest config 40 2025.04.02 05:20:33.245576 [ 32159 ] {} RaftInstance: config at index 35 is committed, prev config log idx 40 2025.04.02 05:20:33.245631 [ 32159 ] {} RaftInstance: skipped config 35, latest config 40 2025.04.02 05:20:33.245718 [ 32159 ] {} RaftInstance: config at index 36 is committed, prev config log idx 40 2025.04.02 05:20:33.245773 [ 32159 ] {} RaftInstance: skipped config 36, latest config 40 2025.04.02 05:20:33.245880 [ 32159 ] {} RaftInstance: config at index 37 is committed, prev config log idx 40 2025.04.02 05:20:33.245926 [ 32159 ] {} RaftInstance: skipped config 37, latest config 40 2025.04.02 05:20:33.246017 [ 32159 ] {} RaftInstance: config at index 38 is committed, prev config log idx 40 2025.04.02 05:20:33.246069 [ 32159 ] {} RaftInstance: skipped config 38, latest config 40 2025.04.02 05:20:33.246164 [ 32159 ] {} RaftInstance: config at index 39 is committed, prev config log idx 40 2025.04.02 05:20:33.246210 [ 32159 ] {} RaftInstance: skipped config 39, latest config 40 2025.04.02 05:20:33.246321 [ 32159 ] {} RaftInstance: config at index 40 is committed, prev config log idx 40 2025.04.02 05:20:33.246376 [ 32159 ] {} RaftInstance: skipped config 40, latest config 40 2025.04.02 05:20:33.246521 [ 32159 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:33.246579 [ 32159 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:33.246659 [ 32159 ] {} RaftInstance: config at index 41 is committed, prev config log idx 40 2025.04.02 05:20:33.246741 [ 32159 ] {} RaftInstance: new config log idx 41, prev log idx 40, cur config log idx 40, prev log idx 39 2025.04.02 05:20:33.246884 [ 32159 ] {} RaftInstance: new configuration: log idx 41, prev log idx 40 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 41 2025.04.02 05:20:33.247118 [ 31551 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:33.248048 [ 31551 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:33.249828 [ 31551 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:33.250181 [ 31551 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:33.261670 [ 31551 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:33.261764 [ 31551 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:33.262846 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:33.263173 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:33.263788 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:33.264028 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:33.264229 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:33.264498 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:33.264749 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:33.265078 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:33.269491 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:33.270054 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:33.270572 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:33.271182 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:33.271745 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:33.272324 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:33.272876 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:33.273533 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:33.274167 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:33.274830 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:33.275197 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:33.275614 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:33.276142 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:33.276760 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:33.277610 [ 31551 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:33.285940 [ 31551 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:33.286320 [ 31551 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:33.295127 [ 31551 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:33.295343 [ 31551 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:33.299635 [ 31551 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:33.301298 [ 31551 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:33.301949 [ 31551 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:33.302546 [ 32167 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:33.311378 [ 31551 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:33.314914 [ 31551 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:33.320473 [ 31551 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:33.323489 [ 31551 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:33.329086 [ 31551 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:33.331816 [ 31551 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:33.333907 [ 31551 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:33.335685 [ 31551 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:33.335812 [ 31551 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:33.335894 [ 31565 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:33.336662 [ 31565 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:37.895151 [ 31551 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:37.895567 [ 31551 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:37.896019 [ 31551 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:37.896085 [ 31551 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:37.896333 [ 31564 ] {} CancellationChecker: Execution took 5208 ms. 2025.04.02 05:20:37.896623 [ 31551 ] {} Application: Shutting down storages. 2025.04.02 05:20:37.896707 [ 31551 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:37.898109 [ 31551 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:37.898153 [ 31551 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:37.898177 [ 31551 ] {} Context: Shutting down named sessions 2025.04.02 05:20:37.898241 [ 31551 ] {} Context: Shutting down database catalog 2025.04.02 05:20:37.898288 [ 31551 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:37.898347 [ 31551 ] {} Context: Shutting down merges executor 2025.04.02 05:20:37.898790 [ 31551 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:37.899476 [ 31551 ] {} Context: Shutting down moves executor 2025.04.02 05:20:37.899715 [ 31551 ] {} Context: Shutting down common executor 2025.04.02 05:20:37.899938 [ 31551 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:37.899976 [ 31551 ] {} Context: Shutting down caches 2025.04.02 05:20:37.900012 [ 31551 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:37.900331 [ 31551 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:37.903085 [ 31551 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:37.913918 [ 31551 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:37.914328 [ 31551 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:37.915037 [ 31551 ] {} Application: Shut down storages. 2025.04.02 05:20:37.915114 [ 31551 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:38.256722 [ 31551 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:38.256920 [ 31551 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:38.257792 [ 31551 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:38.750055 [ 31551 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:38.750202 [ 31551 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:38.750305 [ 31551 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:38.750366 [ 31551 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:38.750438 [ 31551 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:38.750485 [ 31551 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:38.750528 [ 31551 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:38.750754 [ 31551 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:38.750790 [ 32160 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:38.750991 [ 31551 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:38.751047 [ 31551 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:38.751084 [ 31551 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:38.751393 [ 32146 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:20:38.751540 [ 32143 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:38.751597 [ 32145 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:38.751664 [ 32144 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:38.751819 [ 32148 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:38.752192 [ 32146 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:38.752009 [ 32151 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:20:38.752001 [ 32152 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:20:38.752398 [ 32158 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:38.752442 [ 32155 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:20:38.752429 [ 32154 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:38.752072 [ 32147 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:38.752360 [ 32149 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:38.752360 [ 32157 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:38.752077 [ 32153 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:38.752352 [ 32156 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:38.752002 [ 32150 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:38.753099 [ 31551 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:38.753153 [ 32141 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:38.753347 [ 32142 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:20:38.754012 [ 31551 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:38.754164 [ 31551 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:38.754209 [ 31551 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:38.754304 [ 31551 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:38.754359 [ 31551 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:38.754584 [ 31551 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:38.754625 [ 31551 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:38.758072 [ 31551 ] {} Application: Destroyed global context. 2025.04.02 05:20:38.758640 [ 31551 ] {} Application: Waiting for background threads 2025.04.02 05:20:38.834012 [ 31551 ] {} Application: Background threads finished in 75 ms 2025.04.02 05:20:38.834694 [ 31551 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:38.834753 [ 31551 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:38.855289 [ 31551 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:38.855664 [ 31551 ] {} Application: shutting down 2025.04.02 05:20:38.855719 [ 31551 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:38.864175 [ 31554 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:38.864335 [ 31554 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:38.994309 [ 31549 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:39.170245 [ 32276 ] {} Application: Will watch for the process with pid 32278 2025.04.02 05:20:39.171504 [ 32278 ] {} Application: Forked a child process to watch 2025.04.02 05:20:39.173316 [ 32278 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:39.690647 [ 32278 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 32278 2025.04.02 05:20:39.691650 [ 32278 ] {} Application: starting up 2025.04.02 05:20:39.691733 [ 32278 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:39.723221 [ 32278 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:39.723434 [ 32278 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:39.723524 [ 32278 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:39.723555 [ 32278 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:39.723576 [ 32278 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:39.725185 [ 32278 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:39.725670 [ 32278 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:39.725715 [ 32278 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:39.725889 [ 32278 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:39.725937 [ 32278 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:40.562751 [ 32278 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:40.564800 [ 32278 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:40.564868 [ 32278 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:40.565024 [ 32278 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:40.565586 [ 32278 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:40.748665 [ 32288 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:40.748978 [ 32278 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:40.749076 [ 32278 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:40.749142 [ 32278 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:40.749187 [ 32278 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:40.749578 [ 32278 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:40.750075 [ 32278 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:40.773644 [ 32278 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:40.773861 [ 32278 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:40.774445 [ 32278 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:40.775196 [ 32278 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:40.775336 [ 32278 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:40.776782 [ 32278 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:40.785461 [ 32278 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:40.785592 [ 32278 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:40.785780 [ 32278 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:40.786556 [ 32278 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:40.801531 [ 32278 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:40.801650 [ 32278 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:40.810025 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:40.811179 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:40.811566 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:40.812108 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:40.812533 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:40.817257 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:40.817739 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:40.818247 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:40.818634 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:40.818995 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:40.819466 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:40.819803 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:40.820168 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:40.820580 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:40.821118 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:40.821524 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:40.821915 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:40.822301 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:40.822773 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:40.823162 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:40.823608 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:40.824074 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:40.824872 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:40.826004 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:40.826376 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:40.827552 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:40.828859 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:40.829291 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:40.829787 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:40.830255 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:40.830702 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:40.831100 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:40.831595 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:40.832002 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:40.832494 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:40.832869 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:40.833357 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:40.833865 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:40.834311 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:40.835542 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:40.836162 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:40.836619 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:40.837112 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:40.837591 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:40.838048 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:40.838651 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:40.839107 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:40.839623 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:40.840118 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:40.842699 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:40.843523 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:40.844513 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:40.845130 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:40.845584 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:40.845970 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:40.846720 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:40.847186 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:40.847804 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:40.848197 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:40.848657 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:40.849106 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:40.849809 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:40.850238 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:40.850798 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:40.851538 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:40.852048 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:40.853934 [ 32278 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:40.900756 [ 32278 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:40.902680 [ 32278 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:40.938097 [ 32278 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:40.938202 [ 32278 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:40.938245 [ 32278 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:40.954328 [ 32278 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:40.954432 [ 32278 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:40.954495 [ 32278 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:40.954640 [ 32278 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:40.962468 [ 32278 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:40.969815 [ 32278 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:40.983490 [ 32278 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:40.984133 [ 32278 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:40.984336 [ 32278 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:40.987151 [ 32278 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:40.987798 [ 32278 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:40.988123 [ 32278 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:40.989408 [ 32278 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:40.989491 [ 32278 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:40.991056 [ 32278 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:40.991099 [ 32278 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:40.991124 [ 32278 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:40.991165 [ 32278 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:40.991199 [ 32278 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:40.991429 [ 32278 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:40.991494 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.063607 [ 32278 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:41.074180 [ 32278 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:41.074296 [ 32278 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:41.075401 [ 32278 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:41.075550 [ 32278 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz 2025.04.02 05:20:41.075620 [ 32278 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz 2025.04.02 05:20:41.075671 [ 32278 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz, size 4 2025.04.02 05:20:41.076237 [ 32278 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz. 2025.04.02 05:20:41.076453 [ 32859 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz 2025.04.02 05:20:41.085010 [ 32859 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz, size 4 2025.04.02 05:20:41.085845 [ 32278 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/fqo/geckqkrquktyddhpdmcheaqiepovz. 2025.04.02 05:20:41.086156 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/fqo/geckqkrquktyddhpdmcheaqiepovz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.089393 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/fqo/geckqkrquktyddhpdmcheaqiepovz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.089500 [ 32278 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/fqo/geckqkrquktyddhpdmcheaqiepovz, Version: Latest, Offset: 2 2025.04.02 05:20:41.095377 [ 32278 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/fqo/geckqkrquktyddhpdmcheaqiepovz 2025.04.02 05:20:41.095462 [ 32278 ] {} deleteFileFromS3: Object with path s3/fqo/geckqkrquktyddhpdmcheaqiepovz was removed from S3 2025.04.02 05:20:41.095526 [ 32278 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:41.095594 [ 32278 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:41.098810 [ 32278 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:41.109039 [ 32278 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:41.109130 [ 32278 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:41.109743 [ 32278 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:41.119524 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.125106 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.125220 [ 32278 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:41.132143 [ 32278 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:41.132401 [ 32278 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:41 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326241F2C9A9DC x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:41.132566 [ 32278 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:41.137630 [ 32278 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:41.137692 [ 32278 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:41.137750 [ 32278 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:41.137798 [ 32278 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:41.137923 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.137996 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.138054 [ 32278 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:41.138114 [ 32278 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:41.138176 [ 32278 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:41.138229 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.138300 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.138361 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.138453 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.138519 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.141489 [ 32278 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:41.151375 [ 32278 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:41.151476 [ 32278 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:41.152246 [ 32278 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:41.159389 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ede/ltumfsbjnjlfryuazzfglhyeadscx (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.162288 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ede/ltumfsbjnjlfryuazzfglhyeadscx (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.162371 [ 32278 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ede/ltumfsbjnjlfryuazzfglhyeadscx, Version: Latest, Offset: 2 2025.04.02 05:20:41.168393 [ 32278 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ede/ltumfsbjnjlfryuazzfglhyeadscx 2025.04.02 05:20:41.168479 [ 32278 ] {} deleteFileFromS3: Object with path special/ede/ltumfsbjnjlfryuazzfglhyeadscx was removed from S3 2025.04.02 05:20:41.168549 [ 32278 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:41.168587 [ 32278 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:41.171845 [ 32278 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:41.181834 [ 32278 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:41.181925 [ 32278 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:41.182746 [ 32278 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:41.189157 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jxg/blsmwefcddfjupwmztztddjmcpcwp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.192169 [ 32278 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jxg/blsmwefcddfjupwmztztddjmcpcwp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:41.192255 [ 32278 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/jxg/blsmwefcddfjupwmztztddjmcpcwp, Version: Latest, Offset: 2 2025.04.02 05:20:41.197294 [ 32278 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/jxg/blsmwefcddfjupwmztztddjmcpcwp 2025.04.02 05:20:41.197356 [ 32278 ] {} deleteFileFromS3: Object with path test_02944/jxg/blsmwefcddfjupwmztztddjmcpcwp was removed from S3 2025.04.02 05:20:41.197402 [ 32278 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:41.197439 [ 32278 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:41.197578 [ 32278 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:41.200770 [ 32278 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:41.205561 [ 32278 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:41.205699 [ 32278 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:41.207255 [ 32278 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:41.207495 [ 32278 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:41.208827 [ 32278 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:41.208887 [ 32278 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:41.208926 [ 32278 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:41.208961 [ 32278 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:41.208995 [ 32278 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:41.209687 [ 32278 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 41 entries 2025.04.02 05:20:41.209758 [ 32278 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:41.209870 [ 32278 ] {} KeeperServer: Last local log idx 41 2025.04.02 05:20:41.209920 [ 32278 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 41 2025.04.02 05:20:41.211180 [ 32278 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:41.222701 [ 32278 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:41.223155 [ 32278 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:41.223289 [ 32278 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:41.223364 [ 32278 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:41.223455 [ 32278 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:41.223501 [ 32278 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:41.223587 [ 32278 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 41 election timer allowed log store start 1, end 41 config log idx 41, prev log idx 40 -- ASYNC REPLICATION -- 2025.04.02 05:20:41.223630 [ 32278 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:41.223697 [ 32278 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:41.223757 [ 32278 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:41.224512 [ 32278 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:41.224608 [ 32886 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:41.275077 [ 32869 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:41.275294 [ 32869 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:41.275427 [ 32869 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 41, state term 41, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:41.275489 [ 32869 ] {} RaftInstance: pre-vote term (0) is different, reset it to 41 2025.04.02 05:20:41.275716 [ 32278 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:41.275822 [ 32869 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:41.278901 [ 32869 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 42, log idx 41, log term 41, priority (target 1 / mine 1) 2025.04.02 05:20:41.278985 [ 32869 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:41.279049 [ 32869 ] {} RaftInstance: state machine commit index 0, precommit index 41, last log index 41 2025.04.02 05:20:41.279108 [ 32869 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:41.279405 [ 32867 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:41.279600 [ 32869 ] {} RaftInstance: [BECOME LEADER] appended new config at 42 2025.04.02 05:20:41.279920 [ 32885 ] {} RaftInstance: config at index 1 is committed, prev config log idx 41 2025.04.02 05:20:41.280020 [ 32885 ] {} RaftInstance: skipped config 1, latest config 41 2025.04.02 05:20:41.280169 [ 32885 ] {} RaftInstance: config at index 2 is committed, prev config log idx 41 2025.04.02 05:20:41.280217 [ 32885 ] {} RaftInstance: skipped config 2, latest config 41 2025.04.02 05:20:41.280320 [ 32885 ] {} RaftInstance: config at index 3 is committed, prev config log idx 41 2025.04.02 05:20:41.280373 [ 32885 ] {} RaftInstance: skipped config 3, latest config 41 2025.04.02 05:20:41.280458 [ 32885 ] {} RaftInstance: config at index 4 is committed, prev config log idx 41 2025.04.02 05:20:41.280509 [ 32885 ] {} RaftInstance: skipped config 4, latest config 41 2025.04.02 05:20:41.280595 [ 32885 ] {} RaftInstance: config at index 5 is committed, prev config log idx 41 2025.04.02 05:20:41.280638 [ 32885 ] {} RaftInstance: skipped config 5, latest config 41 2025.04.02 05:20:41.280723 [ 32885 ] {} RaftInstance: config at index 6 is committed, prev config log idx 41 2025.04.02 05:20:41.280758 [ 32885 ] {} RaftInstance: skipped config 6, latest config 41 2025.04.02 05:20:41.280829 [ 32885 ] {} RaftInstance: config at index 7 is committed, prev config log idx 41 2025.04.02 05:20:41.280870 [ 32885 ] {} RaftInstance: skipped config 7, latest config 41 2025.04.02 05:20:41.280951 [ 32885 ] {} RaftInstance: config at index 8 is committed, prev config log idx 41 2025.04.02 05:20:41.281005 [ 32885 ] {} RaftInstance: skipped config 8, latest config 41 2025.04.02 05:20:41.281096 [ 32885 ] {} RaftInstance: config at index 9 is committed, prev config log idx 41 2025.04.02 05:20:41.281131 [ 32885 ] {} RaftInstance: skipped config 9, latest config 41 2025.04.02 05:20:41.281200 [ 32885 ] {} RaftInstance: config at index 10 is committed, prev config log idx 41 2025.04.02 05:20:41.281235 [ 32885 ] {} RaftInstance: skipped config 10, latest config 41 2025.04.02 05:20:41.281327 [ 32885 ] {} RaftInstance: config at index 11 is committed, prev config log idx 41 2025.04.02 05:20:41.281373 [ 32885 ] {} RaftInstance: skipped config 11, latest config 41 2025.04.02 05:20:41.281442 [ 32885 ] {} RaftInstance: config at index 12 is committed, prev config log idx 41 2025.04.02 05:20:41.281474 [ 32885 ] {} RaftInstance: skipped config 12, latest config 41 2025.04.02 05:20:41.281542 [ 32885 ] {} RaftInstance: config at index 13 is committed, prev config log idx 41 2025.04.02 05:20:41.281592 [ 32885 ] {} RaftInstance: skipped config 13, latest config 41 2025.04.02 05:20:41.281674 [ 32885 ] {} RaftInstance: config at index 14 is committed, prev config log idx 41 2025.04.02 05:20:41.281711 [ 32885 ] {} RaftInstance: skipped config 14, latest config 41 2025.04.02 05:20:41.281787 [ 32885 ] {} RaftInstance: config at index 15 is committed, prev config log idx 41 2025.04.02 05:20:41.281820 [ 32885 ] {} RaftInstance: skipped config 15, latest config 41 2025.04.02 05:20:41.281896 [ 32885 ] {} RaftInstance: config at index 16 is committed, prev config log idx 41 2025.04.02 05:20:41.281943 [ 32885 ] {} RaftInstance: skipped config 16, latest config 41 2025.04.02 05:20:41.282019 [ 32885 ] {} RaftInstance: config at index 17 is committed, prev config log idx 41 2025.04.02 05:20:41.282061 [ 32885 ] {} RaftInstance: skipped config 17, latest config 41 2025.04.02 05:20:41.282157 [ 32885 ] {} RaftInstance: config at index 18 is committed, prev config log idx 41 2025.04.02 05:20:41.282205 [ 32885 ] {} RaftInstance: skipped config 18, latest config 41 2025.04.02 05:20:41.282300 [ 32885 ] {} RaftInstance: config at index 19 is committed, prev config log idx 41 2025.04.02 05:20:41.282342 [ 32885 ] {} RaftInstance: skipped config 19, latest config 41 2025.04.02 05:20:41.282435 [ 32885 ] {} RaftInstance: config at index 20 is committed, prev config log idx 41 2025.04.02 05:20:41.282473 [ 32885 ] {} RaftInstance: skipped config 20, latest config 41 2025.04.02 05:20:41.282540 [ 32885 ] {} RaftInstance: config at index 21 is committed, prev config log idx 41 2025.04.02 05:20:41.282576 [ 32885 ] {} RaftInstance: skipped config 21, latest config 41 2025.04.02 05:20:41.282646 [ 32885 ] {} RaftInstance: config at index 22 is committed, prev config log idx 41 2025.04.02 05:20:41.282697 [ 32885 ] {} RaftInstance: skipped config 22, latest config 41 2025.04.02 05:20:41.282767 [ 32885 ] {} RaftInstance: config at index 23 is committed, prev config log idx 41 2025.04.02 05:20:41.282808 [ 32885 ] {} RaftInstance: skipped config 23, latest config 41 2025.04.02 05:20:41.282889 [ 32885 ] {} RaftInstance: config at index 24 is committed, prev config log idx 41 2025.04.02 05:20:41.282926 [ 32885 ] {} RaftInstance: skipped config 24, latest config 41 2025.04.02 05:20:41.282998 [ 32885 ] {} RaftInstance: config at index 25 is committed, prev config log idx 41 2025.04.02 05:20:41.283043 [ 32885 ] {} RaftInstance: skipped config 25, latest config 41 2025.04.02 05:20:41.283168 [ 32885 ] {} RaftInstance: config at index 26 is committed, prev config log idx 41 2025.04.02 05:20:41.283210 [ 32885 ] {} RaftInstance: skipped config 26, latest config 41 2025.04.02 05:20:41.283300 [ 32885 ] {} RaftInstance: config at index 27 is committed, prev config log idx 41 2025.04.02 05:20:41.283343 [ 32885 ] {} RaftInstance: skipped config 27, latest config 41 2025.04.02 05:20:41.283431 [ 32885 ] {} RaftInstance: config at index 28 is committed, prev config log idx 41 2025.04.02 05:20:41.283474 [ 32885 ] {} RaftInstance: skipped config 28, latest config 41 2025.04.02 05:20:41.283567 [ 32885 ] {} RaftInstance: config at index 29 is committed, prev config log idx 41 2025.04.02 05:20:41.283637 [ 32885 ] {} RaftInstance: skipped config 29, latest config 41 2025.04.02 05:20:41.283729 [ 32885 ] {} RaftInstance: config at index 30 is committed, prev config log idx 41 2025.04.02 05:20:41.283775 [ 32885 ] {} RaftInstance: skipped config 30, latest config 41 2025.04.02 05:20:41.283853 [ 32885 ] {} RaftInstance: config at index 31 is committed, prev config log idx 41 2025.04.02 05:20:41.283908 [ 32885 ] {} RaftInstance: skipped config 31, latest config 41 2025.04.02 05:20:41.283984 [ 32885 ] {} RaftInstance: config at index 32 is committed, prev config log idx 41 2025.04.02 05:20:41.284024 [ 32885 ] {} RaftInstance: skipped config 32, latest config 41 2025.04.02 05:20:41.284107 [ 32885 ] {} RaftInstance: config at index 33 is committed, prev config log idx 41 2025.04.02 05:20:41.284146 [ 32885 ] {} RaftInstance: skipped config 33, latest config 41 2025.04.02 05:20:41.284218 [ 32885 ] {} RaftInstance: config at index 34 is committed, prev config log idx 41 2025.04.02 05:20:41.284258 [ 32885 ] {} RaftInstance: skipped config 34, latest config 41 2025.04.02 05:20:41.284373 [ 32885 ] {} RaftInstance: config at index 35 is committed, prev config log idx 41 2025.04.02 05:20:41.284420 [ 32885 ] {} RaftInstance: skipped config 35, latest config 41 2025.04.02 05:20:41.284498 [ 32885 ] {} RaftInstance: config at index 36 is committed, prev config log idx 41 2025.04.02 05:20:41.284541 [ 32885 ] {} RaftInstance: skipped config 36, latest config 41 2025.04.02 05:20:41.284615 [ 32885 ] {} RaftInstance: config at index 37 is committed, prev config log idx 41 2025.04.02 05:20:41.284654 [ 32885 ] {} RaftInstance: skipped config 37, latest config 41 2025.04.02 05:20:41.284750 [ 32885 ] {} RaftInstance: config at index 38 is committed, prev config log idx 41 2025.04.02 05:20:41.284795 [ 32885 ] {} RaftInstance: skipped config 38, latest config 41 2025.04.02 05:20:41.284879 [ 32885 ] {} RaftInstance: config at index 39 is committed, prev config log idx 41 2025.04.02 05:20:41.284919 [ 32885 ] {} RaftInstance: skipped config 39, latest config 41 2025.04.02 05:20:41.284996 [ 32885 ] {} RaftInstance: config at index 40 is committed, prev config log idx 41 2025.04.02 05:20:41.285043 [ 32885 ] {} RaftInstance: skipped config 40, latest config 41 2025.04.02 05:20:41.285132 [ 32885 ] {} RaftInstance: config at index 41 is committed, prev config log idx 41 2025.04.02 05:20:41.285181 [ 32885 ] {} RaftInstance: skipped config 41, latest config 41 2025.04.02 05:20:41.285285 [ 32885 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:41.285362 [ 32885 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:41.285435 [ 32885 ] {} RaftInstance: config at index 42 is committed, prev config log idx 41 2025.04.02 05:20:41.285502 [ 32885 ] {} RaftInstance: new config log idx 42, prev log idx 41, cur config log idx 41, prev log idx 40 2025.04.02 05:20:41.285609 [ 32885 ] {} RaftInstance: new configuration: log idx 42, prev log idx 41 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 42 2025.04.02 05:20:41.285818 [ 32278 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:41.286856 [ 32278 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:41.289001 [ 32278 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:41.289368 [ 32278 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:41.303224 [ 32278 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:41.303352 [ 32278 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:41.304598 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:41.305072 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:41.305813 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:41.306114 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:41.306566 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:41.306857 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:41.307146 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:41.307534 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:41.311366 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:41.311876 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:41.312258 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:41.312605 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:41.312981 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:41.313342 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:41.313697 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:41.314071 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:41.314547 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:41.315036 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:41.315378 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:41.315827 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:41.316166 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:41.316639 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:41.317481 [ 32278 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:41.324953 [ 32278 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:41.325206 [ 32278 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:41.332205 [ 32278 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:41.332375 [ 32278 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:41.335653 [ 32278 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:41.337076 [ 32278 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:41.337836 [ 32278 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:41.338500 [ 32891 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:41.347113 [ 32278 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:41.349970 [ 32278 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:41.355783 [ 32278 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:41.359532 [ 32278 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:41.367089 [ 32278 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:41.371082 [ 32278 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:41.373793 [ 32278 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:41.376259 [ 32278 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:41.376433 [ 32278 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:41.376518 [ 32289 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:41.377847 [ 32289 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:46.003168 [ 32278 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:46.003597 [ 32278 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:46.004034 [ 32278 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:46.004093 [ 32278 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:46.004290 [ 32288 ] {} CancellationChecker: Execution took 5255 ms. 2025.04.02 05:20:46.004606 [ 32278 ] {} Application: Shutting down storages. 2025.04.02 05:20:46.004655 [ 32278 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:46.006106 [ 32278 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:46.006158 [ 32278 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:46.006201 [ 32278 ] {} Context: Shutting down named sessions 2025.04.02 05:20:46.006271 [ 32278 ] {} Context: Shutting down database catalog 2025.04.02 05:20:46.006333 [ 32278 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:46.006412 [ 32278 ] {} Context: Shutting down merges executor 2025.04.02 05:20:46.006772 [ 32278 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:46.007163 [ 32278 ] {} Context: Shutting down moves executor 2025.04.02 05:20:46.007511 [ 32278 ] {} Context: Shutting down common executor 2025.04.02 05:20:46.007801 [ 32278 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:46.007861 [ 32278 ] {} Context: Shutting down caches 2025.04.02 05:20:46.007929 [ 32278 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:46.008321 [ 32278 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:46.010776 [ 32278 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:46.021016 [ 32278 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:46.021325 [ 32278 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:46.021996 [ 32278 ] {} Application: Shut down storages. 2025.04.02 05:20:46.022071 [ 32278 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:46.295902 [ 32278 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:46.296021 [ 32278 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:46.296083 [ 32278 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:46.788938 [ 32278 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:46.789110 [ 32278 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:46.789191 [ 32278 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:46.789258 [ 32278 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:46.789343 [ 32278 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:46.789396 [ 32278 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:46.789455 [ 32278 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:46.789572 [ 32278 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:46.789590 [ 32886 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:46.789752 [ 32278 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:46.789821 [ 32278 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:46.789895 [ 32278 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:46.790544 [ 32873 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:46.790608 [ 32876 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:46.790688 [ 32870 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:46.790656 [ 32874 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:46.790837 [ 32880 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:20:46.791046 [ 32869 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:46.790859 [ 32872 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:46.791174 [ 32871 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:46.790888 [ 32878 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:46.790900 [ 32875 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:20:46.791119 [ 32882 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:46.791094 [ 32877 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:46.791104 [ 32879 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:46.790955 [ 32881 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:46.791201 [ 32884 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:46.791144 [ 32883 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:20:46.791997 [ 32278 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:46.792046 [ 32867 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:46.792830 [ 32278 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:46.792992 [ 32278 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:46.793040 [ 32278 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:46.793114 [ 32278 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:46.793167 [ 32278 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:46.793351 [ 32278 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:46.793396 [ 32278 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:46.796963 [ 32278 ] {} Application: Destroyed global context. 2025.04.02 05:20:46.797603 [ 32278 ] {} Application: Waiting for background threads 2025.04.02 05:20:46.867918 [ 32278 ] {} Application: Background threads finished in 70 ms 2025.04.02 05:20:46.868686 [ 32278 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:46.868762 [ 32278 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:46.882801 [ 32278 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:46.883173 [ 32278 ] {} Application: shutting down 2025.04.02 05:20:46.883222 [ 32278 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:46.890068 [ 32281 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:46.890503 [ 32281 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:47.007028 [ 32276 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:47.347314 [ 33003 ] {} Application: Will watch for the process with pid 33005 2025.04.02 05:20:47.348177 [ 33005 ] {} Application: Forked a child process to watch 2025.04.02 05:20:47.349266 [ 33005 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:47.825089 [ 33005 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 33005 2025.04.02 05:20:47.826003 [ 33005 ] {} Application: starting up 2025.04.02 05:20:47.826090 [ 33005 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:47.856408 [ 33005 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:47.856596 [ 33005 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:47.856658 [ 33005 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:47.856687 [ 33005 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:47.856707 [ 33005 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:47.858492 [ 33005 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:47.858895 [ 33005 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:47.858938 [ 33005 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:47.859096 [ 33005 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:47.859143 [ 33005 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:48.675254 [ 33005 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:48.677326 [ 33005 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:48.677393 [ 33005 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:48.677538 [ 33005 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:48.678110 [ 33005 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:48.844823 [ 33014 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:48.845097 [ 33005 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:48.845205 [ 33005 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:48.845259 [ 33005 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:48.845308 [ 33005 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:48.845607 [ 33005 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:48.846039 [ 33005 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:48.864190 [ 33005 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:48.864349 [ 33005 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:48.864662 [ 33005 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:48.865133 [ 33005 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:48.865213 [ 33005 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:48.866106 [ 33005 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:48.871262 [ 33005 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:48.871358 [ 33005 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:48.871468 [ 33005 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:48.871936 [ 33005 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:48.884348 [ 33005 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:48.884440 [ 33005 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:48.892399 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:48.893431 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:48.893806 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:48.894293 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:48.894713 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:48.899031 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:48.899452 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:48.899830 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:48.900172 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:48.900530 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:48.900968 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:48.901314 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:48.901665 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:48.902004 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:48.902547 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:48.902877 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:48.903243 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:48.903615 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:48.904017 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:48.904383 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:48.904767 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:48.905145 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:48.905882 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:48.906973 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:48.907332 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:48.908261 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:48.909380 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:48.909778 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:48.910122 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:48.910534 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:48.910907 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:48.911300 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:48.911785 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:48.912144 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:48.912637 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:48.913020 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:48.913509 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:48.914002 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:48.914469 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:48.915607 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:48.916196 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:48.916610 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:48.917048 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:48.917498 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:48.917921 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:48.918492 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:48.918909 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:48.919391 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:48.919853 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:48.922340 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:48.923156 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:48.924090 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:48.924711 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:48.925115 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:48.925507 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:48.926227 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:48.926755 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:48.927349 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:48.927741 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:48.928170 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:48.928615 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:48.929293 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:48.929732 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:48.930254 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:48.930987 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:48.931485 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:48.933312 [ 33005 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:48.979230 [ 33005 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:48.980918 [ 33005 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:49.016902 [ 33005 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:49.016995 [ 33005 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:49.017040 [ 33005 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:49.032359 [ 33005 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:49.032433 [ 33005 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:49.032489 [ 33005 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:49.032615 [ 33005 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:49.038877 [ 33005 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:49.045825 [ 33005 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:49.058044 [ 33005 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:49.058534 [ 33005 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:49.058695 [ 33005 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:49.060829 [ 33005 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:49.061465 [ 33005 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:49.061744 [ 33005 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:49.062776 [ 33005 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:49.062842 [ 33005 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:49.064292 [ 33005 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:49.064334 [ 33005 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:49.064358 [ 33005 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:49.064398 [ 33005 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:49.064420 [ 33005 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:49.064587 [ 33005 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:49.064645 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.134543 [ 33005 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:49.144592 [ 33005 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:49.144683 [ 33005 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:49.145691 [ 33005 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:49.145844 [ 33005 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp 2025.04.02 05:20:49.145912 [ 33005 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp 2025.04.02 05:20:49.145973 [ 33005 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp, size 4 2025.04.02 05:20:49.146603 [ 33005 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp. 2025.04.02 05:20:49.146869 [ 33586 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp 2025.04.02 05:20:49.154909 [ 33586 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp, size 4 2025.04.02 05:20:49.156154 [ 33005 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/qum/parwwdhymtgvipvvsosmgfgdibxhp. 2025.04.02 05:20:49.156724 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qum/parwwdhymtgvipvvsosmgfgdibxhp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.161396 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qum/parwwdhymtgvipvvsosmgfgdibxhp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.161506 [ 33005 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/qum/parwwdhymtgvipvvsosmgfgdibxhp, Version: Latest, Offset: 2 2025.04.02 05:20:49.168237 [ 33005 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/qum/parwwdhymtgvipvvsosmgfgdibxhp 2025.04.02 05:20:49.168314 [ 33005 ] {} deleteFileFromS3: Object with path s3/qum/parwwdhymtgvipvvsosmgfgdibxhp was removed from S3 2025.04.02 05:20:49.168371 [ 33005 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:49.168430 [ 33005 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:49.171668 [ 33005 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:49.181660 [ 33005 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:49.181741 [ 33005 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:49.182266 [ 33005 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:49.193253 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.198346 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.198477 [ 33005 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:49.205726 [ 33005 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:49.205945 [ 33005 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:49 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326243D3FEE549 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:49.206122 [ 33005 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:49.211684 [ 33005 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:49.211744 [ 33005 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:49.211809 [ 33005 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:49.211860 [ 33005 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:49.211982 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.212052 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.212116 [ 33005 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:49.212171 [ 33005 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:49.212239 [ 33005 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:49.212317 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.212388 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.212451 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.212503 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.212563 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.215670 [ 33005 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:49.225719 [ 33005 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:49.225812 [ 33005 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:49.226617 [ 33005 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:49.233578 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/grh/vkrfryhvutosmtqhfcysqegemxuvw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.236540 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/grh/vkrfryhvutosmtqhfcysqegemxuvw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.236622 [ 33005 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/grh/vkrfryhvutosmtqhfcysqegemxuvw, Version: Latest, Offset: 2 2025.04.02 05:20:49.242260 [ 33005 ] {} deleteFileFromS3: No blob storage log, not writing blob special/grh/vkrfryhvutosmtqhfcysqegemxuvw 2025.04.02 05:20:49.242360 [ 33005 ] {} deleteFileFromS3: Object with path special/grh/vkrfryhvutosmtqhfcysqegemxuvw was removed from S3 2025.04.02 05:20:49.242436 [ 33005 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:49.242478 [ 33005 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:49.245623 [ 33005 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:49.255462 [ 33005 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:49.255571 [ 33005 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:49.256361 [ 33005 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:49.264901 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vql/auwdblbcyivhfqtmmxmxangtoysct (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.267932 [ 33005 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vql/auwdblbcyivhfqtmmxmxangtoysct (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:49.268009 [ 33005 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/vql/auwdblbcyivhfqtmmxmxangtoysct, Version: Latest, Offset: 2 2025.04.02 05:20:49.273831 [ 33005 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/vql/auwdblbcyivhfqtmmxmxangtoysct 2025.04.02 05:20:49.273894 [ 33005 ] {} deleteFileFromS3: Object with path test_02944/vql/auwdblbcyivhfqtmmxmxangtoysct was removed from S3 2025.04.02 05:20:49.273940 [ 33005 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:49.273976 [ 33005 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:49.274118 [ 33005 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:49.277434 [ 33005 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:49.281599 [ 33005 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:49.281723 [ 33005 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:49.283326 [ 33005 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:49.283510 [ 33005 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:49.284400 [ 33005 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:49.284503 [ 33005 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:49.284546 [ 33005 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:49.284581 [ 33005 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:49.284616 [ 33005 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:49.285307 [ 33005 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 42 entries 2025.04.02 05:20:49.285389 [ 33005 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:49.285502 [ 33005 ] {} KeeperServer: Last local log idx 42 2025.04.02 05:20:49.285553 [ 33005 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 42 2025.04.02 05:20:49.286788 [ 33005 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:49.297878 [ 33005 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:49.298338 [ 33005 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:49.298472 [ 33005 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:49.298535 [ 33005 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:49.298611 [ 33005 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:49.298670 [ 33005 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:49.298755 [ 33005 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 42 election timer allowed log store start 1, end 42 config log idx 42, prev log idx 41 -- ASYNC REPLICATION -- 2025.04.02 05:20:49.298797 [ 33005 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:49.298859 [ 33005 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:49.298919 [ 33005 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:49.299612 [ 33005 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:49.299705 [ 33613 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:49.350173 [ 33596 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:49.350556 [ 33596 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:49.350584 [ 33005 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:49.350731 [ 33596 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 42, state term 42, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:49.350877 [ 33596 ] {} RaftInstance: pre-vote term (0) is different, reset it to 42 2025.04.02 05:20:49.351300 [ 33596 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:49.354845 [ 33596 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 43, log idx 42, log term 42, priority (target 1 / mine 1) 2025.04.02 05:20:49.354980 [ 33596 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:49.355092 [ 33596 ] {} RaftInstance: state machine commit index 0, precommit index 42, last log index 42 2025.04.02 05:20:49.355195 [ 33596 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:49.355634 [ 33594 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:49.355850 [ 33596 ] {} RaftInstance: [BECOME LEADER] appended new config at 43 2025.04.02 05:20:49.356368 [ 33612 ] {} RaftInstance: config at index 1 is committed, prev config log idx 42 2025.04.02 05:20:49.356520 [ 33612 ] {} RaftInstance: skipped config 1, latest config 42 2025.04.02 05:20:49.356635 [ 33612 ] {} RaftInstance: config at index 2 is committed, prev config log idx 42 2025.04.02 05:20:49.356668 [ 33612 ] {} RaftInstance: skipped config 2, latest config 42 2025.04.02 05:20:49.356726 [ 33612 ] {} RaftInstance: config at index 3 is committed, prev config log idx 42 2025.04.02 05:20:49.356760 [ 33612 ] {} RaftInstance: skipped config 3, latest config 42 2025.04.02 05:20:49.356816 [ 33612 ] {} RaftInstance: config at index 4 is committed, prev config log idx 42 2025.04.02 05:20:49.356845 [ 33612 ] {} RaftInstance: skipped config 4, latest config 42 2025.04.02 05:20:49.356895 [ 33612 ] {} RaftInstance: config at index 5 is committed, prev config log idx 42 2025.04.02 05:20:49.356924 [ 33612 ] {} RaftInstance: skipped config 5, latest config 42 2025.04.02 05:20:49.356976 [ 33612 ] {} RaftInstance: config at index 6 is committed, prev config log idx 42 2025.04.02 05:20:49.357002 [ 33612 ] {} RaftInstance: skipped config 6, latest config 42 2025.04.02 05:20:49.357051 [ 33612 ] {} RaftInstance: config at index 7 is committed, prev config log idx 42 2025.04.02 05:20:49.357088 [ 33612 ] {} RaftInstance: skipped config 7, latest config 42 2025.04.02 05:20:49.357138 [ 33612 ] {} RaftInstance: config at index 8 is committed, prev config log idx 42 2025.04.02 05:20:49.357181 [ 33612 ] {} RaftInstance: skipped config 8, latest config 42 2025.04.02 05:20:49.357232 [ 33612 ] {} RaftInstance: config at index 9 is committed, prev config log idx 42 2025.04.02 05:20:49.357256 [ 33612 ] {} RaftInstance: skipped config 9, latest config 42 2025.04.02 05:20:49.357323 [ 33612 ] {} RaftInstance: config at index 10 is committed, prev config log idx 42 2025.04.02 05:20:49.357361 [ 33612 ] {} RaftInstance: skipped config 10, latest config 42 2025.04.02 05:20:49.357420 [ 33612 ] {} RaftInstance: config at index 11 is committed, prev config log idx 42 2025.04.02 05:20:49.357446 [ 33612 ] {} RaftInstance: skipped config 11, latest config 42 2025.04.02 05:20:49.357512 [ 33612 ] {} RaftInstance: config at index 12 is committed, prev config log idx 42 2025.04.02 05:20:49.357538 [ 33612 ] {} RaftInstance: skipped config 12, latest config 42 2025.04.02 05:20:49.357588 [ 33612 ] {} RaftInstance: config at index 13 is committed, prev config log idx 42 2025.04.02 05:20:49.357618 [ 33612 ] {} RaftInstance: skipped config 13, latest config 42 2025.04.02 05:20:49.357667 [ 33612 ] {} RaftInstance: config at index 14 is committed, prev config log idx 42 2025.04.02 05:20:49.357692 [ 33612 ] {} RaftInstance: skipped config 14, latest config 42 2025.04.02 05:20:49.357744 [ 33612 ] {} RaftInstance: config at index 15 is committed, prev config log idx 42 2025.04.02 05:20:49.357767 [ 33612 ] {} RaftInstance: skipped config 15, latest config 42 2025.04.02 05:20:49.357827 [ 33612 ] {} RaftInstance: config at index 16 is committed, prev config log idx 42 2025.04.02 05:20:49.357853 [ 33612 ] {} RaftInstance: skipped config 16, latest config 42 2025.04.02 05:20:49.357901 [ 33612 ] {} RaftInstance: config at index 17 is committed, prev config log idx 42 2025.04.02 05:20:49.357926 [ 33612 ] {} RaftInstance: skipped config 17, latest config 42 2025.04.02 05:20:49.357975 [ 33612 ] {} RaftInstance: config at index 18 is committed, prev config log idx 42 2025.04.02 05:20:49.358004 [ 33612 ] {} RaftInstance: skipped config 18, latest config 42 2025.04.02 05:20:49.358051 [ 33612 ] {} RaftInstance: config at index 19 is committed, prev config log idx 42 2025.04.02 05:20:49.358073 [ 33612 ] {} RaftInstance: skipped config 19, latest config 42 2025.04.02 05:20:49.358114 [ 33612 ] {} RaftInstance: config at index 20 is committed, prev config log idx 42 2025.04.02 05:20:49.358137 [ 33612 ] {} RaftInstance: skipped config 20, latest config 42 2025.04.02 05:20:49.358185 [ 33612 ] {} RaftInstance: config at index 21 is committed, prev config log idx 42 2025.04.02 05:20:49.358208 [ 33612 ] {} RaftInstance: skipped config 21, latest config 42 2025.04.02 05:20:49.358251 [ 33612 ] {} RaftInstance: config at index 22 is committed, prev config log idx 42 2025.04.02 05:20:49.358273 [ 33612 ] {} RaftInstance: skipped config 22, latest config 42 2025.04.02 05:20:49.358336 [ 33612 ] {} RaftInstance: config at index 23 is committed, prev config log idx 42 2025.04.02 05:20:49.358363 [ 33612 ] {} RaftInstance: skipped config 23, latest config 42 2025.04.02 05:20:49.358464 [ 33612 ] {} RaftInstance: config at index 24 is committed, prev config log idx 42 2025.04.02 05:20:49.358494 [ 33612 ] {} RaftInstance: skipped config 24, latest config 42 2025.04.02 05:20:49.358566 [ 33612 ] {} RaftInstance: config at index 25 is committed, prev config log idx 42 2025.04.02 05:20:49.358604 [ 33612 ] {} RaftInstance: skipped config 25, latest config 42 2025.04.02 05:20:49.358681 [ 33612 ] {} RaftInstance: config at index 26 is committed, prev config log idx 42 2025.04.02 05:20:49.358706 [ 33612 ] {} RaftInstance: skipped config 26, latest config 42 2025.04.02 05:20:49.358771 [ 33612 ] {} RaftInstance: config at index 27 is committed, prev config log idx 42 2025.04.02 05:20:49.358821 [ 33612 ] {} RaftInstance: skipped config 27, latest config 42 2025.04.02 05:20:49.358909 [ 33612 ] {} RaftInstance: config at index 28 is committed, prev config log idx 42 2025.04.02 05:20:49.358937 [ 33612 ] {} RaftInstance: skipped config 28, latest config 42 2025.04.02 05:20:49.358987 [ 33612 ] {} RaftInstance: config at index 29 is committed, prev config log idx 42 2025.04.02 05:20:49.359012 [ 33612 ] {} RaftInstance: skipped config 29, latest config 42 2025.04.02 05:20:49.359054 [ 33612 ] {} RaftInstance: config at index 30 is committed, prev config log idx 42 2025.04.02 05:20:49.359080 [ 33612 ] {} RaftInstance: skipped config 30, latest config 42 2025.04.02 05:20:49.359123 [ 33612 ] {} RaftInstance: config at index 31 is committed, prev config log idx 42 2025.04.02 05:20:49.359150 [ 33612 ] {} RaftInstance: skipped config 31, latest config 42 2025.04.02 05:20:49.359193 [ 33612 ] {} RaftInstance: config at index 32 is committed, prev config log idx 42 2025.04.02 05:20:49.359217 [ 33612 ] {} RaftInstance: skipped config 32, latest config 42 2025.04.02 05:20:49.359274 [ 33612 ] {} RaftInstance: config at index 33 is committed, prev config log idx 42 2025.04.02 05:20:49.359313 [ 33612 ] {} RaftInstance: skipped config 33, latest config 42 2025.04.02 05:20:49.359356 [ 33612 ] {} RaftInstance: config at index 34 is committed, prev config log idx 42 2025.04.02 05:20:49.359378 [ 33612 ] {} RaftInstance: skipped config 34, latest config 42 2025.04.02 05:20:49.359422 [ 33612 ] {} RaftInstance: config at index 35 is committed, prev config log idx 42 2025.04.02 05:20:49.359458 [ 33612 ] {} RaftInstance: skipped config 35, latest config 42 2025.04.02 05:20:49.359508 [ 33612 ] {} RaftInstance: config at index 36 is committed, prev config log idx 42 2025.04.02 05:20:49.359534 [ 33612 ] {} RaftInstance: skipped config 36, latest config 42 2025.04.02 05:20:49.359577 [ 33612 ] {} RaftInstance: config at index 37 is committed, prev config log idx 42 2025.04.02 05:20:49.359598 [ 33612 ] {} RaftInstance: skipped config 37, latest config 42 2025.04.02 05:20:49.359645 [ 33612 ] {} RaftInstance: config at index 38 is committed, prev config log idx 42 2025.04.02 05:20:49.359668 [ 33612 ] {} RaftInstance: skipped config 38, latest config 42 2025.04.02 05:20:49.359715 [ 33612 ] {} RaftInstance: config at index 39 is committed, prev config log idx 42 2025.04.02 05:20:49.359738 [ 33612 ] {} RaftInstance: skipped config 39, latest config 42 2025.04.02 05:20:49.359780 [ 33612 ] {} RaftInstance: config at index 40 is committed, prev config log idx 42 2025.04.02 05:20:49.359804 [ 33612 ] {} RaftInstance: skipped config 40, latest config 42 2025.04.02 05:20:49.359846 [ 33612 ] {} RaftInstance: config at index 41 is committed, prev config log idx 42 2025.04.02 05:20:49.359869 [ 33612 ] {} RaftInstance: skipped config 41, latest config 42 2025.04.02 05:20:49.359910 [ 33612 ] {} RaftInstance: config at index 42 is committed, prev config log idx 42 2025.04.02 05:20:49.359932 [ 33612 ] {} RaftInstance: skipped config 42, latest config 42 2025.04.02 05:20:49.359994 [ 33612 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:49.360033 [ 33612 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:49.360074 [ 33612 ] {} RaftInstance: config at index 43 is committed, prev config log idx 42 2025.04.02 05:20:49.360126 [ 33612 ] {} RaftInstance: new config log idx 43, prev log idx 42, cur config log idx 42, prev log idx 41 2025.04.02 05:20:49.360219 [ 33612 ] {} RaftInstance: new configuration: log idx 43, prev log idx 42 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 43 2025.04.02 05:20:49.360405 [ 33005 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:49.361430 [ 33005 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:49.363425 [ 33005 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:49.363815 [ 33005 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:49.376034 [ 33005 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:49.376166 [ 33005 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:49.377391 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:49.377820 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:49.378446 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:49.378777 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:49.379048 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:49.379305 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:49.379543 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:49.379873 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:49.384025 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:49.384417 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:49.384737 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:49.385071 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:49.385414 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:49.385718 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:49.386021 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:49.386422 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:49.386789 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:49.387214 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:49.387563 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:49.387936 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:49.388306 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:49.388755 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:49.389524 [ 33005 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:49.396841 [ 33005 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:49.397064 [ 33005 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:49.403743 [ 33005 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:49.403877 [ 33005 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:49.407089 [ 33005 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:49.408330 [ 33005 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:49.409019 [ 33005 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:49.409604 [ 33618 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:49.417489 [ 33005 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:49.420472 [ 33005 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:49.426021 [ 33005 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:49.429664 [ 33005 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:49.436156 [ 33005 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:49.438044 [ 33005 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:49.439396 [ 33005 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:49.440533 [ 33005 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:49.440616 [ 33005 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:49.440764 [ 33015 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:49.442134 [ 33015 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:20:53.847933 [ 33005 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:53.848366 [ 33005 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:20:53.848793 [ 33005 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:20:53.848846 [ 33005 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:20:53.849061 [ 33014 ] {} CancellationChecker: Execution took 5004 ms. 2025.04.02 05:20:53.849330 [ 33005 ] {} Application: Shutting down storages. 2025.04.02 05:20:53.849387 [ 33005 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:20:53.850854 [ 33005 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:20:53.850895 [ 33005 ] {} Context: Shutting down workload entity storage 2025.04.02 05:20:53.850941 [ 33005 ] {} Context: Shutting down named sessions 2025.04.02 05:20:53.851001 [ 33005 ] {} Context: Shutting down database catalog 2025.04.02 05:20:53.851036 [ 33005 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:20:53.851098 [ 33005 ] {} Context: Shutting down merges executor 2025.04.02 05:20:53.851627 [ 33005 ] {} Context: Shutting down fetches executor 2025.04.02 05:20:53.851992 [ 33005 ] {} Context: Shutting down moves executor 2025.04.02 05:20:53.852362 [ 33005 ] {} Context: Shutting down common executor 2025.04.02 05:20:53.852673 [ 33005 ] {} Context: Shutting down DDLWorker 2025.04.02 05:20:53.852722 [ 33005 ] {} Context: Shutting down caches 2025.04.02 05:20:53.852784 [ 33005 ] {} Context: Shutting down AccessControl 2025.04.02 05:20:53.853163 [ 33005 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:20:53.855978 [ 33005 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:20:53.868789 [ 33005 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:20:53.869119 [ 33005 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:20:53.869869 [ 33005 ] {} Application: Shut down storages. 2025.04.02 05:20:53.869933 [ 33005 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:20:54.119914 [ 33005 ] {} Application: Closed all listening sockets. 2025.04.02 05:20:54.120053 [ 33005 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:20:54.120118 [ 33005 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:20:54.363074 [ 33005 ] {} RaftInstance: shutting down raft core 2025.04.02 05:20:54.363196 [ 33005 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:20:54.363837 [ 33005 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:20:54.363902 [ 33005 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:20:54.363954 [ 33005 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:20:54.364000 [ 33005 ] {} RaftInstance: reset all pointers. 2025.04.02 05:20:54.364050 [ 33005 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:20:54.364183 [ 33005 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:20:54.364204 [ 33613 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:20:54.364377 [ 33005 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:20:54.364424 [ 33005 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:20:54.364466 [ 33005 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:20:54.364850 [ 33596 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:20:54.364749 [ 33599 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:20:54.364865 [ 33597 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:20:54.364962 [ 33602 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:20:54.364974 [ 33600 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:20:54.364993 [ 33607 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:20:54.365200 [ 33604 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:20:54.365315 [ 33609 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:20:54.365480 [ 33608 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:20:54.365343 [ 33610 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:20:54.365488 [ 33605 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:20:54.365526 [ 33599 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:20:54.365624 [ 33601 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:20:54.365581 [ 33611 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:20:54.365497 [ 33606 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:20:54.365665 [ 33598 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:20:54.365739 [ 33603 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:20:54.366222 [ 33005 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:54.366260 [ 33594 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:20:54.366423 [ 33595 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:20:54.366980 [ 33005 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:20:54.367117 [ 33005 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:20:54.367154 [ 33005 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:20:54.367203 [ 33005 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:20:54.367243 [ 33005 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:54.367402 [ 33005 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:20:54.367441 [ 33005 ] {} Context: Destructing threadpool writer 2025.04.02 05:20:54.370924 [ 33005 ] {} Application: Destroyed global context. 2025.04.02 05:20:54.371491 [ 33005 ] {} Application: Waiting for background threads 2025.04.02 05:20:54.436773 [ 33005 ] {} Application: Background threads finished in 65 ms 2025.04.02 05:20:54.437267 [ 33005 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:20:54.437351 [ 33005 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:20:54.449619 [ 33005 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:20:54.449867 [ 33005 ] {} Application: shutting down 2025.04.02 05:20:54.449905 [ 33005 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:20:54.456337 [ 33008 ] {} BaseDaemon: Received signal -2 2025.04.02 05:20:54.456458 [ 33008 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:20:54.556426 [ 33003 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:20:55.384629 [ 33730 ] {} Application: Will watch for the process with pid 33732 2025.04.02 05:20:55.385811 [ 33732 ] {} Application: Forked a child process to watch 2025.04.02 05:20:55.387364 [ 33732 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:20:55.881939 [ 33732 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 33732 2025.04.02 05:20:55.882874 [ 33732 ] {} Application: starting up 2025.04.02 05:20:55.882969 [ 33732 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:20:55.915003 [ 33732 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:20:55.915226 [ 33732 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:20:55.915309 [ 33732 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:20:55.915345 [ 33732 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:20:55.915367 [ 33732 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:20:55.916769 [ 33732 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:20:55.917206 [ 33732 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:20:55.917260 [ 33732 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:20:55.917446 [ 33732 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:20:55.917496 [ 33732 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:20:56.741226 [ 33732 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:20:56.743405 [ 33732 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:20:56.743488 [ 33732 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:20:56.743657 [ 33732 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:20:56.744398 [ 33732 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:20:56.904495 [ 33741 ] {} CancellationChecker: Started worker function 2025.04.02 05:20:56.904864 [ 33732 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:20:56.904966 [ 33732 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:20:56.905045 [ 33732 ] {} Application: Initializing DateLUT. 2025.04.02 05:20:56.905101 [ 33732 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:20:56.905445 [ 33732 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:20:56.905968 [ 33732 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:20:56.927250 [ 33732 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:20:56.927419 [ 33732 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:20:56.927761 [ 33732 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:20:56.928311 [ 33732 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:20:56.928409 [ 33732 ] {} Application: Initializing interserver credentials. 2025.04.02 05:20:56.929314 [ 33732 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:20:56.934503 [ 33732 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:56.934565 [ 33732 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:20:56.934655 [ 33732 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:20:56.935075 [ 33732 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:20:56.948225 [ 33732 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:20:56.948344 [ 33732 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:20:56.958405 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:20:56.959954 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:20:56.960494 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:20:56.961110 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:20:56.961728 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:20:56.968014 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:20:56.968635 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:20:56.969213 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:20:56.969772 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:20:56.970281 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:20:56.970967 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:20:56.971354 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:20:56.971761 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:20:56.972113 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:20:56.972624 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:20:56.972950 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:20:56.973496 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:20:56.973864 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:20:56.974328 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:20:56.974761 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:20:56.975238 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:20:56.975696 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:20:56.976474 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:20:56.977533 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:20:56.977903 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:20:56.979004 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:20:56.980311 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:20:56.980735 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:20:56.981105 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:20:56.981550 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:20:56.981963 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:20:56.982443 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:20:56.983028 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:20:56.983531 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:20:56.983997 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:20:56.984450 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:20:56.985195 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:20:56.986019 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:20:56.986743 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:20:56.988540 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:20:56.989472 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:20:56.989933 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:20:56.990432 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:20:56.990873 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:20:56.991338 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:20:56.991874 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:20:56.992315 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:20:56.992756 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:20:56.993222 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:20:56.995705 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:20:56.996477 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:20:56.997407 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:20:56.998043 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:20:56.998504 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:20:56.998910 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:20:56.999623 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:20:57.000074 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:20:57.000685 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:20:57.001103 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:20:57.001553 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:20:57.001953 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:20:57.002629 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:20:57.003058 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:20:57.003588 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:20:57.004299 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:20:57.004810 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:20:57.006664 [ 33732 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:20:57.056047 [ 33732 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:20:57.058413 [ 33732 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:20:57.105281 [ 33732 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:20:57.105427 [ 33732 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:20:57.105491 [ 33732 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:20:57.122755 [ 33732 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:20:57.122853 [ 33732 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:20:57.122943 [ 33732 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:20:57.123100 [ 33732 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:57.129335 [ 33732 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:57.135230 [ 33732 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:20:57.148125 [ 33732 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:20:57.148611 [ 33732 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:20:57.148778 [ 33732 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:57.151083 [ 33732 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:20:57.151790 [ 33732 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:20:57.152142 [ 33732 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:20:57.153624 [ 33732 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:20:57.153718 [ 33732 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:20:57.155958 [ 33732 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:20:57.156011 [ 33732 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:20:57.156045 [ 33732 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:20:57.156101 [ 33732 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:20:57.156135 [ 33732 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:20:57.156392 [ 33732 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:57.156479 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.232239 [ 33732 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:57.242007 [ 33732 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:57.242103 [ 33732 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:57.243066 [ 33732 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:57.243194 [ 33732 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr 2025.04.02 05:20:57.243281 [ 33732 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr 2025.04.02 05:20:57.243349 [ 33732 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr, size 4 2025.04.02 05:20:57.243887 [ 33732 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr. 2025.04.02 05:20:57.244081 [ 34313 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr 2025.04.02 05:20:57.250798 [ 34313 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr, size 4 2025.04.02 05:20:57.251645 [ 33732 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr. 2025.04.02 05:20:57.251982 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.255446 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.255576 [ 33732 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr, Version: Latest, Offset: 2 2025.04.02 05:20:57.261708 [ 33732 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr 2025.04.02 05:20:57.261790 [ 33732 ] {} deleteFileFromS3: Object with path s3/lng/oxynxxhcrcgauouvnwpnullmnmtyr was removed from S3 2025.04.02 05:20:57.261856 [ 33732 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:20:57.261922 [ 33732 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:20:57.266309 [ 33732 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:57.280762 [ 33732 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:57.280873 [ 33732 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:57.281613 [ 33732 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:57.291140 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.296237 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.296354 [ 33732 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:20:57.302686 [ 33732 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:20:57.302889 [ 33732 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:20:57 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326245B6A2F47F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:20:57.303045 [ 33732 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:20:57.307298 [ 33732 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:57.307351 [ 33732 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:20:57.307402 [ 33732 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:20:57.307445 [ 33732 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:20:57.307558 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.307626 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.307684 [ 33732 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:57.307739 [ 33732 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:57.307800 [ 33732 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:20:57.307854 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.307907 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.307964 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.308017 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.308076 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.311169 [ 33732 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:57.320889 [ 33732 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:57.320954 [ 33732 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:57.321678 [ 33732 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:57.328116 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/xnp/gygepxhphjbvjmslzxedpknhyodvk (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.330776 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/xnp/gygepxhphjbvjmslzxedpknhyodvk (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.330844 [ 33732 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/xnp/gygepxhphjbvjmslzxedpknhyodvk, Version: Latest, Offset: 2 2025.04.02 05:20:57.335478 [ 33732 ] {} deleteFileFromS3: No blob storage log, not writing blob special/xnp/gygepxhphjbvjmslzxedpknhyodvk 2025.04.02 05:20:57.335537 [ 33732 ] {} deleteFileFromS3: Object with path special/xnp/gygepxhphjbvjmslzxedpknhyodvk was removed from S3 2025.04.02 05:20:57.335581 [ 33732 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:20:57.335627 [ 33732 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:20:57.339279 [ 33732 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:20:57.349501 [ 33732 ] {} S3Client: Provider type: Unknown 2025.04.02 05:20:57.349599 [ 33732 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:20:57.350277 [ 33732 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:20:57.357191 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ixm/lqaweyppbrrjapdwopaptjoudduxj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.359506 [ 33732 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ixm/lqaweyppbrrjapdwopaptjoudduxj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:20:57.359570 [ 33732 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/ixm/lqaweyppbrrjapdwopaptjoudduxj, Version: Latest, Offset: 2 2025.04.02 05:20:57.363662 [ 33732 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ixm/lqaweyppbrrjapdwopaptjoudduxj 2025.04.02 05:20:57.363710 [ 33732 ] {} deleteFileFromS3: Object with path test_02944/ixm/lqaweyppbrrjapdwopaptjoudduxj was removed from S3 2025.04.02 05:20:57.363749 [ 33732 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:20:57.363782 [ 33732 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:20:57.363898 [ 33732 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:20:57.367074 [ 33732 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:20:57.370979 [ 33732 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:20:57.371077 [ 33732 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:20:57.372563 [ 33732 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:20:57.372713 [ 33732 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:20:57.373876 [ 33732 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:20:57.373925 [ 33732 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:20:57.373976 [ 33732 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:20:57.374013 [ 33732 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:20:57.374046 [ 33732 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:20:57.374733 [ 33732 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 43 entries 2025.04.02 05:20:57.374857 [ 33732 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:20:57.374992 [ 33732 ] {} KeeperServer: Last local log idx 43 2025.04.02 05:20:57.375071 [ 33732 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 43 2025.04.02 05:20:57.376271 [ 33732 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:20:57.386511 [ 33732 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:20:57.386821 [ 33732 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:20:57.386911 [ 33732 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:20:57.386963 [ 33732 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:20:57.387055 [ 33732 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:20:57.387097 [ 33732 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:20:57.387172 [ 33732 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 43 election timer allowed log store start 1, end 43 config log idx 43, prev log idx 42 -- ASYNC REPLICATION -- 2025.04.02 05:20:57.387218 [ 33732 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:20:57.387335 [ 33732 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:20:57.387398 [ 33732 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:20:57.387937 [ 33732 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:20:57.388018 [ 34340 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:20:57.438374 [ 34323 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:20:57.438595 [ 34323 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:20:57.438711 [ 34323 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 43, state term 43, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:20:57.438777 [ 34323 ] {} RaftInstance: pre-vote term (0) is different, reset it to 43 2025.04.02 05:20:57.438971 [ 33732 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:20:57.439094 [ 34323 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:20:57.441777 [ 34323 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 44, log idx 43, log term 43, priority (target 1 / mine 1) 2025.04.02 05:20:57.441849 [ 34323 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:20:57.441909 [ 34323 ] {} RaftInstance: state machine commit index 0, precommit index 43, last log index 43 2025.04.02 05:20:57.441967 [ 34323 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:20:57.442234 [ 34321 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:20:57.442365 [ 34323 ] {} RaftInstance: [BECOME LEADER] appended new config at 44 2025.04.02 05:20:57.442746 [ 34339 ] {} RaftInstance: config at index 1 is committed, prev config log idx 43 2025.04.02 05:20:57.442820 [ 34339 ] {} RaftInstance: skipped config 1, latest config 43 2025.04.02 05:20:57.442925 [ 34339 ] {} RaftInstance: config at index 2 is committed, prev config log idx 43 2025.04.02 05:20:57.442963 [ 34339 ] {} RaftInstance: skipped config 2, latest config 43 2025.04.02 05:20:57.443031 [ 34339 ] {} RaftInstance: config at index 3 is committed, prev config log idx 43 2025.04.02 05:20:57.443071 [ 34339 ] {} RaftInstance: skipped config 3, latest config 43 2025.04.02 05:20:57.443137 [ 34339 ] {} RaftInstance: config at index 4 is committed, prev config log idx 43 2025.04.02 05:20:57.443170 [ 34339 ] {} RaftInstance: skipped config 4, latest config 43 2025.04.02 05:20:57.443230 [ 34339 ] {} RaftInstance: config at index 5 is committed, prev config log idx 43 2025.04.02 05:20:57.443262 [ 34339 ] {} RaftInstance: skipped config 5, latest config 43 2025.04.02 05:20:57.443344 [ 34339 ] {} RaftInstance: config at index 6 is committed, prev config log idx 43 2025.04.02 05:20:57.443377 [ 34339 ] {} RaftInstance: skipped config 6, latest config 43 2025.04.02 05:20:57.443451 [ 34339 ] {} RaftInstance: config at index 7 is committed, prev config log idx 43 2025.04.02 05:20:57.443486 [ 34339 ] {} RaftInstance: skipped config 7, latest config 43 2025.04.02 05:20:57.443548 [ 34339 ] {} RaftInstance: config at index 8 is committed, prev config log idx 43 2025.04.02 05:20:57.443599 [ 34339 ] {} RaftInstance: skipped config 8, latest config 43 2025.04.02 05:20:57.443663 [ 34339 ] {} RaftInstance: config at index 9 is committed, prev config log idx 43 2025.04.02 05:20:57.443693 [ 34339 ] {} RaftInstance: skipped config 9, latest config 43 2025.04.02 05:20:57.443753 [ 34339 ] {} RaftInstance: config at index 10 is committed, prev config log idx 43 2025.04.02 05:20:57.443785 [ 34339 ] {} RaftInstance: skipped config 10, latest config 43 2025.04.02 05:20:57.443846 [ 34339 ] {} RaftInstance: config at index 11 is committed, prev config log idx 43 2025.04.02 05:20:57.443904 [ 34339 ] {} RaftInstance: skipped config 11, latest config 43 2025.04.02 05:20:57.443967 [ 34339 ] {} RaftInstance: config at index 12 is committed, prev config log idx 43 2025.04.02 05:20:57.443997 [ 34339 ] {} RaftInstance: skipped config 12, latest config 43 2025.04.02 05:20:57.444057 [ 34339 ] {} RaftInstance: config at index 13 is committed, prev config log idx 43 2025.04.02 05:20:57.444092 [ 34339 ] {} RaftInstance: skipped config 13, latest config 43 2025.04.02 05:20:57.444151 [ 34339 ] {} RaftInstance: config at index 14 is committed, prev config log idx 43 2025.04.02 05:20:57.444183 [ 34339 ] {} RaftInstance: skipped config 14, latest config 43 2025.04.02 05:20:57.444246 [ 34339 ] {} RaftInstance: config at index 15 is committed, prev config log idx 43 2025.04.02 05:20:57.444275 [ 34339 ] {} RaftInstance: skipped config 15, latest config 43 2025.04.02 05:20:57.444355 [ 34339 ] {} RaftInstance: config at index 16 is committed, prev config log idx 43 2025.04.02 05:20:57.444395 [ 34339 ] {} RaftInstance: skipped config 16, latest config 43 2025.04.02 05:20:57.444489 [ 34339 ] {} RaftInstance: config at index 17 is committed, prev config log idx 43 2025.04.02 05:20:57.444537 [ 34339 ] {} RaftInstance: skipped config 17, latest config 43 2025.04.02 05:20:57.444624 [ 34339 ] {} RaftInstance: config at index 18 is committed, prev config log idx 43 2025.04.02 05:20:57.444663 [ 34339 ] {} RaftInstance: skipped config 18, latest config 43 2025.04.02 05:20:57.444717 [ 34339 ] {} RaftInstance: config at index 19 is committed, prev config log idx 43 2025.04.02 05:20:57.444745 [ 34339 ] {} RaftInstance: skipped config 19, latest config 43 2025.04.02 05:20:57.444796 [ 34339 ] {} RaftInstance: config at index 20 is committed, prev config log idx 43 2025.04.02 05:20:57.444826 [ 34339 ] {} RaftInstance: skipped config 20, latest config 43 2025.04.02 05:20:57.444884 [ 34339 ] {} RaftInstance: config at index 21 is committed, prev config log idx 43 2025.04.02 05:20:57.444912 [ 34339 ] {} RaftInstance: skipped config 21, latest config 43 2025.04.02 05:20:57.444967 [ 34339 ] {} RaftInstance: config at index 22 is committed, prev config log idx 43 2025.04.02 05:20:57.445000 [ 34339 ] {} RaftInstance: skipped config 22, latest config 43 2025.04.02 05:20:57.445052 [ 34339 ] {} RaftInstance: config at index 23 is committed, prev config log idx 43 2025.04.02 05:20:57.445085 [ 34339 ] {} RaftInstance: skipped config 23, latest config 43 2025.04.02 05:20:57.445173 [ 34339 ] {} RaftInstance: config at index 24 is committed, prev config log idx 43 2025.04.02 05:20:57.445229 [ 34339 ] {} RaftInstance: skipped config 24, latest config 43 2025.04.02 05:20:57.445307 [ 34339 ] {} RaftInstance: config at index 25 is committed, prev config log idx 43 2025.04.02 05:20:57.445343 [ 34339 ] {} RaftInstance: skipped config 25, latest config 43 2025.04.02 05:20:57.445399 [ 34339 ] {} RaftInstance: config at index 26 is committed, prev config log idx 43 2025.04.02 05:20:57.445434 [ 34339 ] {} RaftInstance: skipped config 26, latest config 43 2025.04.02 05:20:57.445489 [ 34339 ] {} RaftInstance: config at index 27 is committed, prev config log idx 43 2025.04.02 05:20:57.445517 [ 34339 ] {} RaftInstance: skipped config 27, latest config 43 2025.04.02 05:20:57.445573 [ 34339 ] {} RaftInstance: config at index 28 is committed, prev config log idx 43 2025.04.02 05:20:57.445606 [ 34339 ] {} RaftInstance: skipped config 28, latest config 43 2025.04.02 05:20:57.445665 [ 34339 ] {} RaftInstance: config at index 29 is committed, prev config log idx 43 2025.04.02 05:20:57.445696 [ 34339 ] {} RaftInstance: skipped config 29, latest config 43 2025.04.02 05:20:57.445749 [ 34339 ] {} RaftInstance: config at index 30 is committed, prev config log idx 43 2025.04.02 05:20:57.445780 [ 34339 ] {} RaftInstance: skipped config 30, latest config 43 2025.04.02 05:20:57.445833 [ 34339 ] {} RaftInstance: config at index 31 is committed, prev config log idx 43 2025.04.02 05:20:57.445867 [ 34339 ] {} RaftInstance: skipped config 31, latest config 43 2025.04.02 05:20:57.445922 [ 34339 ] {} RaftInstance: config at index 32 is committed, prev config log idx 43 2025.04.02 05:20:57.445950 [ 34339 ] {} RaftInstance: skipped config 32, latest config 43 2025.04.02 05:20:57.446007 [ 34339 ] {} RaftInstance: config at index 33 is committed, prev config log idx 43 2025.04.02 05:20:57.446035 [ 34339 ] {} RaftInstance: skipped config 33, latest config 43 2025.04.02 05:20:57.446118 [ 34339 ] {} RaftInstance: config at index 34 is committed, prev config log idx 43 2025.04.02 05:20:57.446161 [ 34339 ] {} RaftInstance: skipped config 34, latest config 43 2025.04.02 05:20:57.446257 [ 34339 ] {} RaftInstance: config at index 35 is committed, prev config log idx 43 2025.04.02 05:20:57.446326 [ 34339 ] {} RaftInstance: skipped config 35, latest config 43 2025.04.02 05:20:57.446442 [ 34339 ] {} RaftInstance: config at index 36 is committed, prev config log idx 43 2025.04.02 05:20:57.446497 [ 34339 ] {} RaftInstance: skipped config 36, latest config 43 2025.04.02 05:20:57.446585 [ 34339 ] {} RaftInstance: config at index 37 is committed, prev config log idx 43 2025.04.02 05:20:57.446628 [ 34339 ] {} RaftInstance: skipped config 37, latest config 43 2025.04.02 05:20:57.446712 [ 34339 ] {} RaftInstance: config at index 38 is committed, prev config log idx 43 2025.04.02 05:20:57.446749 [ 34339 ] {} RaftInstance: skipped config 38, latest config 43 2025.04.02 05:20:57.446828 [ 34339 ] {} RaftInstance: config at index 39 is committed, prev config log idx 43 2025.04.02 05:20:57.446872 [ 34339 ] {} RaftInstance: skipped config 39, latest config 43 2025.04.02 05:20:57.446950 [ 34339 ] {} RaftInstance: config at index 40 is committed, prev config log idx 43 2025.04.02 05:20:57.446993 [ 34339 ] {} RaftInstance: skipped config 40, latest config 43 2025.04.02 05:20:57.447074 [ 34339 ] {} RaftInstance: config at index 41 is committed, prev config log idx 43 2025.04.02 05:20:57.447117 [ 34339 ] {} RaftInstance: skipped config 41, latest config 43 2025.04.02 05:20:57.447193 [ 34339 ] {} RaftInstance: config at index 42 is committed, prev config log idx 43 2025.04.02 05:20:57.447238 [ 34339 ] {} RaftInstance: skipped config 42, latest config 43 2025.04.02 05:20:57.447344 [ 34339 ] {} RaftInstance: config at index 43 is committed, prev config log idx 43 2025.04.02 05:20:57.447390 [ 34339 ] {} RaftInstance: skipped config 43, latest config 43 2025.04.02 05:20:57.447481 [ 34339 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:20:57.447531 [ 34339 ] {} KeeperServer: Preprocessing done 2025.04.02 05:20:57.447630 [ 34339 ] {} RaftInstance: config at index 44 is committed, prev config log idx 43 2025.04.02 05:20:57.447707 [ 34339 ] {} RaftInstance: new config log idx 44, prev log idx 43, cur config log idx 43, prev log idx 42 2025.04.02 05:20:57.447811 [ 34339 ] {} RaftInstance: new configuration: log idx 44, prev log idx 43 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 44 2025.04.02 05:20:57.448001 [ 33732 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:20:57.448863 [ 33732 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:20:57.450883 [ 33732 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:20:57.451229 [ 33732 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:20:57.463750 [ 33732 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:20:57.463818 [ 33732 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:20:57.464953 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:20:57.465353 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:20:57.465928 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:20:57.466207 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:20:57.466537 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:20:57.466815 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:20:57.467119 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:20:57.467520 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:20:57.471675 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:20:57.472155 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:20:57.472623 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:20:57.472997 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:20:57.473403 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:20:57.473821 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:20:57.474204 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:20:57.474720 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:20:57.475165 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:20:57.475689 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:20:57.476129 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:20:57.476567 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:20:57.476986 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:20:57.477507 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:20:57.478354 [ 33732 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:20:57.485869 [ 33732 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:20:57.486085 [ 33732 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:20:57.492748 [ 33732 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:20:57.492844 [ 33732 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:20:57.495861 [ 33732 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:20:57.497036 [ 33732 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:20:57.497549 [ 33732 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:20:57.497892 [ 34345 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:20:57.504838 [ 33732 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:20:57.507556 [ 33732 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:20:57.512356 [ 33732 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:20:57.514855 [ 33732 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:20:57.520117 [ 33732 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:20:57.522155 [ 33732 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:20:57.523657 [ 33732 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:20:57.524844 [ 33732 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:20:57.524925 [ 33732 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:20:57.524977 [ 33742 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:20:57.525590 [ 33742 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:01.709582 [ 33732 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:01.709994 [ 33732 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:01.710366 [ 33732 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:01.710436 [ 33732 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:01.710617 [ 33741 ] {} CancellationChecker: Execution took 4806 ms. 2025.04.02 05:21:01.711198 [ 33732 ] {} Application: Shutting down storages. 2025.04.02 05:21:01.711246 [ 33732 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:01.712538 [ 33732 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:01.712579 [ 33732 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:01.712609 [ 33732 ] {} Context: Shutting down named sessions 2025.04.02 05:21:01.712665 [ 33732 ] {} Context: Shutting down database catalog 2025.04.02 05:21:01.712697 [ 33732 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:01.712750 [ 33732 ] {} Context: Shutting down merges executor 2025.04.02 05:21:01.713242 [ 33732 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:01.713726 [ 33732 ] {} Context: Shutting down moves executor 2025.04.02 05:21:01.713974 [ 33732 ] {} Context: Shutting down common executor 2025.04.02 05:21:01.714251 [ 33732 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:01.714302 [ 33732 ] {} Context: Shutting down caches 2025.04.02 05:21:01.714340 [ 33732 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:01.714625 [ 33732 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:01.717555 [ 33732 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:01.726975 [ 33732 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:01.727267 [ 33732 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:01.727911 [ 33732 ] {} Application: Shut down storages. 2025.04.02 05:21:01.727965 [ 33732 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:02.207012 [ 33732 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:02.207117 [ 33732 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:02.207175 [ 33732 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:02.450798 [ 33732 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:02.450951 [ 33732 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:02.451047 [ 33732 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:02.451110 [ 33732 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:02.451175 [ 33732 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:02.451221 [ 33732 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:02.451265 [ 33732 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:02.451389 [ 33732 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:02.451414 [ 34340 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:02.451535 [ 33732 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:02.451585 [ 33732 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:02.451634 [ 33732 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:02.451957 [ 34323 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:21:02.452062 [ 34324 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:02.452167 [ 34338 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:02.452250 [ 34327 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:02.452446 [ 34333 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:02.452392 [ 34331 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:21:02.452472 [ 34332 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:02.452521 [ 34326 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:02.452543 [ 34334 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:02.452878 [ 34336 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:02.452894 [ 34325 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:02.452733 [ 34328 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:02.452670 [ 34337 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:02.452675 [ 34335 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:02.452603 [ 34330 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:02.453112 [ 34329 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:02.453665 [ 33732 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:02.453685 [ 34321 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:02.454491 [ 33732 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:02.454665 [ 33732 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:02.454746 [ 33732 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:02.454805 [ 33732 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:02.454852 [ 33732 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:02.455041 [ 33732 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:02.455096 [ 33732 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:02.458778 [ 33732 ] {} Application: Destroyed global context. 2025.04.02 05:21:02.459267 [ 33732 ] {} Application: Waiting for background threads 2025.04.02 05:21:02.529022 [ 33732 ] {} Application: Background threads finished in 69 ms 2025.04.02 05:21:02.529717 [ 33732 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:02.529783 [ 33732 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:02.544022 [ 33732 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:02.544249 [ 33732 ] {} Application: shutting down 2025.04.02 05:21:02.544300 [ 33732 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:02.551433 [ 33735 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:02.551725 [ 33735 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:02.673575 [ 33730 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:21:03.413086 [ 34457 ] {} Application: Will watch for the process with pid 34459 2025.04.02 05:21:03.414321 [ 34459 ] {} Application: Forked a child process to watch 2025.04.02 05:21:03.415505 [ 34459 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:21:03.898475 [ 34459 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 34459 2025.04.02 05:21:03.899418 [ 34459 ] {} Application: starting up 2025.04.02 05:21:03.899503 [ 34459 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:21:03.930569 [ 34459 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:21:03.930779 [ 34459 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:21:03.930842 [ 34459 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:21:03.930875 [ 34459 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:21:03.930898 [ 34459 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:21:03.932517 [ 34459 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:21:03.932955 [ 34459 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:21:03.933004 [ 34459 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:21:03.933168 [ 34459 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:21:03.933216 [ 34459 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:21:04.755055 [ 34459 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:21:04.757181 [ 34459 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:21:04.757257 [ 34459 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:21:04.757495 [ 34459 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:21:04.758155 [ 34459 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:21:04.928183 [ 34468 ] {} CancellationChecker: Started worker function 2025.04.02 05:21:04.928636 [ 34459 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:21:04.928767 [ 34459 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:21:04.928903 [ 34459 ] {} Application: Initializing DateLUT. 2025.04.02 05:21:04.928969 [ 34459 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:21:04.929343 [ 34459 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:21:04.929910 [ 34459 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:21:04.953423 [ 34459 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:21:04.953616 [ 34459 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:21:04.954136 [ 34459 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:21:04.954883 [ 34459 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:21:04.955044 [ 34459 ] {} Application: Initializing interserver credentials. 2025.04.02 05:21:04.956464 [ 34459 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:21:04.964724 [ 34459 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:04.964834 [ 34459 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:21:04.965009 [ 34459 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:21:04.965641 [ 34459 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:21:04.984896 [ 34459 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:21:04.985027 [ 34459 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:21:04.996877 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:21:04.998575 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:21:04.999253 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:21:05.000013 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:21:05.000820 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:21:05.007594 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:21:05.008242 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:21:05.008864 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:21:05.009394 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:21:05.009893 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:21:05.010560 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:21:05.011110 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:21:05.011694 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:21:05.012167 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:21:05.012919 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:21:05.013407 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:21:05.013960 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:21:05.014558 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:21:05.015148 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:21:05.015733 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:21:05.016371 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:21:05.016981 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:21:05.018068 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:21:05.019722 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:21:05.020238 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:21:05.021613 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:21:05.023352 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:21:05.023996 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:21:05.024721 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:21:05.025404 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:21:05.026051 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:21:05.026730 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:21:05.027455 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:21:05.028048 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:21:05.028730 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:21:05.029363 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:21:05.030086 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:21:05.030921 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:21:05.031577 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:21:05.033392 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:21:05.034275 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:21:05.034935 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:21:05.035603 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:21:05.036329 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:21:05.036961 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:21:05.037903 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:21:05.038633 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:21:05.039365 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:21:05.040091 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:21:05.043985 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:21:05.045237 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:21:05.046967 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:21:05.047954 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:21:05.048627 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:21:05.049217 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:21:05.050365 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:21:05.051095 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:21:05.052052 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:21:05.052651 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:21:05.053342 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:21:05.053959 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:21:05.054997 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:21:05.055705 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:21:05.056529 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:21:05.057513 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:21:05.058229 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:21:05.061340 [ 34459 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:21:05.135418 [ 34459 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:21:05.138615 [ 34459 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:21:05.196499 [ 34459 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:21:05.196635 [ 34459 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:21:05.196691 [ 34459 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:21:05.223313 [ 34459 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:21:05.223417 [ 34459 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:21:05.223491 [ 34459 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:21:05.223685 [ 34459 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:05.230780 [ 34459 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:05.237517 [ 34459 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:05.252714 [ 34459 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:05.253307 [ 34459 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:21:05.253536 [ 34459 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:05.257345 [ 34459 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:21:05.258285 [ 34459 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:21:05.258740 [ 34459 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:21:05.260325 [ 34459 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:21:05.260441 [ 34459 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:21:05.262750 [ 34459 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:21:05.262826 [ 34459 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:21:05.262864 [ 34459 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:21:05.262925 [ 34459 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:21:05.262962 [ 34459 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:21:05.263205 [ 34459 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:05.263308 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.385622 [ 34459 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:05.403610 [ 34459 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:05.403764 [ 34459 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:05.405391 [ 34459 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:05.405592 [ 34459 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh 2025.04.02 05:21:05.405703 [ 34459 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh 2025.04.02 05:21:05.405784 [ 34459 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh, size 4 2025.04.02 05:21:05.406640 [ 34459 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh. 2025.04.02 05:21:05.406810 [ 35040 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh 2025.04.02 05:21:05.414331 [ 35040 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh, size 4 2025.04.02 05:21:05.415438 [ 34459 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh. 2025.04.02 05:21:05.415923 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.420353 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.420477 [ 34459 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh, Version: Latest, Offset: 2 2025.04.02 05:21:05.427578 [ 34459 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh 2025.04.02 05:21:05.427684 [ 34459 ] {} deleteFileFromS3: Object with path s3/iwb/tuqyvfklzaxdfdyasxovhjfnebfoh was removed from S3 2025.04.02 05:21:05.427780 [ 34459 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:21:05.427878 [ 34459 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:21:05.433280 [ 34459 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:05.451094 [ 34459 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:05.451217 [ 34459 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:05.452333 [ 34459 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:05.463127 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.469131 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.469261 [ 34459 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:21:05.477656 [ 34459 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:21:05.478038 [ 34459 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:21:05 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 183262479DE68B0B x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:21:05.478306 [ 34459 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:21:05.485330 [ 34459 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:05.485452 [ 34459 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:21:05.485552 [ 34459 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:21:05.485616 [ 34459 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:21:05.485793 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.485899 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.485997 [ 34459 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:05.486078 [ 34459 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:05.486166 [ 34459 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:21:05.486242 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.486339 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.486493 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.486576 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.486675 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.490877 [ 34459 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:05.508553 [ 34459 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:05.508678 [ 34459 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:05.510167 [ 34459 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:05.518073 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ptf/ouryugivytxoyibulaggswpmzqqrb (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.522255 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ptf/ouryugivytxoyibulaggswpmzqqrb (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.522375 [ 34459 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ptf/ouryugivytxoyibulaggswpmzqqrb, Version: Latest, Offset: 2 2025.04.02 05:21:05.528812 [ 34459 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ptf/ouryugivytxoyibulaggswpmzqqrb 2025.04.02 05:21:05.528911 [ 34459 ] {} deleteFileFromS3: Object with path special/ptf/ouryugivytxoyibulaggswpmzqqrb was removed from S3 2025.04.02 05:21:05.528977 [ 34459 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:21:05.529026 [ 34459 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:21:05.533535 [ 34459 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:05.551236 [ 34459 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:05.551439 [ 34459 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:05.552902 [ 34459 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:05.560175 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/rui/cechxqyqwqydfyqnszxuwizqmgmhl (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.563849 [ 34459 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/rui/cechxqyqwqydfyqnszxuwizqmgmhl (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:05.563989 [ 34459 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/rui/cechxqyqwqydfyqnszxuwizqmgmhl, Version: Latest, Offset: 2 2025.04.02 05:21:05.570410 [ 34459 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/rui/cechxqyqwqydfyqnszxuwizqmgmhl 2025.04.02 05:21:05.570497 [ 34459 ] {} deleteFileFromS3: Object with path test_02944/rui/cechxqyqwqydfyqnszxuwizqmgmhl was removed from S3 2025.04.02 05:21:05.570566 [ 34459 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:21:05.570621 [ 34459 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:21:05.570811 [ 34459 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:05.575672 [ 34459 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:05.580966 [ 34459 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:21:05.581083 [ 34459 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:21:05.583279 [ 34459 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:21:05.583519 [ 34459 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:21:05.584772 [ 34459 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:21:05.584858 [ 34459 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:21:05.584913 [ 34459 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:21:05.584964 [ 34459 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:21:05.585014 [ 34459 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:21:05.586077 [ 34459 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 44 entries 2025.04.02 05:21:05.586185 [ 34459 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:21:05.586317 [ 34459 ] {} KeeperServer: Last local log idx 44 2025.04.02 05:21:05.586379 [ 34459 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 44 2025.04.02 05:21:05.588329 [ 34459 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:21:05.604170 [ 34459 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:21:05.604726 [ 34459 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:21:05.604902 [ 34459 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:21:05.605004 [ 34459 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:21:05.605135 [ 34459 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:21:05.605217 [ 34459 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:21:05.605380 [ 34459 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 44 election timer allowed log store start 1, end 44 config log idx 44, prev log idx 43 -- ASYNC REPLICATION -- 2025.04.02 05:21:05.605493 [ 34459 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:21:05.605618 [ 34459 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:21:05.605738 [ 34459 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:21:05.606459 [ 34459 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:21:05.606556 [ 35068 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:21:05.657055 [ 35051 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:21:05.657263 [ 35051 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:21:05.657411 [ 35051 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 44, state term 44, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:21:05.657517 [ 35051 ] {} RaftInstance: pre-vote term (0) is different, reset it to 44 2025.04.02 05:21:05.657649 [ 34459 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:21:05.657826 [ 35051 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:21:05.661342 [ 35051 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 45, log idx 44, log term 44, priority (target 1 / mine 1) 2025.04.02 05:21:05.661449 [ 35051 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:21:05.661530 [ 35051 ] {} RaftInstance: state machine commit index 0, precommit index 44, last log index 44 2025.04.02 05:21:05.661595 [ 35051 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:21:05.661875 [ 35048 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:21:05.662007 [ 35051 ] {} RaftInstance: [BECOME LEADER] appended new config at 45 2025.04.02 05:21:05.662414 [ 35067 ] {} RaftInstance: config at index 1 is committed, prev config log idx 44 2025.04.02 05:21:05.662557 [ 35067 ] {} RaftInstance: skipped config 1, latest config 44 2025.04.02 05:21:05.662724 [ 35067 ] {} RaftInstance: config at index 2 is committed, prev config log idx 44 2025.04.02 05:21:05.662773 [ 35067 ] {} RaftInstance: skipped config 2, latest config 44 2025.04.02 05:21:05.662852 [ 35067 ] {} RaftInstance: config at index 3 is committed, prev config log idx 44 2025.04.02 05:21:05.662902 [ 35067 ] {} RaftInstance: skipped config 3, latest config 44 2025.04.02 05:21:05.662978 [ 35067 ] {} RaftInstance: config at index 4 is committed, prev config log idx 44 2025.04.02 05:21:05.663015 [ 35067 ] {} RaftInstance: skipped config 4, latest config 44 2025.04.02 05:21:05.663082 [ 35067 ] {} RaftInstance: config at index 5 is committed, prev config log idx 44 2025.04.02 05:21:05.663118 [ 35067 ] {} RaftInstance: skipped config 5, latest config 44 2025.04.02 05:21:05.663200 [ 35067 ] {} RaftInstance: config at index 6 is committed, prev config log idx 44 2025.04.02 05:21:05.663236 [ 35067 ] {} RaftInstance: skipped config 6, latest config 44 2025.04.02 05:21:05.663366 [ 35067 ] {} RaftInstance: config at index 7 is committed, prev config log idx 44 2025.04.02 05:21:05.663407 [ 35067 ] {} RaftInstance: skipped config 7, latest config 44 2025.04.02 05:21:05.663478 [ 35067 ] {} RaftInstance: config at index 8 is committed, prev config log idx 44 2025.04.02 05:21:05.663570 [ 35067 ] {} RaftInstance: skipped config 8, latest config 44 2025.04.02 05:21:05.663683 [ 35067 ] {} RaftInstance: config at index 9 is committed, prev config log idx 44 2025.04.02 05:21:05.663719 [ 35067 ] {} RaftInstance: skipped config 9, latest config 44 2025.04.02 05:21:05.663823 [ 35067 ] {} RaftInstance: config at index 10 is committed, prev config log idx 44 2025.04.02 05:21:05.663858 [ 35067 ] {} RaftInstance: skipped config 10, latest config 44 2025.04.02 05:21:05.663920 [ 35067 ] {} RaftInstance: config at index 11 is committed, prev config log idx 44 2025.04.02 05:21:05.663950 [ 35067 ] {} RaftInstance: skipped config 11, latest config 44 2025.04.02 05:21:05.664003 [ 35067 ] {} RaftInstance: config at index 12 is committed, prev config log idx 44 2025.04.02 05:21:05.664032 [ 35067 ] {} RaftInstance: skipped config 12, latest config 44 2025.04.02 05:21:05.664086 [ 35067 ] {} RaftInstance: config at index 13 is committed, prev config log idx 44 2025.04.02 05:21:05.664132 [ 35067 ] {} RaftInstance: skipped config 13, latest config 44 2025.04.02 05:21:05.664188 [ 35067 ] {} RaftInstance: config at index 14 is committed, prev config log idx 44 2025.04.02 05:21:05.664217 [ 35067 ] {} RaftInstance: skipped config 14, latest config 44 2025.04.02 05:21:05.664277 [ 35067 ] {} RaftInstance: config at index 15 is committed, prev config log idx 44 2025.04.02 05:21:05.664322 [ 35067 ] {} RaftInstance: skipped config 15, latest config 44 2025.04.02 05:21:05.664419 [ 35067 ] {} RaftInstance: config at index 16 is committed, prev config log idx 44 2025.04.02 05:21:05.664453 [ 35067 ] {} RaftInstance: skipped config 16, latest config 44 2025.04.02 05:21:05.664511 [ 35067 ] {} RaftInstance: config at index 17 is committed, prev config log idx 44 2025.04.02 05:21:05.664539 [ 35067 ] {} RaftInstance: skipped config 17, latest config 44 2025.04.02 05:21:05.664592 [ 35067 ] {} RaftInstance: config at index 18 is committed, prev config log idx 44 2025.04.02 05:21:05.664625 [ 35067 ] {} RaftInstance: skipped config 18, latest config 44 2025.04.02 05:21:05.664680 [ 35067 ] {} RaftInstance: config at index 19 is committed, prev config log idx 44 2025.04.02 05:21:05.664708 [ 35067 ] {} RaftInstance: skipped config 19, latest config 44 2025.04.02 05:21:05.664759 [ 35067 ] {} RaftInstance: config at index 20 is committed, prev config log idx 44 2025.04.02 05:21:05.664789 [ 35067 ] {} RaftInstance: skipped config 20, latest config 44 2025.04.02 05:21:05.664845 [ 35067 ] {} RaftInstance: config at index 21 is committed, prev config log idx 44 2025.04.02 05:21:05.664873 [ 35067 ] {} RaftInstance: skipped config 21, latest config 44 2025.04.02 05:21:05.664940 [ 35067 ] {} RaftInstance: config at index 22 is committed, prev config log idx 44 2025.04.02 05:21:05.665002 [ 35067 ] {} RaftInstance: skipped config 22, latest config 44 2025.04.02 05:21:05.665059 [ 35067 ] {} RaftInstance: config at index 23 is committed, prev config log idx 44 2025.04.02 05:21:05.665091 [ 35067 ] {} RaftInstance: skipped config 23, latest config 44 2025.04.02 05:21:05.665154 [ 35067 ] {} RaftInstance: config at index 24 is committed, prev config log idx 44 2025.04.02 05:21:05.665183 [ 35067 ] {} RaftInstance: skipped config 24, latest config 44 2025.04.02 05:21:05.665303 [ 35067 ] {} RaftInstance: config at index 25 is committed, prev config log idx 44 2025.04.02 05:21:05.665344 [ 35067 ] {} RaftInstance: skipped config 25, latest config 44 2025.04.02 05:21:05.665399 [ 35067 ] {} RaftInstance: config at index 26 is committed, prev config log idx 44 2025.04.02 05:21:05.665426 [ 35067 ] {} RaftInstance: skipped config 26, latest config 44 2025.04.02 05:21:05.665480 [ 35067 ] {} RaftInstance: config at index 27 is committed, prev config log idx 44 2025.04.02 05:21:05.665508 [ 35067 ] {} RaftInstance: skipped config 27, latest config 44 2025.04.02 05:21:05.665571 [ 35067 ] {} RaftInstance: config at index 28 is committed, prev config log idx 44 2025.04.02 05:21:05.665601 [ 35067 ] {} RaftInstance: skipped config 28, latest config 44 2025.04.02 05:21:05.665660 [ 35067 ] {} RaftInstance: config at index 29 is committed, prev config log idx 44 2025.04.02 05:21:05.665690 [ 35067 ] {} RaftInstance: skipped config 29, latest config 44 2025.04.02 05:21:05.665742 [ 35067 ] {} RaftInstance: config at index 30 is committed, prev config log idx 44 2025.04.02 05:21:05.665776 [ 35067 ] {} RaftInstance: skipped config 30, latest config 44 2025.04.02 05:21:05.665829 [ 35067 ] {} RaftInstance: config at index 31 is committed, prev config log idx 44 2025.04.02 05:21:05.665864 [ 35067 ] {} RaftInstance: skipped config 31, latest config 44 2025.04.02 05:21:05.665918 [ 35067 ] {} RaftInstance: config at index 32 is committed, prev config log idx 44 2025.04.02 05:21:05.665946 [ 35067 ] {} RaftInstance: skipped config 32, latest config 44 2025.04.02 05:21:05.666003 [ 35067 ] {} RaftInstance: config at index 33 is committed, prev config log idx 44 2025.04.02 05:21:05.666032 [ 35067 ] {} RaftInstance: skipped config 33, latest config 44 2025.04.02 05:21:05.666083 [ 35067 ] {} RaftInstance: config at index 34 is committed, prev config log idx 44 2025.04.02 05:21:05.666111 [ 35067 ] {} RaftInstance: skipped config 34, latest config 44 2025.04.02 05:21:05.666197 [ 35067 ] {} RaftInstance: config at index 35 is committed, prev config log idx 44 2025.04.02 05:21:05.666232 [ 35067 ] {} RaftInstance: skipped config 35, latest config 44 2025.04.02 05:21:05.666309 [ 35067 ] {} RaftInstance: config at index 36 is committed, prev config log idx 44 2025.04.02 05:21:05.666344 [ 35067 ] {} RaftInstance: skipped config 36, latest config 44 2025.04.02 05:21:05.666433 [ 35067 ] {} RaftInstance: config at index 37 is committed, prev config log idx 44 2025.04.02 05:21:05.666464 [ 35067 ] {} RaftInstance: skipped config 37, latest config 44 2025.04.02 05:21:05.666531 [ 35067 ] {} RaftInstance: config at index 38 is committed, prev config log idx 44 2025.04.02 05:21:05.666567 [ 35067 ] {} RaftInstance: skipped config 38, latest config 44 2025.04.02 05:21:05.666669 [ 35067 ] {} RaftInstance: config at index 39 is committed, prev config log idx 44 2025.04.02 05:21:05.666708 [ 35067 ] {} RaftInstance: skipped config 39, latest config 44 2025.04.02 05:21:05.666770 [ 35067 ] {} RaftInstance: config at index 40 is committed, prev config log idx 44 2025.04.02 05:21:05.666805 [ 35067 ] {} RaftInstance: skipped config 40, latest config 44 2025.04.02 05:21:05.666859 [ 35067 ] {} RaftInstance: config at index 41 is committed, prev config log idx 44 2025.04.02 05:21:05.666899 [ 35067 ] {} RaftInstance: skipped config 41, latest config 44 2025.04.02 05:21:05.666953 [ 35067 ] {} RaftInstance: config at index 42 is committed, prev config log idx 44 2025.04.02 05:21:05.666981 [ 35067 ] {} RaftInstance: skipped config 42, latest config 44 2025.04.02 05:21:05.667041 [ 35067 ] {} RaftInstance: config at index 43 is committed, prev config log idx 44 2025.04.02 05:21:05.667073 [ 35067 ] {} RaftInstance: skipped config 43, latest config 44 2025.04.02 05:21:05.667127 [ 35067 ] {} RaftInstance: config at index 44 is committed, prev config log idx 44 2025.04.02 05:21:05.667157 [ 35067 ] {} RaftInstance: skipped config 44, latest config 44 2025.04.02 05:21:05.667236 [ 35067 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:21:05.667278 [ 35067 ] {} KeeperServer: Preprocessing done 2025.04.02 05:21:05.667361 [ 35067 ] {} RaftInstance: config at index 45 is committed, prev config log idx 44 2025.04.02 05:21:05.667420 [ 35067 ] {} RaftInstance: new config log idx 45, prev log idx 44, cur config log idx 44, prev log idx 43 2025.04.02 05:21:05.667516 [ 35067 ] {} RaftInstance: new configuration: log idx 45, prev log idx 44 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 45 2025.04.02 05:21:05.667669 [ 34459 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:21:05.668836 [ 34459 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:21:05.670712 [ 34459 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:21:05.671219 [ 34459 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:21:05.684132 [ 34459 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:21:05.684275 [ 34459 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:21:05.685525 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:21:05.686076 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:21:05.686639 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:21:05.686950 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:21:05.687164 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:21:05.687397 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:21:05.687593 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:21:05.687867 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:21:05.691351 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:21:05.691710 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:21:05.692105 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:21:05.692457 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:21:05.692805 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:21:05.693134 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:21:05.693478 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:21:05.693845 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:21:05.694196 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:21:05.694661 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:21:05.695000 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:21:05.695372 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:21:05.695711 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:21:05.696180 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:21:05.697047 [ 34459 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:21:05.705146 [ 34459 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:21:05.705440 [ 34459 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:21:05.712517 [ 34459 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:21:05.712646 [ 34459 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:05.715645 [ 34459 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:21:05.716817 [ 34459 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:21:05.717566 [ 34459 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:21:05.718199 [ 35073 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:21:05.726549 [ 34459 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:21:05.729557 [ 34459 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:21:05.735226 [ 34459 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:21:05.738412 [ 34459 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:21:05.744781 [ 34459 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:21:05.746855 [ 34459 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:21:05.748216 [ 34459 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:21:05.749321 [ 34459 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:21:05.749406 [ 34459 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:21:05.749525 [ 34469 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:21:05.750673 [ 34469 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:10.473424 [ 34459 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:10.474181 [ 34459 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:10.474810 [ 34459 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:10.474921 [ 34459 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:10.475109 [ 34468 ] {} CancellationChecker: Execution took 5547 ms. 2025.04.02 05:21:10.475480 [ 34459 ] {} Application: Shutting down storages. 2025.04.02 05:21:10.475567 [ 34459 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:10.477255 [ 34459 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:10.477360 [ 34459 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:10.477435 [ 34459 ] {} Context: Shutting down named sessions 2025.04.02 05:21:10.477563 [ 34459 ] {} Context: Shutting down database catalog 2025.04.02 05:21:10.477634 [ 34459 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:10.477743 [ 34459 ] {} Context: Shutting down merges executor 2025.04.02 05:21:10.478246 [ 34459 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:10.478932 [ 34459 ] {} Context: Shutting down moves executor 2025.04.02 05:21:10.479169 [ 34459 ] {} Context: Shutting down common executor 2025.04.02 05:21:10.479475 [ 34459 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:10.479539 [ 34459 ] {} Context: Shutting down caches 2025.04.02 05:21:10.479596 [ 34459 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:10.479952 [ 34459 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:10.483788 [ 34459 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:10.489428 [ 34459 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:10.489864 [ 34459 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:10.490722 [ 34459 ] {} Application: Shut down storages. 2025.04.02 05:21:10.490872 [ 34459 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:10.677607 [ 34459 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:10.677754 [ 34459 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:10.677855 [ 34459 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:11.171240 [ 34459 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:11.171445 [ 34459 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:11.171579 [ 34459 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:11.171663 [ 34459 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:11.171748 [ 34459 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:11.171818 [ 34459 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:11.171880 [ 34459 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:11.172114 [ 34459 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:11.172126 [ 35068 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:11.172374 [ 34459 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:11.172462 [ 34459 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:11.172545 [ 34459 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:11.172861 [ 35054 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:21:11.172999 [ 35051 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:11.173054 [ 35055 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:11.173172 [ 35056 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:11.173175 [ 35057 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:11.173476 [ 35060 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:21:11.173474 [ 35063 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:11.173720 [ 35054 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:11.173484 [ 35058 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:11.173755 [ 35065 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:11.173487 [ 35059 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:11.173748 [ 35052 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:11.173829 [ 35061 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:11.173563 [ 35062 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:11.173870 [ 35053 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:11.173912 [ 35066 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:11.173635 [ 35064 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:11.174543 [ 34459 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:11.174581 [ 35048 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:11.174723 [ 35049 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:21:11.175237 [ 34459 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:11.175385 [ 34459 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:11.175451 [ 34459 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:11.175513 [ 34459 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:11.175561 [ 34459 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:11.175720 [ 34459 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:11.175756 [ 34459 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:11.179175 [ 34459 ] {} Application: Destroyed global context. 2025.04.02 05:21:11.179591 [ 34459 ] {} Application: Waiting for background threads 2025.04.02 05:21:11.248284 [ 34459 ] {} Application: Background threads finished in 68 ms 2025.04.02 05:21:11.248775 [ 34459 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:11.248826 [ 34459 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:11.262471 [ 34459 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:11.262770 [ 34459 ] {} Application: shutting down 2025.04.02 05:21:11.262813 [ 34459 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:11.270089 [ 34462 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:11.270193 [ 34462 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:11.376353 [ 34457 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:21:11.734704 [ 35184 ] {} Application: Will watch for the process with pid 35186 2025.04.02 05:21:11.736024 [ 35186 ] {} Application: Forked a child process to watch 2025.04.02 05:21:11.737551 [ 35186 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:21:12.235135 [ 35186 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 35186 2025.04.02 05:21:12.236060 [ 35186 ] {} Application: starting up 2025.04.02 05:21:12.236143 [ 35186 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:21:12.271950 [ 35186 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:21:12.272213 [ 35186 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:21:12.272283 [ 35186 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:21:12.272338 [ 35186 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:21:12.272362 [ 35186 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:21:12.273881 [ 35186 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:21:12.274506 [ 35186 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:21:12.274555 [ 35186 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:21:12.274739 [ 35186 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:21:12.274790 [ 35186 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:21:13.156657 [ 35186 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:21:13.158798 [ 35186 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:21:13.158881 [ 35186 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:21:13.159055 [ 35186 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:21:13.159695 [ 35186 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:21:13.306026 [ 35196 ] {} CancellationChecker: Started worker function 2025.04.02 05:21:13.306537 [ 35186 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:21:13.306630 [ 35186 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:21:13.306686 [ 35186 ] {} Application: Initializing DateLUT. 2025.04.02 05:21:13.306726 [ 35186 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:21:13.307036 [ 35186 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:21:13.307517 [ 35186 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:21:13.325254 [ 35186 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:21:13.325407 [ 35186 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:21:13.325911 [ 35186 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:21:13.326551 [ 35186 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:21:13.326680 [ 35186 ] {} Application: Initializing interserver credentials. 2025.04.02 05:21:13.327912 [ 35186 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:21:13.333695 [ 35186 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:13.333764 [ 35186 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:21:13.333850 [ 35186 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:21:13.334311 [ 35186 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:21:13.345743 [ 35186 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:21:13.345811 [ 35186 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:21:13.353418 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:21:13.354453 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:21:13.354876 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:21:13.355359 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:21:13.355771 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:21:13.360130 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:21:13.360547 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:21:13.360921 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:21:13.361245 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:21:13.361594 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:21:13.362034 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:21:13.362369 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:21:13.362732 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:21:13.363094 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:21:13.363595 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:21:13.363909 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:21:13.364290 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:21:13.364647 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:21:13.365035 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:21:13.365407 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:21:13.365775 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:21:13.366138 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:21:13.366966 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:21:13.368029 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:21:13.368378 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:21:13.369364 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:21:13.370634 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:21:13.371087 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:21:13.371432 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:21:13.371832 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:21:13.372228 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:21:13.372618 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:21:13.373078 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:21:13.373440 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:21:13.373886 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:21:13.374240 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:21:13.374752 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:21:13.375246 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:21:13.375670 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:21:13.376790 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:21:13.377428 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:21:13.377889 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:21:13.378344 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:21:13.378791 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:21:13.379196 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:21:13.379748 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:21:13.380158 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:21:13.380631 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:21:13.381082 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:21:13.383550 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:21:13.384343 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:21:13.385242 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:21:13.385954 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:21:13.386411 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:21:13.386794 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:21:13.387559 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:21:13.388069 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:21:13.388669 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:21:13.389058 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:21:13.389621 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:21:13.390046 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:21:13.390735 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:21:13.391162 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:21:13.391704 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:21:13.392429 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:21:13.392937 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:21:13.395251 [ 35186 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:21:13.442463 [ 35186 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:21:13.444319 [ 35186 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:21:13.480594 [ 35186 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:21:13.480681 [ 35186 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:21:13.480720 [ 35186 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:21:13.495688 [ 35186 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:21:13.495745 [ 35186 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:21:13.495796 [ 35186 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:21:13.495916 [ 35186 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:13.501262 [ 35186 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:13.506571 [ 35186 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:13.517666 [ 35186 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:13.518077 [ 35186 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:21:13.518223 [ 35186 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:13.520367 [ 35186 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:21:13.520966 [ 35186 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:21:13.521221 [ 35186 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:21:13.522252 [ 35186 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:21:13.522324 [ 35186 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:21:13.523836 [ 35186 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:21:13.523876 [ 35186 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:21:13.523900 [ 35186 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:21:13.523943 [ 35186 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:21:13.523965 [ 35186 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:21:13.524142 [ 35186 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:13.524200 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.597770 [ 35186 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:13.608478 [ 35186 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:13.608583 [ 35186 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:13.609659 [ 35186 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:13.609828 [ 35186 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou 2025.04.02 05:21:13.609924 [ 35186 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou 2025.04.02 05:21:13.609986 [ 35186 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou, size 4 2025.04.02 05:21:13.610514 [ 35186 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou. 2025.04.02 05:21:13.610641 [ 35767 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou 2025.04.02 05:21:13.617043 [ 35767 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou, size 4 2025.04.02 05:21:13.617732 [ 35186 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/ixf/mrkxxggeajsncxysqwvwpogzjikou. 2025.04.02 05:21:13.617967 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ixf/mrkxxggeajsncxysqwvwpogzjikou (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.620844 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ixf/mrkxxggeajsncxysqwvwpogzjikou (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.620933 [ 35186 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/ixf/mrkxxggeajsncxysqwvwpogzjikou, Version: Latest, Offset: 2 2025.04.02 05:21:13.626061 [ 35186 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/ixf/mrkxxggeajsncxysqwvwpogzjikou 2025.04.02 05:21:13.626115 [ 35186 ] {} deleteFileFromS3: Object with path s3/ixf/mrkxxggeajsncxysqwvwpogzjikou was removed from S3 2025.04.02 05:21:13.626161 [ 35186 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:21:13.626212 [ 35186 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:21:13.629420 [ 35186 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:13.639571 [ 35186 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:13.639639 [ 35186 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:13.640227 [ 35186 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:13.648519 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.652591 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.652690 [ 35186 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:21:13.658410 [ 35186 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:21:13.658603 [ 35186 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:21:13 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 183262498584849F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:21:13.658749 [ 35186 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:21:13.662930 [ 35186 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:13.663011 [ 35186 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:21:13.663064 [ 35186 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:21:13.663125 [ 35186 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:21:13.663238 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.663335 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.663413 [ 35186 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:13.663469 [ 35186 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:13.663528 [ 35186 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:21:13.663580 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.663630 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.663685 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.663738 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.663795 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.666894 [ 35186 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:13.676781 [ 35186 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:13.676831 [ 35186 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:13.677491 [ 35186 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:13.683416 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/vhc/rwhujbjbfiatpiteswzjujvzvwfee (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.685541 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/vhc/rwhujbjbfiatpiteswzjujvzvwfee (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.685608 [ 35186 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/vhc/rwhujbjbfiatpiteswzjujvzvwfee, Version: Latest, Offset: 2 2025.04.02 05:21:13.689657 [ 35186 ] {} deleteFileFromS3: No blob storage log, not writing blob special/vhc/rwhujbjbfiatpiteswzjujvzvwfee 2025.04.02 05:21:13.689711 [ 35186 ] {} deleteFileFromS3: Object with path special/vhc/rwhujbjbfiatpiteswzjujvzvwfee was removed from S3 2025.04.02 05:21:13.689751 [ 35186 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:21:13.689782 [ 35186 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:21:13.692749 [ 35186 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:13.702336 [ 35186 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:13.702425 [ 35186 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:13.703115 [ 35186 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:13.708657 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/izn/nrxpcamgkapkcsftcwoxqavuznklp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.711174 [ 35186 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/izn/nrxpcamgkapkcsftcwoxqavuznklp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:13.711248 [ 35186 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/izn/nrxpcamgkapkcsftcwoxqavuznklp, Version: Latest, Offset: 2 2025.04.02 05:21:13.715435 [ 35186 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/izn/nrxpcamgkapkcsftcwoxqavuznklp 2025.04.02 05:21:13.715480 [ 35186 ] {} deleteFileFromS3: Object with path test_02944/izn/nrxpcamgkapkcsftcwoxqavuznklp was removed from S3 2025.04.02 05:21:13.715521 [ 35186 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:21:13.715553 [ 35186 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:21:13.715665 [ 35186 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:13.718642 [ 35186 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:13.722589 [ 35186 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:21:13.722694 [ 35186 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:21:13.724127 [ 35186 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:21:13.724312 [ 35186 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:21:13.725165 [ 35186 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:21:13.725217 [ 35186 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:21:13.725254 [ 35186 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:21:13.725291 [ 35186 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:21:13.725340 [ 35186 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:21:13.725935 [ 35186 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 45 entries 2025.04.02 05:21:13.726000 [ 35186 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:21:13.726090 [ 35186 ] {} KeeperServer: Last local log idx 45 2025.04.02 05:21:13.726148 [ 35186 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 45 2025.04.02 05:21:13.727241 [ 35186 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:21:13.736187 [ 35186 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:21:13.736535 [ 35186 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:21:13.736629 [ 35186 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:21:13.736687 [ 35186 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:21:13.736758 [ 35186 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:21:13.736799 [ 35186 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:21:13.736874 [ 35186 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 45 election timer allowed log store start 1, end 45 config log idx 45, prev log idx 44 -- ASYNC REPLICATION -- 2025.04.02 05:21:13.736924 [ 35186 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:21:13.736989 [ 35186 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:21:13.737058 [ 35186 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:21:13.737746 [ 35186 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:21:13.737856 [ 35794 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:21:13.788157 [ 35777 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:21:13.788343 [ 35777 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:21:13.788438 [ 35777 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 45, state term 45, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:21:13.788492 [ 35777 ] {} RaftInstance: pre-vote term (0) is different, reset it to 45 2025.04.02 05:21:13.788641 [ 35186 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:21:13.788801 [ 35777 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:21:13.791643 [ 35777 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 46, log idx 45, log term 45, priority (target 1 / mine 1) 2025.04.02 05:21:13.791716 [ 35777 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:21:13.791766 [ 35777 ] {} RaftInstance: state machine commit index 0, precommit index 45, last log index 45 2025.04.02 05:21:13.791814 [ 35777 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:21:13.792119 [ 35775 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:21:13.792374 [ 35777 ] {} RaftInstance: [BECOME LEADER] appended new config at 46 2025.04.02 05:21:13.792598 [ 35793 ] {} RaftInstance: config at index 1 is committed, prev config log idx 45 2025.04.02 05:21:13.792665 [ 35793 ] {} RaftInstance: skipped config 1, latest config 45 2025.04.02 05:21:13.792767 [ 35793 ] {} RaftInstance: config at index 2 is committed, prev config log idx 45 2025.04.02 05:21:13.792804 [ 35793 ] {} RaftInstance: skipped config 2, latest config 45 2025.04.02 05:21:13.792873 [ 35793 ] {} RaftInstance: config at index 3 is committed, prev config log idx 45 2025.04.02 05:21:13.792913 [ 35793 ] {} RaftInstance: skipped config 3, latest config 45 2025.04.02 05:21:13.792977 [ 35793 ] {} RaftInstance: config at index 4 is committed, prev config log idx 45 2025.04.02 05:21:13.793009 [ 35793 ] {} RaftInstance: skipped config 4, latest config 45 2025.04.02 05:21:13.793070 [ 35793 ] {} RaftInstance: config at index 5 is committed, prev config log idx 45 2025.04.02 05:21:13.793114 [ 35793 ] {} RaftInstance: skipped config 5, latest config 45 2025.04.02 05:21:13.793182 [ 35793 ] {} RaftInstance: config at index 6 is committed, prev config log idx 45 2025.04.02 05:21:13.793215 [ 35793 ] {} RaftInstance: skipped config 6, latest config 45 2025.04.02 05:21:13.793276 [ 35793 ] {} RaftInstance: config at index 7 is committed, prev config log idx 45 2025.04.02 05:21:13.793329 [ 35793 ] {} RaftInstance: skipped config 7, latest config 45 2025.04.02 05:21:13.793397 [ 35793 ] {} RaftInstance: config at index 8 is committed, prev config log idx 45 2025.04.02 05:21:13.793439 [ 35793 ] {} RaftInstance: skipped config 8, latest config 45 2025.04.02 05:21:13.793507 [ 35793 ] {} RaftInstance: config at index 9 is committed, prev config log idx 45 2025.04.02 05:21:13.793540 [ 35793 ] {} RaftInstance: skipped config 9, latest config 45 2025.04.02 05:21:13.793599 [ 35793 ] {} RaftInstance: config at index 10 is committed, prev config log idx 45 2025.04.02 05:21:13.793629 [ 35793 ] {} RaftInstance: skipped config 10, latest config 45 2025.04.02 05:21:13.793692 [ 35793 ] {} RaftInstance: config at index 11 is committed, prev config log idx 45 2025.04.02 05:21:13.793723 [ 35793 ] {} RaftInstance: skipped config 11, latest config 45 2025.04.02 05:21:13.793782 [ 35793 ] {} RaftInstance: config at index 12 is committed, prev config log idx 45 2025.04.02 05:21:13.793811 [ 35793 ] {} RaftInstance: skipped config 12, latest config 45 2025.04.02 05:21:13.793873 [ 35793 ] {} RaftInstance: config at index 13 is committed, prev config log idx 45 2025.04.02 05:21:13.793908 [ 35793 ] {} RaftInstance: skipped config 13, latest config 45 2025.04.02 05:21:13.793960 [ 35793 ] {} RaftInstance: config at index 14 is committed, prev config log idx 45 2025.04.02 05:21:13.793985 [ 35793 ] {} RaftInstance: skipped config 14, latest config 45 2025.04.02 05:21:13.794034 [ 35793 ] {} RaftInstance: config at index 15 is committed, prev config log idx 45 2025.04.02 05:21:13.794056 [ 35793 ] {} RaftInstance: skipped config 15, latest config 45 2025.04.02 05:21:13.794108 [ 35793 ] {} RaftInstance: config at index 16 is committed, prev config log idx 45 2025.04.02 05:21:13.794132 [ 35793 ] {} RaftInstance: skipped config 16, latest config 45 2025.04.02 05:21:13.794175 [ 35793 ] {} RaftInstance: config at index 17 is committed, prev config log idx 45 2025.04.02 05:21:13.794199 [ 35793 ] {} RaftInstance: skipped config 17, latest config 45 2025.04.02 05:21:13.794244 [ 35793 ] {} RaftInstance: config at index 18 is committed, prev config log idx 45 2025.04.02 05:21:13.794272 [ 35793 ] {} RaftInstance: skipped config 18, latest config 45 2025.04.02 05:21:13.794331 [ 35793 ] {} RaftInstance: config at index 19 is committed, prev config log idx 45 2025.04.02 05:21:13.794357 [ 35793 ] {} RaftInstance: skipped config 19, latest config 45 2025.04.02 05:21:13.794420 [ 35793 ] {} RaftInstance: config at index 20 is committed, prev config log idx 45 2025.04.02 05:21:13.794447 [ 35793 ] {} RaftInstance: skipped config 20, latest config 45 2025.04.02 05:21:13.794496 [ 35793 ] {} RaftInstance: config at index 21 is committed, prev config log idx 45 2025.04.02 05:21:13.794520 [ 35793 ] {} RaftInstance: skipped config 21, latest config 45 2025.04.02 05:21:13.794566 [ 35793 ] {} RaftInstance: config at index 22 is committed, prev config log idx 45 2025.04.02 05:21:13.794589 [ 35793 ] {} RaftInstance: skipped config 22, latest config 45 2025.04.02 05:21:13.794634 [ 35793 ] {} RaftInstance: config at index 23 is committed, prev config log idx 45 2025.04.02 05:21:13.794660 [ 35793 ] {} RaftInstance: skipped config 23, latest config 45 2025.04.02 05:21:13.794710 [ 35793 ] {} RaftInstance: config at index 24 is committed, prev config log idx 45 2025.04.02 05:21:13.794734 [ 35793 ] {} RaftInstance: skipped config 24, latest config 45 2025.04.02 05:21:13.794778 [ 35793 ] {} RaftInstance: config at index 25 is committed, prev config log idx 45 2025.04.02 05:21:13.794804 [ 35793 ] {} RaftInstance: skipped config 25, latest config 45 2025.04.02 05:21:13.794849 [ 35793 ] {} RaftInstance: config at index 26 is committed, prev config log idx 45 2025.04.02 05:21:13.794871 [ 35793 ] {} RaftInstance: skipped config 26, latest config 45 2025.04.02 05:21:13.794921 [ 35793 ] {} RaftInstance: config at index 27 is committed, prev config log idx 45 2025.04.02 05:21:13.794946 [ 35793 ] {} RaftInstance: skipped config 27, latest config 45 2025.04.02 05:21:13.794992 [ 35793 ] {} RaftInstance: config at index 28 is committed, prev config log idx 45 2025.04.02 05:21:13.795017 [ 35793 ] {} RaftInstance: skipped config 28, latest config 45 2025.04.02 05:21:13.795063 [ 35793 ] {} RaftInstance: config at index 29 is committed, prev config log idx 45 2025.04.02 05:21:13.795087 [ 35793 ] {} RaftInstance: skipped config 29, latest config 45 2025.04.02 05:21:13.795129 [ 35793 ] {} RaftInstance: config at index 30 is committed, prev config log idx 45 2025.04.02 05:21:13.795155 [ 35793 ] {} RaftInstance: skipped config 30, latest config 45 2025.04.02 05:21:13.795198 [ 35793 ] {} RaftInstance: config at index 31 is committed, prev config log idx 45 2025.04.02 05:21:13.795224 [ 35793 ] {} RaftInstance: skipped config 31, latest config 45 2025.04.02 05:21:13.795275 [ 35793 ] {} RaftInstance: config at index 32 is committed, prev config log idx 45 2025.04.02 05:21:13.795317 [ 35793 ] {} RaftInstance: skipped config 32, latest config 45 2025.04.02 05:21:13.795368 [ 35793 ] {} RaftInstance: config at index 33 is committed, prev config log idx 45 2025.04.02 05:21:13.795390 [ 35793 ] {} RaftInstance: skipped config 33, latest config 45 2025.04.02 05:21:13.795432 [ 35793 ] {} RaftInstance: config at index 34 is committed, prev config log idx 45 2025.04.02 05:21:13.795454 [ 35793 ] {} RaftInstance: skipped config 34, latest config 45 2025.04.02 05:21:13.795498 [ 35793 ] {} RaftInstance: config at index 35 is committed, prev config log idx 45 2025.04.02 05:21:13.795523 [ 35793 ] {} RaftInstance: skipped config 35, latest config 45 2025.04.02 05:21:13.795564 [ 35793 ] {} RaftInstance: config at index 36 is committed, prev config log idx 45 2025.04.02 05:21:13.795588 [ 35793 ] {} RaftInstance: skipped config 36, latest config 45 2025.04.02 05:21:13.795632 [ 35793 ] {} RaftInstance: config at index 37 is committed, prev config log idx 45 2025.04.02 05:21:13.795653 [ 35793 ] {} RaftInstance: skipped config 37, latest config 45 2025.04.02 05:21:13.795699 [ 35793 ] {} RaftInstance: config at index 38 is committed, prev config log idx 45 2025.04.02 05:21:13.795722 [ 35793 ] {} RaftInstance: skipped config 38, latest config 45 2025.04.02 05:21:13.795767 [ 35793 ] {} RaftInstance: config at index 39 is committed, prev config log idx 45 2025.04.02 05:21:13.795790 [ 35793 ] {} RaftInstance: skipped config 39, latest config 45 2025.04.02 05:21:13.795833 [ 35793 ] {} RaftInstance: config at index 40 is committed, prev config log idx 45 2025.04.02 05:21:13.795858 [ 35793 ] {} RaftInstance: skipped config 40, latest config 45 2025.04.02 05:21:13.795900 [ 35793 ] {} RaftInstance: config at index 41 is committed, prev config log idx 45 2025.04.02 05:21:13.795922 [ 35793 ] {} RaftInstance: skipped config 41, latest config 45 2025.04.02 05:21:13.795965 [ 35793 ] {} RaftInstance: config at index 42 is committed, prev config log idx 45 2025.04.02 05:21:13.795987 [ 35793 ] {} RaftInstance: skipped config 42, latest config 45 2025.04.02 05:21:13.796035 [ 35793 ] {} RaftInstance: config at index 43 is committed, prev config log idx 45 2025.04.02 05:21:13.796063 [ 35793 ] {} RaftInstance: skipped config 43, latest config 45 2025.04.02 05:21:13.796110 [ 35793 ] {} RaftInstance: config at index 44 is committed, prev config log idx 45 2025.04.02 05:21:13.796133 [ 35793 ] {} RaftInstance: skipped config 44, latest config 45 2025.04.02 05:21:13.796180 [ 35793 ] {} RaftInstance: config at index 45 is committed, prev config log idx 45 2025.04.02 05:21:13.796206 [ 35793 ] {} RaftInstance: skipped config 45, latest config 45 2025.04.02 05:21:13.796258 [ 35793 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:21:13.796288 [ 35793 ] {} KeeperServer: Preprocessing done 2025.04.02 05:21:13.796346 [ 35793 ] {} RaftInstance: config at index 46 is committed, prev config log idx 45 2025.04.02 05:21:13.796390 [ 35793 ] {} RaftInstance: new config log idx 46, prev log idx 45, cur config log idx 45, prev log idx 44 2025.04.02 05:21:13.796465 [ 35793 ] {} RaftInstance: new configuration: log idx 46, prev log idx 45 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 46 2025.04.02 05:21:13.796634 [ 35186 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:21:13.797392 [ 35186 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:21:13.799228 [ 35186 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:21:13.799577 [ 35186 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:21:13.811644 [ 35186 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:21:13.811734 [ 35186 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:21:13.812798 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:21:13.813185 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:21:13.813739 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:21:13.814016 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:21:13.814253 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:21:13.814547 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:21:13.814794 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:21:13.815125 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:21:13.819108 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:21:13.819521 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:21:13.819890 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:21:13.820258 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:21:13.820672 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:21:13.821027 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:21:13.821484 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:21:13.821926 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:21:13.822366 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:21:13.822893 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:21:13.823350 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:21:13.823770 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:21:13.824148 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:21:13.824688 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:21:13.825662 [ 35186 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:21:13.833783 [ 35186 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:21:13.833967 [ 35186 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:21:13.840448 [ 35186 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:21:13.840538 [ 35186 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:13.843435 [ 35186 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:21:13.844618 [ 35186 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:21:13.845073 [ 35186 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:21:13.845468 [ 35799 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:21:13.852616 [ 35186 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:21:13.855412 [ 35186 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:21:13.860654 [ 35186 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:21:13.863282 [ 35186 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:21:13.868438 [ 35186 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:21:13.870716 [ 35186 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:21:13.872408 [ 35186 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:21:13.873784 [ 35186 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:21:13.873916 [ 35186 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:21:13.873949 [ 35197 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:21:13.874540 [ 35197 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:18.308852 [ 35186 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:18.309242 [ 35186 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:18.309601 [ 35186 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:18.309663 [ 35186 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:18.309789 [ 35196 ] {} CancellationChecker: Execution took 5003 ms. 2025.04.02 05:21:18.310549 [ 35186 ] {} Application: Shutting down storages. 2025.04.02 05:21:18.310601 [ 35186 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:18.311738 [ 35186 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:18.311782 [ 35186 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:18.311808 [ 35186 ] {} Context: Shutting down named sessions 2025.04.02 05:21:18.311872 [ 35186 ] {} Context: Shutting down database catalog 2025.04.02 05:21:18.311906 [ 35186 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:18.311958 [ 35186 ] {} Context: Shutting down merges executor 2025.04.02 05:21:18.312646 [ 35186 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:18.313001 [ 35186 ] {} Context: Shutting down moves executor 2025.04.02 05:21:18.313332 [ 35186 ] {} Context: Shutting down common executor 2025.04.02 05:21:18.313529 [ 35186 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:18.313556 [ 35186 ] {} Context: Shutting down caches 2025.04.02 05:21:18.313587 [ 35186 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:18.313809 [ 35186 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:18.316730 [ 35186 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:18.325130 [ 35186 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:18.325420 [ 35186 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:18.326019 [ 35186 ] {} Application: Shut down storages. 2025.04.02 05:21:18.326067 [ 35186 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:18.555690 [ 35186 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:18.555772 [ 35186 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:18.555825 [ 35186 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:18.799100 [ 35186 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:18.799216 [ 35186 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:18.799825 [ 35186 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:18.799878 [ 35186 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:18.799921 [ 35186 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:18.799986 [ 35186 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:18.800052 [ 35186 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:18.800228 [ 35186 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:18.800288 [ 35794 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:18.800513 [ 35186 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:18.800607 [ 35186 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:18.800657 [ 35186 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:18.801015 [ 35777 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:18.800929 [ 35780 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:21:18.801051 [ 35779 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:18.801185 [ 35783 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:18.801256 [ 35787 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:21:18.801243 [ 35781 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:18.801341 [ 35792 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:18.801756 [ 35780 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:18.801779 [ 35785 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:18.801795 [ 35789 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:18.801795 [ 35782 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:18.801435 [ 35790 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:18.801800 [ 35791 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:18.801498 [ 35786 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:18.801739 [ 35784 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:18.801662 [ 35788 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:18.801822 [ 35778 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:18.802479 [ 35186 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:18.802513 [ 35775 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:18.802683 [ 35776 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:21:18.803312 [ 35186 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:18.803481 [ 35186 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:18.803546 [ 35186 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:18.803611 [ 35186 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:18.803661 [ 35186 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:18.803836 [ 35186 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:18.803873 [ 35186 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:18.807479 [ 35186 ] {} Application: Destroyed global context. 2025.04.02 05:21:18.807938 [ 35186 ] {} Application: Waiting for background threads 2025.04.02 05:21:18.880070 [ 35186 ] {} Application: Background threads finished in 72 ms 2025.04.02 05:21:18.880853 [ 35186 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:18.880944 [ 35186 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:18.905287 [ 35186 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:18.905767 [ 35186 ] {} Application: shutting down 2025.04.02 05:21:18.905847 [ 35186 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:18.917095 [ 35189 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:18.917201 [ 35189 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:19.044935 [ 35184 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:21:19.779546 [ 35911 ] {} Application: Will watch for the process with pid 35913 2025.04.02 05:21:19.780846 [ 35913 ] {} Application: Forked a child process to watch 2025.04.02 05:21:19.782248 [ 35913 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:21:20.266953 [ 35913 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 35913 2025.04.02 05:21:20.267844 [ 35913 ] {} Application: starting up 2025.04.02 05:21:20.267931 [ 35913 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:21:20.298506 [ 35913 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:21:20.298744 [ 35913 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:21:20.298809 [ 35913 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:21:20.298843 [ 35913 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:21:20.298866 [ 35913 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:21:20.300483 [ 35913 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:21:20.300908 [ 35913 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:21:20.300954 [ 35913 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:21:20.301116 [ 35913 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:21:20.301166 [ 35913 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:21:21.101517 [ 35913 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:21:21.103574 [ 35913 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:21:21.103653 [ 35913 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:21:21.103828 [ 35913 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:21:21.104548 [ 35913 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:21:21.264086 [ 35922 ] {} CancellationChecker: Started worker function 2025.04.02 05:21:21.264289 [ 35913 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:21:21.264371 [ 35913 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:21:21.264420 [ 35913 ] {} Application: Initializing DateLUT. 2025.04.02 05:21:21.264451 [ 35913 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:21:21.264680 [ 35913 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:21:21.265019 [ 35913 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:21:21.278001 [ 35913 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:21:21.278141 [ 35913 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:21:21.278466 [ 35913 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:21:21.278932 [ 35913 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:21:21.279013 [ 35913 ] {} Application: Initializing interserver credentials. 2025.04.02 05:21:21.279911 [ 35913 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:21:21.284835 [ 35913 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:21.284898 [ 35913 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:21:21.284990 [ 35913 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:21:21.285421 [ 35913 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:21:21.296259 [ 35913 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:21:21.296370 [ 35913 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:21:21.304012 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:21:21.305005 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:21:21.305384 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:21:21.305884 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:21:21.306278 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:21:21.310612 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:21:21.310994 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:21:21.311384 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:21:21.311725 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:21:21.312065 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:21:21.312505 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:21:21.312840 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:21:21.313171 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:21:21.313503 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:21:21.313983 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:21:21.314321 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:21:21.314701 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:21:21.315048 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:21:21.315467 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:21:21.315819 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:21:21.316197 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:21:21.316586 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:21:21.317268 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:21:21.318313 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:21:21.318682 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:21:21.319658 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:21:21.320788 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:21:21.321192 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:21:21.321539 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:21:21.321906 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:21:21.322278 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:21:21.322703 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:21:21.323170 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:21:21.323540 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:21:21.323993 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:21:21.324367 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:21:21.324839 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:21:21.325355 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:21:21.325799 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:21:21.326953 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:21:21.327560 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:21:21.327954 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:21:21.328404 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:21:21.328828 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:21:21.329239 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:21:21.329798 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:21:21.330229 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:21:21.330710 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:21:21.331172 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:21:21.333713 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:21:21.334572 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:21:21.335546 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:21:21.336165 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:21:21.336602 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:21:21.337014 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:21:21.337737 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:21:21.338197 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:21:21.338836 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:21:21.339234 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:21:21.339684 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:21:21.340086 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:21:21.340748 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:21:21.341179 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:21:21.341696 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:21:21.342424 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:21:21.342925 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:21:21.344742 [ 35913 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:21:21.390019 [ 35913 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:21:21.391919 [ 35913 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:21:21.426592 [ 35913 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:21:21.426685 [ 35913 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:21:21.426723 [ 35913 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:21:21.441431 [ 35913 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:21:21.441507 [ 35913 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:21:21.441564 [ 35913 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:21:21.441688 [ 35913 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:21.447760 [ 35913 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:21.453519 [ 35913 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:21.465211 [ 35913 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:21.465606 [ 35913 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:21:21.465734 [ 35913 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:21.467738 [ 35913 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:21:21.468343 [ 35913 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:21:21.468626 [ 35913 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:21:21.469611 [ 35913 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:21:21.469673 [ 35913 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:21:21.471095 [ 35913 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:21:21.471131 [ 35913 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:21:21.471155 [ 35913 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:21:21.471195 [ 35913 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:21:21.471217 [ 35913 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:21:21.471403 [ 35913 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:21.471461 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.539628 [ 35913 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:21.549600 [ 35913 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:21.549697 [ 35913 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:21.550780 [ 35913 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:21.550925 [ 35913 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc 2025.04.02 05:21:21.550995 [ 35913 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc 2025.04.02 05:21:21.551046 [ 35913 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc, size 4 2025.04.02 05:21:21.551774 [ 35913 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc. 2025.04.02 05:21:21.551967 [ 36493 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc 2025.04.02 05:21:21.559074 [ 36493 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc, size 4 2025.04.02 05:21:21.559925 [ 35913 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/iot/fnraovihgroglepxfpgwrbfiwzakc. 2025.04.02 05:21:21.560212 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/iot/fnraovihgroglepxfpgwrbfiwzakc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.563485 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/iot/fnraovihgroglepxfpgwrbfiwzakc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.563577 [ 35913 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/iot/fnraovihgroglepxfpgwrbfiwzakc, Version: Latest, Offset: 2 2025.04.02 05:21:21.569114 [ 35913 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/iot/fnraovihgroglepxfpgwrbfiwzakc 2025.04.02 05:21:21.569180 [ 35913 ] {} deleteFileFromS3: Object with path s3/iot/fnraovihgroglepxfpgwrbfiwzakc was removed from S3 2025.04.02 05:21:21.569236 [ 35913 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:21:21.569295 [ 35913 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:21:21.572368 [ 35913 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:21.582765 [ 35913 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:21.582838 [ 35913 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:21.583410 [ 35913 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:21.593722 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.600245 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.600417 [ 35913 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:21:21.608253 [ 35913 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:21:21.608571 [ 35913 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:21:21 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832624B5F5AE8DB x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:21:21.608792 [ 35913 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:21:21.614279 [ 35913 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:21.614379 [ 35913 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:21:21.614482 [ 35913 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:21:21.614543 [ 35913 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:21:21.614687 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.614776 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.614854 [ 35913 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:21.614927 [ 35913 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:21.615006 [ 35913 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:21:21.615090 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.615160 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.615235 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.615398 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.615487 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.619683 [ 35913 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:21.634190 [ 35913 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:21.634289 [ 35913 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:21.635333 [ 35913 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:21.642757 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/qnf/hudgfacekzkvquzqvfhxpifkvfxyo (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.646585 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/qnf/hudgfacekzkvquzqvfhxpifkvfxyo (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.646681 [ 35913 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/qnf/hudgfacekzkvquzqvfhxpifkvfxyo, Version: Latest, Offset: 2 2025.04.02 05:21:21.653608 [ 35913 ] {} deleteFileFromS3: No blob storage log, not writing blob special/qnf/hudgfacekzkvquzqvfhxpifkvfxyo 2025.04.02 05:21:21.653690 [ 35913 ] {} deleteFileFromS3: Object with path special/qnf/hudgfacekzkvquzqvfhxpifkvfxyo was removed from S3 2025.04.02 05:21:21.653747 [ 35913 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:21:21.653791 [ 35913 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:21:21.658265 [ 35913 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:21.672998 [ 35913 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:21.673104 [ 35913 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:21.674152 [ 35913 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:21.681134 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/fys/gqqmocsjboeukgczmiqopxzklvtxo (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.685020 [ 35913 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/fys/gqqmocsjboeukgczmiqopxzklvtxo (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:21.685114 [ 35913 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/fys/gqqmocsjboeukgczmiqopxzklvtxo, Version: Latest, Offset: 2 2025.04.02 05:21:21.691797 [ 35913 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/fys/gqqmocsjboeukgczmiqopxzklvtxo 2025.04.02 05:21:21.691888 [ 35913 ] {} deleteFileFromS3: Object with path test_02944/fys/gqqmocsjboeukgczmiqopxzklvtxo was removed from S3 2025.04.02 05:21:21.691952 [ 35913 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:21:21.692037 [ 35913 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:21:21.692232 [ 35913 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:21.696411 [ 35913 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:21.701703 [ 35913 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:21:21.701851 [ 35913 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:21:21.703978 [ 35913 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:21:21.704193 [ 35913 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:21:21.705371 [ 35913 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:21:21.705454 [ 35913 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:21:21.705514 [ 35913 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:21:21.705559 [ 35913 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:21:21.705603 [ 35913 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:21:21.706638 [ 35913 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 46 entries 2025.04.02 05:21:21.706736 [ 35913 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:21:21.706870 [ 35913 ] {} KeeperServer: Last local log idx 46 2025.04.02 05:21:21.706929 [ 35913 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 46 2025.04.02 05:21:21.708616 [ 35913 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:21:21.722534 [ 35913 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:21:21.723114 [ 35913 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:21:21.723251 [ 35913 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:21:21.723341 [ 35913 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:21:21.723436 [ 35913 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:21:21.723506 [ 35913 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:21:21.723613 [ 35913 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 46 election timer allowed log store start 1, end 46 config log idx 46, prev log idx 45 -- ASYNC REPLICATION -- 2025.04.02 05:21:21.723666 [ 35913 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:21:21.723747 [ 35913 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:21:21.723820 [ 35913 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:21:21.724683 [ 35913 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:21:21.724811 [ 36521 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:21:21.775220 [ 36504 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:21:21.775447 [ 36504 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:21:21.775613 [ 36504 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 46, state term 46, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:21:21.775701 [ 36504 ] {} RaftInstance: pre-vote term (0) is different, reset it to 46 2025.04.02 05:21:21.775779 [ 35913 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:21:21.776065 [ 36504 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:21:21.779636 [ 36504 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 47, log idx 46, log term 46, priority (target 1 / mine 1) 2025.04.02 05:21:21.779729 [ 36504 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:21:21.779806 [ 36504 ] {} RaftInstance: state machine commit index 0, precommit index 46, last log index 46 2025.04.02 05:21:21.779886 [ 36504 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:21:21.780359 [ 36502 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:21:21.780641 [ 36504 ] {} RaftInstance: [BECOME LEADER] appended new config at 47 2025.04.02 05:21:21.780973 [ 36520 ] {} RaftInstance: config at index 1 is committed, prev config log idx 46 2025.04.02 05:21:21.781057 [ 36520 ] {} RaftInstance: skipped config 1, latest config 46 2025.04.02 05:21:21.781166 [ 36520 ] {} RaftInstance: config at index 2 is committed, prev config log idx 46 2025.04.02 05:21:21.781210 [ 36520 ] {} RaftInstance: skipped config 2, latest config 46 2025.04.02 05:21:21.781284 [ 36520 ] {} RaftInstance: config at index 3 is committed, prev config log idx 46 2025.04.02 05:21:21.781351 [ 36520 ] {} RaftInstance: skipped config 3, latest config 46 2025.04.02 05:21:21.781431 [ 36520 ] {} RaftInstance: config at index 4 is committed, prev config log idx 46 2025.04.02 05:21:21.781470 [ 36520 ] {} RaftInstance: skipped config 4, latest config 46 2025.04.02 05:21:21.781541 [ 36520 ] {} RaftInstance: config at index 5 is committed, prev config log idx 46 2025.04.02 05:21:21.781580 [ 36520 ] {} RaftInstance: skipped config 5, latest config 46 2025.04.02 05:21:21.781691 [ 36520 ] {} RaftInstance: config at index 6 is committed, prev config log idx 46 2025.04.02 05:21:21.781733 [ 36520 ] {} RaftInstance: skipped config 6, latest config 46 2025.04.02 05:21:21.781810 [ 36520 ] {} RaftInstance: config at index 7 is committed, prev config log idx 46 2025.04.02 05:21:21.781860 [ 36520 ] {} RaftInstance: skipped config 7, latest config 46 2025.04.02 05:21:21.781931 [ 36520 ] {} RaftInstance: config at index 8 is committed, prev config log idx 46 2025.04.02 05:21:21.781983 [ 36520 ] {} RaftInstance: skipped config 8, latest config 46 2025.04.02 05:21:21.782057 [ 36520 ] {} RaftInstance: config at index 9 is committed, prev config log idx 46 2025.04.02 05:21:21.782093 [ 36520 ] {} RaftInstance: skipped config 9, latest config 46 2025.04.02 05:21:21.782160 [ 36520 ] {} RaftInstance: config at index 10 is committed, prev config log idx 46 2025.04.02 05:21:21.782197 [ 36520 ] {} RaftInstance: skipped config 10, latest config 46 2025.04.02 05:21:21.782270 [ 36520 ] {} RaftInstance: config at index 11 is committed, prev config log idx 46 2025.04.02 05:21:21.782324 [ 36520 ] {} RaftInstance: skipped config 11, latest config 46 2025.04.02 05:21:21.782420 [ 36520 ] {} RaftInstance: config at index 12 is committed, prev config log idx 46 2025.04.02 05:21:21.782459 [ 36520 ] {} RaftInstance: skipped config 12, latest config 46 2025.04.02 05:21:21.782545 [ 36520 ] {} RaftInstance: config at index 13 is committed, prev config log idx 46 2025.04.02 05:21:21.782590 [ 36520 ] {} RaftInstance: skipped config 13, latest config 46 2025.04.02 05:21:21.782666 [ 36520 ] {} RaftInstance: config at index 14 is committed, prev config log idx 46 2025.04.02 05:21:21.782706 [ 36520 ] {} RaftInstance: skipped config 14, latest config 46 2025.04.02 05:21:21.782783 [ 36520 ] {} RaftInstance: config at index 15 is committed, prev config log idx 46 2025.04.02 05:21:21.782819 [ 36520 ] {} RaftInstance: skipped config 15, latest config 46 2025.04.02 05:21:21.782899 [ 36520 ] {} RaftInstance: config at index 16 is committed, prev config log idx 46 2025.04.02 05:21:21.782961 [ 36520 ] {} RaftInstance: skipped config 16, latest config 46 2025.04.02 05:21:21.783051 [ 36520 ] {} RaftInstance: config at index 17 is committed, prev config log idx 46 2025.04.02 05:21:21.783112 [ 36520 ] {} RaftInstance: skipped config 17, latest config 46 2025.04.02 05:21:21.783200 [ 36520 ] {} RaftInstance: config at index 18 is committed, prev config log idx 46 2025.04.02 05:21:21.783244 [ 36520 ] {} RaftInstance: skipped config 18, latest config 46 2025.04.02 05:21:21.783335 [ 36520 ] {} RaftInstance: config at index 19 is committed, prev config log idx 46 2025.04.02 05:21:21.783374 [ 36520 ] {} RaftInstance: skipped config 19, latest config 46 2025.04.02 05:21:21.783441 [ 36520 ] {} RaftInstance: config at index 20 is committed, prev config log idx 46 2025.04.02 05:21:21.783479 [ 36520 ] {} RaftInstance: skipped config 20, latest config 46 2025.04.02 05:21:21.783556 [ 36520 ] {} RaftInstance: config at index 21 is committed, prev config log idx 46 2025.04.02 05:21:21.783605 [ 36520 ] {} RaftInstance: skipped config 21, latest config 46 2025.04.02 05:21:21.783683 [ 36520 ] {} RaftInstance: config at index 22 is committed, prev config log idx 46 2025.04.02 05:21:21.783723 [ 36520 ] {} RaftInstance: skipped config 22, latest config 46 2025.04.02 05:21:21.783794 [ 36520 ] {} RaftInstance: config at index 23 is committed, prev config log idx 46 2025.04.02 05:21:21.783845 [ 36520 ] {} RaftInstance: skipped config 23, latest config 46 2025.04.02 05:21:21.783924 [ 36520 ] {} RaftInstance: config at index 24 is committed, prev config log idx 46 2025.04.02 05:21:21.783963 [ 36520 ] {} RaftInstance: skipped config 24, latest config 46 2025.04.02 05:21:21.784031 [ 36520 ] {} RaftInstance: config at index 25 is committed, prev config log idx 46 2025.04.02 05:21:21.784081 [ 36520 ] {} RaftInstance: skipped config 25, latest config 46 2025.04.02 05:21:21.784152 [ 36520 ] {} RaftInstance: config at index 26 is committed, prev config log idx 46 2025.04.02 05:21:21.784188 [ 36520 ] {} RaftInstance: skipped config 26, latest config 46 2025.04.02 05:21:21.784260 [ 36520 ] {} RaftInstance: config at index 27 is committed, prev config log idx 46 2025.04.02 05:21:21.784313 [ 36520 ] {} RaftInstance: skipped config 27, latest config 46 2025.04.02 05:21:21.784394 [ 36520 ] {} RaftInstance: config at index 28 is committed, prev config log idx 46 2025.04.02 05:21:21.784434 [ 36520 ] {} RaftInstance: skipped config 28, latest config 46 2025.04.02 05:21:21.784510 [ 36520 ] {} RaftInstance: config at index 29 is committed, prev config log idx 46 2025.04.02 05:21:21.784550 [ 36520 ] {} RaftInstance: skipped config 29, latest config 46 2025.04.02 05:21:21.784622 [ 36520 ] {} RaftInstance: config at index 30 is committed, prev config log idx 46 2025.04.02 05:21:21.784668 [ 36520 ] {} RaftInstance: skipped config 30, latest config 46 2025.04.02 05:21:21.784745 [ 36520 ] {} RaftInstance: config at index 31 is committed, prev config log idx 46 2025.04.02 05:21:21.784789 [ 36520 ] {} RaftInstance: skipped config 31, latest config 46 2025.04.02 05:21:21.784860 [ 36520 ] {} RaftInstance: config at index 32 is committed, prev config log idx 46 2025.04.02 05:21:21.784896 [ 36520 ] {} RaftInstance: skipped config 32, latest config 46 2025.04.02 05:21:21.784974 [ 36520 ] {} RaftInstance: config at index 33 is committed, prev config log idx 46 2025.04.02 05:21:21.785011 [ 36520 ] {} RaftInstance: skipped config 33, latest config 46 2025.04.02 05:21:21.785079 [ 36520 ] {} RaftInstance: config at index 34 is committed, prev config log idx 46 2025.04.02 05:21:21.785116 [ 36520 ] {} RaftInstance: skipped config 34, latest config 46 2025.04.02 05:21:21.785184 [ 36520 ] {} RaftInstance: config at index 35 is committed, prev config log idx 46 2025.04.02 05:21:21.785238 [ 36520 ] {} RaftInstance: skipped config 35, latest config 46 2025.04.02 05:21:21.785326 [ 36520 ] {} RaftInstance: config at index 36 is committed, prev config log idx 46 2025.04.02 05:21:21.785369 [ 36520 ] {} RaftInstance: skipped config 36, latest config 46 2025.04.02 05:21:21.785451 [ 36520 ] {} RaftInstance: config at index 37 is committed, prev config log idx 46 2025.04.02 05:21:21.785490 [ 36520 ] {} RaftInstance: skipped config 37, latest config 46 2025.04.02 05:21:21.785579 [ 36520 ] {} RaftInstance: config at index 38 is committed, prev config log idx 46 2025.04.02 05:21:21.785619 [ 36520 ] {} RaftInstance: skipped config 38, latest config 46 2025.04.02 05:21:21.785696 [ 36520 ] {} RaftInstance: config at index 39 is committed, prev config log idx 46 2025.04.02 05:21:21.785736 [ 36520 ] {} RaftInstance: skipped config 39, latest config 46 2025.04.02 05:21:21.785809 [ 36520 ] {} RaftInstance: config at index 40 is committed, prev config log idx 46 2025.04.02 05:21:21.785848 [ 36520 ] {} RaftInstance: skipped config 40, latest config 46 2025.04.02 05:21:21.785919 [ 36520 ] {} RaftInstance: config at index 41 is committed, prev config log idx 46 2025.04.02 05:21:21.785957 [ 36520 ] {} RaftInstance: skipped config 41, latest config 46 2025.04.02 05:21:21.786037 [ 36520 ] {} RaftInstance: config at index 42 is committed, prev config log idx 46 2025.04.02 05:21:21.786074 [ 36520 ] {} RaftInstance: skipped config 42, latest config 46 2025.04.02 05:21:21.786152 [ 36520 ] {} RaftInstance: config at index 43 is committed, prev config log idx 46 2025.04.02 05:21:21.786199 [ 36520 ] {} RaftInstance: skipped config 43, latest config 46 2025.04.02 05:21:21.786269 [ 36520 ] {} RaftInstance: config at index 44 is committed, prev config log idx 46 2025.04.02 05:21:21.786325 [ 36520 ] {} RaftInstance: skipped config 44, latest config 46 2025.04.02 05:21:21.786451 [ 36520 ] {} RaftInstance: config at index 45 is committed, prev config log idx 46 2025.04.02 05:21:21.786521 [ 36520 ] {} RaftInstance: skipped config 45, latest config 46 2025.04.02 05:21:21.786596 [ 36520 ] {} RaftInstance: config at index 46 is committed, prev config log idx 46 2025.04.02 05:21:21.786633 [ 36520 ] {} RaftInstance: skipped config 46, latest config 46 2025.04.02 05:21:21.786748 [ 36520 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:21:21.786822 [ 36520 ] {} KeeperServer: Preprocessing done 2025.04.02 05:21:21.786888 [ 36520 ] {} RaftInstance: config at index 47 is committed, prev config log idx 46 2025.04.02 05:21:21.786955 [ 36520 ] {} RaftInstance: new config log idx 47, prev log idx 46, cur config log idx 46, prev log idx 45 2025.04.02 05:21:21.787065 [ 36520 ] {} RaftInstance: new configuration: log idx 47, prev log idx 46 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 47 2025.04.02 05:21:21.787220 [ 35913 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:21:21.788179 [ 35913 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:21:21.790274 [ 35913 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:21:21.790701 [ 35913 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:21:21.805900 [ 35913 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:21:21.806017 [ 35913 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:21:21.807484 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:21:21.808053 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:21:21.808738 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:21:21.809119 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:21:21.809455 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:21:21.809732 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:21:21.810021 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:21:21.810436 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:21:21.815677 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:21:21.816207 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:21:21.816708 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:21:21.817171 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:21:21.817638 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:21:21.818070 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:21:21.818531 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:21:21.819061 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:21:21.819682 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:21:21.820249 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:21:21.820711 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:21:21.821230 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:21:21.821776 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:21:21.822427 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:21:21.823517 [ 35913 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:21:21.835421 [ 35913 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:21:21.835827 [ 35913 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:21:21.846088 [ 35913 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:21:21.846244 [ 35913 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:21.851169 [ 35913 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:21:21.853119 [ 35913 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:21:21.853930 [ 35913 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:21:21.854563 [ 36526 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:21:21.863983 [ 35913 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:21:21.867417 [ 35913 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:21:21.873869 [ 35913 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:21:21.877193 [ 35913 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:21:21.884333 [ 35913 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:21:21.887048 [ 35913 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:21:21.889203 [ 35913 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:21:21.890908 [ 35913 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:21:21.891042 [ 35913 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:21:21.891162 [ 35923 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:21:21.892131 [ 35923 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:26.130926 [ 35913 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:26.131357 [ 35913 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:26.131701 [ 35913 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:26.131757 [ 35913 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:26.131908 [ 35922 ] {} CancellationChecker: Execution took 4867 ms. 2025.04.02 05:21:26.132624 [ 35913 ] {} Application: Shutting down storages. 2025.04.02 05:21:26.132673 [ 35913 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:26.134096 [ 35913 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:26.134159 [ 35913 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:26.134188 [ 35913 ] {} Context: Shutting down named sessions 2025.04.02 05:21:26.134245 [ 35913 ] {} Context: Shutting down database catalog 2025.04.02 05:21:26.134287 [ 35913 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:26.134359 [ 35913 ] {} Context: Shutting down merges executor 2025.04.02 05:21:26.134923 [ 35913 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:26.135749 [ 35913 ] {} Context: Shutting down moves executor 2025.04.02 05:21:26.136022 [ 35913 ] {} Context: Shutting down common executor 2025.04.02 05:21:26.136414 [ 35913 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:26.136493 [ 35913 ] {} Context: Shutting down caches 2025.04.02 05:21:26.136573 [ 35913 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:26.137013 [ 35913 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:26.139836 [ 35913 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:26.150224 [ 35913 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:26.150637 [ 35913 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:26.151267 [ 35913 ] {} Application: Shut down storages. 2025.04.02 05:21:26.151353 [ 35913 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:26.546814 [ 35913 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:26.546948 [ 35913 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:26.547021 [ 35913 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:26.790405 [ 35913 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:26.790572 [ 35913 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:26.791364 [ 35913 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:26.791443 [ 35913 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:26.791517 [ 35913 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:26.791591 [ 35913 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:26.791644 [ 35913 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:26.791861 [ 35913 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:26.791913 [ 36521 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:26.792157 [ 35913 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:26.792243 [ 35913 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:26.792350 [ 35913 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:26.792804 [ 36504 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:26.792854 [ 36508 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:26.792977 [ 36510 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:26.792755 [ 36507 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:21:26.793024 [ 36505 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:26.793247 [ 36513 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:21:26.793293 [ 36506 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:26.793293 [ 36509 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:26.793484 [ 36517 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:26.793298 [ 36515 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:26.793373 [ 36516 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:26.793240 [ 36514 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:26.793472 [ 36512 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:26.793374 [ 36511 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:26.793503 [ 36519 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:26.793925 [ 36507 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:26.793315 [ 36518 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:26.794243 [ 35913 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:26.794277 [ 36502 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:26.794475 [ 36503 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:21:26.795077 [ 35913 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:26.795213 [ 35913 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:26.795260 [ 35913 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:26.795342 [ 35913 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:26.795393 [ 35913 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:26.795551 [ 35913 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:26.795587 [ 35913 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:26.799835 [ 35913 ] {} Application: Destroyed global context. 2025.04.02 05:21:26.800501 [ 35913 ] {} Application: Waiting for background threads 2025.04.02 05:21:26.876529 [ 35913 ] {} Application: Background threads finished in 75 ms 2025.04.02 05:21:26.877281 [ 35913 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:26.877373 [ 35913 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:26.898516 [ 35913 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:26.898911 [ 35913 ] {} Application: shutting down 2025.04.02 05:21:26.898973 [ 35913 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:26.908905 [ 35916 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:26.909014 [ 35916 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:27.023193 [ 35911 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:21:27.347160 [ 36633 ] {} Application: Will watch for the process with pid 36635 2025.04.02 05:21:27.348254 [ 36635 ] {} Application: Forked a child process to watch 2025.04.02 05:21:27.349505 [ 36635 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:21:27.840035 [ 36635 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 36635 2025.04.02 05:21:27.840914 [ 36635 ] {} Application: starting up 2025.04.02 05:21:27.840998 [ 36635 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:21:27.872032 [ 36635 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:21:27.872253 [ 36635 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:21:27.872334 [ 36635 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:21:27.872368 [ 36635 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:21:27.872390 [ 36635 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:21:27.873783 [ 36635 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:21:27.874209 [ 36635 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:21:27.874254 [ 36635 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:21:27.874476 [ 36635 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:21:27.874539 [ 36635 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:21:28.724637 [ 36635 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:21:28.727015 [ 36635 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:21:28.727093 [ 36635 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:21:28.727249 [ 36635 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:21:28.728024 [ 36635 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:21:28.893676 [ 36644 ] {} CancellationChecker: Started worker function 2025.04.02 05:21:28.894182 [ 36635 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:21:28.894286 [ 36635 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:21:28.894404 [ 36635 ] {} Application: Initializing DateLUT. 2025.04.02 05:21:28.894493 [ 36635 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:21:28.894846 [ 36635 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:21:28.895437 [ 36635 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:21:28.923711 [ 36635 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:21:28.923938 [ 36635 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:21:28.924556 [ 36635 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:21:28.925433 [ 36635 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:21:28.925651 [ 36635 ] {} Application: Initializing interserver credentials. 2025.04.02 05:21:28.927376 [ 36635 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:21:28.936867 [ 36635 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:28.936970 [ 36635 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:21:28.937134 [ 36635 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:21:28.937869 [ 36635 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:21:28.954232 [ 36635 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:21:28.954342 [ 36635 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:21:28.962696 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:21:28.963817 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:21:28.964174 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:21:28.964673 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:21:28.965092 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:21:28.970141 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:21:28.970715 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:21:28.971169 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:21:28.971548 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:21:28.971882 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:21:28.972319 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:21:28.972705 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:21:28.973057 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:21:28.973462 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:21:28.973950 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:21:28.974291 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:21:28.974719 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:21:28.975065 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:21:28.975503 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:21:28.975942 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:21:28.976383 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:21:28.976768 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:21:28.977462 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:21:28.978644 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:21:28.978989 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:21:28.980120 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:21:28.981380 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:21:28.981812 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:21:28.982155 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:21:28.982564 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:21:28.982979 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:21:28.983402 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:21:28.983944 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:21:28.984349 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:21:28.984849 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:21:28.985217 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:21:28.985783 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:21:28.986425 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:21:28.986882 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:21:28.988109 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:21:28.988746 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:21:28.989182 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:21:28.989680 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:21:28.990153 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:21:28.990641 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:21:28.991267 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:21:28.991714 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:21:28.992171 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:21:28.992719 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:21:28.995389 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:21:28.996835 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:21:28.997988 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:21:28.998753 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:21:28.999230 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:21:28.999677 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:21:29.000381 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:21:29.000893 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:21:29.001573 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:21:29.002015 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:21:29.002484 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:21:29.002916 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:21:29.003586 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:21:29.004007 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:21:29.004516 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:21:29.005271 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:21:29.005757 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:21:29.007641 [ 36635 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:21:29.054835 [ 36635 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:21:29.056649 [ 36635 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:21:29.092771 [ 36635 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:21:29.092858 [ 36635 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:21:29.092934 [ 36635 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:21:29.108616 [ 36635 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:21:29.108681 [ 36635 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:21:29.108743 [ 36635 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:21:29.108888 [ 36635 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:29.115176 [ 36635 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:29.121038 [ 36635 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:29.133521 [ 36635 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:29.133918 [ 36635 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:21:29.134045 [ 36635 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:29.136272 [ 36635 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:21:29.136913 [ 36635 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:21:29.137232 [ 36635 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:21:29.138281 [ 36635 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:21:29.138367 [ 36635 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:21:29.139932 [ 36635 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:21:29.139971 [ 36635 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:21:29.139995 [ 36635 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:21:29.140036 [ 36635 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:21:29.140058 [ 36635 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:21:29.140260 [ 36635 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:29.140335 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.213887 [ 36635 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:29.225454 [ 36635 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:29.225575 [ 36635 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:29.226639 [ 36635 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:29.226805 [ 36635 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx 2025.04.02 05:21:29.226870 [ 36635 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx 2025.04.02 05:21:29.226918 [ 36635 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx, size 4 2025.04.02 05:21:29.227534 [ 36635 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx. 2025.04.02 05:21:29.227798 [ 37216 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx 2025.04.02 05:21:29.235113 [ 37216 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx, size 4 2025.04.02 05:21:29.235736 [ 36635 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx. 2025.04.02 05:21:29.236014 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.239560 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.239691 [ 36635 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx, Version: Latest, Offset: 2 2025.04.02 05:21:29.245557 [ 36635 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx 2025.04.02 05:21:29.245625 [ 36635 ] {} deleteFileFromS3: Object with path s3/wtp/lvbtqrbifqacyjraolitlpgfwpfgx was removed from S3 2025.04.02 05:21:29.245686 [ 36635 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:21:29.245750 [ 36635 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:21:29.249468 [ 36635 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:29.262089 [ 36635 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:29.262161 [ 36635 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:29.262837 [ 36635 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:29.271760 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.277099 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.277240 [ 36635 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:21:29.284637 [ 36635 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:21:29.284891 [ 36635 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:21:29 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832624D28E6669F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:21:29.285067 [ 36635 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:21:29.290536 [ 36635 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:29.290598 [ 36635 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:21:29.290660 [ 36635 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:21:29.290713 [ 36635 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:21:29.290854 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.290928 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.290998 [ 36635 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:29.291065 [ 36635 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:29.291137 [ 36635 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:21:29.291202 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.291292 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.291407 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.291473 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.291545 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.295298 [ 36635 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:29.305217 [ 36635 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:29.305273 [ 36635 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:29.306014 [ 36635 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:29.313860 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/zzl/nonnxyjetfymxjmepxygudchtnhbn (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.316746 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/zzl/nonnxyjetfymxjmepxygudchtnhbn (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.316808 [ 36635 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/zzl/nonnxyjetfymxjmepxygudchtnhbn, Version: Latest, Offset: 2 2025.04.02 05:21:29.321431 [ 36635 ] {} deleteFileFromS3: No blob storage log, not writing blob special/zzl/nonnxyjetfymxjmepxygudchtnhbn 2025.04.02 05:21:29.321481 [ 36635 ] {} deleteFileFromS3: Object with path special/zzl/nonnxyjetfymxjmepxygudchtnhbn was removed from S3 2025.04.02 05:21:29.321529 [ 36635 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:21:29.321562 [ 36635 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:21:29.324637 [ 36635 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:29.334680 [ 36635 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:29.334739 [ 36635 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:29.335390 [ 36635 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:29.342110 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ufm/bbleytwirowgviodnohgqamrvcohj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.344817 [ 36635 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ufm/bbleytwirowgviodnohgqamrvcohj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:29.344883 [ 36635 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/ufm/bbleytwirowgviodnohgqamrvcohj, Version: Latest, Offset: 2 2025.04.02 05:21:29.349912 [ 36635 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ufm/bbleytwirowgviodnohgqamrvcohj 2025.04.02 05:21:29.349958 [ 36635 ] {} deleteFileFromS3: Object with path test_02944/ufm/bbleytwirowgviodnohgqamrvcohj was removed from S3 2025.04.02 05:21:29.350008 [ 36635 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:21:29.350044 [ 36635 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:21:29.350178 [ 36635 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:29.353203 [ 36635 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:29.357089 [ 36635 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:21:29.357197 [ 36635 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:21:29.358861 [ 36635 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:21:29.359101 [ 36635 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:21:29.360210 [ 36635 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:21:29.360338 [ 36635 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:21:29.360379 [ 36635 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:21:29.360414 [ 36635 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:21:29.360468 [ 36635 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:21:29.361127 [ 36635 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 47 entries 2025.04.02 05:21:29.361198 [ 36635 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:21:29.361297 [ 36635 ] {} KeeperServer: Last local log idx 47 2025.04.02 05:21:29.361361 [ 36635 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 47 2025.04.02 05:21:29.362522 [ 36635 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:21:29.372994 [ 36635 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:21:29.373345 [ 36635 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:21:29.373478 [ 36635 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:21:29.373542 [ 36635 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:21:29.373612 [ 36635 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:21:29.373654 [ 36635 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:21:29.373732 [ 36635 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 47 election timer allowed log store start 1, end 47 config log idx 47, prev log idx 46 -- ASYNC REPLICATION -- 2025.04.02 05:21:29.373772 [ 36635 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:21:29.373836 [ 36635 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:21:29.373892 [ 36635 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:21:29.374583 [ 36635 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:21:29.374682 [ 37243 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:21:29.425137 [ 37226 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:21:29.425391 [ 37226 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:21:29.425528 [ 37226 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 47, state term 47, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:21:29.425613 [ 37226 ] {} RaftInstance: pre-vote term (0) is different, reset it to 47 2025.04.02 05:21:29.425656 [ 36635 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:21:29.425946 [ 37226 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:21:29.429088 [ 37226 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 48, log idx 47, log term 47, priority (target 1 / mine 1) 2025.04.02 05:21:29.429178 [ 37226 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:21:29.429257 [ 37226 ] {} RaftInstance: state machine commit index 0, precommit index 47, last log index 47 2025.04.02 05:21:29.429353 [ 37226 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:21:29.429677 [ 37224 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:21:29.429806 [ 37226 ] {} RaftInstance: [BECOME LEADER] appended new config at 48 2025.04.02 05:21:29.430123 [ 37242 ] {} RaftInstance: config at index 1 is committed, prev config log idx 47 2025.04.02 05:21:29.430293 [ 37242 ] {} RaftInstance: skipped config 1, latest config 47 2025.04.02 05:21:29.430459 [ 37242 ] {} RaftInstance: config at index 2 is committed, prev config log idx 47 2025.04.02 05:21:29.430525 [ 37242 ] {} RaftInstance: skipped config 2, latest config 47 2025.04.02 05:21:29.430596 [ 37242 ] {} RaftInstance: config at index 3 is committed, prev config log idx 47 2025.04.02 05:21:29.430634 [ 37242 ] {} RaftInstance: skipped config 3, latest config 47 2025.04.02 05:21:29.430694 [ 37242 ] {} RaftInstance: config at index 4 is committed, prev config log idx 47 2025.04.02 05:21:29.430736 [ 37242 ] {} RaftInstance: skipped config 4, latest config 47 2025.04.02 05:21:29.430794 [ 37242 ] {} RaftInstance: config at index 5 is committed, prev config log idx 47 2025.04.02 05:21:29.430844 [ 37242 ] {} RaftInstance: skipped config 5, latest config 47 2025.04.02 05:21:29.430911 [ 37242 ] {} RaftInstance: config at index 6 is committed, prev config log idx 47 2025.04.02 05:21:29.430939 [ 37242 ] {} RaftInstance: skipped config 6, latest config 47 2025.04.02 05:21:29.430993 [ 37242 ] {} RaftInstance: config at index 7 is committed, prev config log idx 47 2025.04.02 05:21:29.431021 [ 37242 ] {} RaftInstance: skipped config 7, latest config 47 2025.04.02 05:21:29.431076 [ 37242 ] {} RaftInstance: config at index 8 is committed, prev config log idx 47 2025.04.02 05:21:29.431125 [ 37242 ] {} RaftInstance: skipped config 8, latest config 47 2025.04.02 05:21:29.431198 [ 37242 ] {} RaftInstance: config at index 9 is committed, prev config log idx 47 2025.04.02 05:21:29.431230 [ 37242 ] {} RaftInstance: skipped config 9, latest config 47 2025.04.02 05:21:29.431285 [ 37242 ] {} RaftInstance: config at index 10 is committed, prev config log idx 47 2025.04.02 05:21:29.431334 [ 37242 ] {} RaftInstance: skipped config 10, latest config 47 2025.04.02 05:21:29.431394 [ 37242 ] {} RaftInstance: config at index 11 is committed, prev config log idx 47 2025.04.02 05:21:29.431447 [ 37242 ] {} RaftInstance: skipped config 11, latest config 47 2025.04.02 05:21:29.431500 [ 37242 ] {} RaftInstance: config at index 12 is committed, prev config log idx 47 2025.04.02 05:21:29.431524 [ 37242 ] {} RaftInstance: skipped config 12, latest config 47 2025.04.02 05:21:29.431569 [ 37242 ] {} RaftInstance: config at index 13 is committed, prev config log idx 47 2025.04.02 05:21:29.431617 [ 37242 ] {} RaftInstance: skipped config 13, latest config 47 2025.04.02 05:21:29.431665 [ 37242 ] {} RaftInstance: config at index 14 is committed, prev config log idx 47 2025.04.02 05:21:29.431691 [ 37242 ] {} RaftInstance: skipped config 14, latest config 47 2025.04.02 05:21:29.431769 [ 37242 ] {} RaftInstance: config at index 15 is committed, prev config log idx 47 2025.04.02 05:21:29.431794 [ 37242 ] {} RaftInstance: skipped config 15, latest config 47 2025.04.02 05:21:29.431852 [ 37242 ] {} RaftInstance: config at index 16 is committed, prev config log idx 47 2025.04.02 05:21:29.431880 [ 37242 ] {} RaftInstance: skipped config 16, latest config 47 2025.04.02 05:21:29.431922 [ 37242 ] {} RaftInstance: config at index 17 is committed, prev config log idx 47 2025.04.02 05:21:29.431946 [ 37242 ] {} RaftInstance: skipped config 17, latest config 47 2025.04.02 05:21:29.431988 [ 37242 ] {} RaftInstance: config at index 18 is committed, prev config log idx 47 2025.04.02 05:21:29.432016 [ 37242 ] {} RaftInstance: skipped config 18, latest config 47 2025.04.02 05:21:29.432059 [ 37242 ] {} RaftInstance: config at index 19 is committed, prev config log idx 47 2025.04.02 05:21:29.432083 [ 37242 ] {} RaftInstance: skipped config 19, latest config 47 2025.04.02 05:21:29.432125 [ 37242 ] {} RaftInstance: config at index 20 is committed, prev config log idx 47 2025.04.02 05:21:29.432158 [ 37242 ] {} RaftInstance: skipped config 20, latest config 47 2025.04.02 05:21:29.432208 [ 37242 ] {} RaftInstance: config at index 21 is committed, prev config log idx 47 2025.04.02 05:21:29.432231 [ 37242 ] {} RaftInstance: skipped config 21, latest config 47 2025.04.02 05:21:29.432276 [ 37242 ] {} RaftInstance: config at index 22 is committed, prev config log idx 47 2025.04.02 05:21:29.432318 [ 37242 ] {} RaftInstance: skipped config 22, latest config 47 2025.04.02 05:21:29.432365 [ 37242 ] {} RaftInstance: config at index 23 is committed, prev config log idx 47 2025.04.02 05:21:29.432392 [ 37242 ] {} RaftInstance: skipped config 23, latest config 47 2025.04.02 05:21:29.432441 [ 37242 ] {} RaftInstance: config at index 24 is committed, prev config log idx 47 2025.04.02 05:21:29.432465 [ 37242 ] {} RaftInstance: skipped config 24, latest config 47 2025.04.02 05:21:29.432506 [ 37242 ] {} RaftInstance: config at index 25 is committed, prev config log idx 47 2025.04.02 05:21:29.432533 [ 37242 ] {} RaftInstance: skipped config 25, latest config 47 2025.04.02 05:21:29.432576 [ 37242 ] {} RaftInstance: config at index 26 is committed, prev config log idx 47 2025.04.02 05:21:29.432598 [ 37242 ] {} RaftInstance: skipped config 26, latest config 47 2025.04.02 05:21:29.432641 [ 37242 ] {} RaftInstance: config at index 27 is committed, prev config log idx 47 2025.04.02 05:21:29.432664 [ 37242 ] {} RaftInstance: skipped config 27, latest config 47 2025.04.02 05:21:29.432710 [ 37242 ] {} RaftInstance: config at index 28 is committed, prev config log idx 47 2025.04.02 05:21:29.432734 [ 37242 ] {} RaftInstance: skipped config 28, latest config 47 2025.04.02 05:21:29.432784 [ 37242 ] {} RaftInstance: config at index 29 is committed, prev config log idx 47 2025.04.02 05:21:29.432808 [ 37242 ] {} RaftInstance: skipped config 29, latest config 47 2025.04.02 05:21:29.432849 [ 37242 ] {} RaftInstance: config at index 30 is committed, prev config log idx 47 2025.04.02 05:21:29.432877 [ 37242 ] {} RaftInstance: skipped config 30, latest config 47 2025.04.02 05:21:29.432920 [ 37242 ] {} RaftInstance: config at index 31 is committed, prev config log idx 47 2025.04.02 05:21:29.432957 [ 37242 ] {} RaftInstance: skipped config 31, latest config 47 2025.04.02 05:21:29.433037 [ 37242 ] {} RaftInstance: config at index 32 is committed, prev config log idx 47 2025.04.02 05:21:29.433063 [ 37242 ] {} RaftInstance: skipped config 32, latest config 47 2025.04.02 05:21:29.433109 [ 37242 ] {} RaftInstance: config at index 33 is committed, prev config log idx 47 2025.04.02 05:21:29.433133 [ 37242 ] {} RaftInstance: skipped config 33, latest config 47 2025.04.02 05:21:29.433196 [ 37242 ] {} RaftInstance: config at index 34 is committed, prev config log idx 47 2025.04.02 05:21:29.433221 [ 37242 ] {} RaftInstance: skipped config 34, latest config 47 2025.04.02 05:21:29.433266 [ 37242 ] {} RaftInstance: config at index 35 is committed, prev config log idx 47 2025.04.02 05:21:29.433294 [ 37242 ] {} RaftInstance: skipped config 35, latest config 47 2025.04.02 05:21:29.433351 [ 37242 ] {} RaftInstance: config at index 36 is committed, prev config log idx 47 2025.04.02 05:21:29.433376 [ 37242 ] {} RaftInstance: skipped config 36, latest config 47 2025.04.02 05:21:29.433419 [ 37242 ] {} RaftInstance: config at index 37 is committed, prev config log idx 47 2025.04.02 05:21:29.433441 [ 37242 ] {} RaftInstance: skipped config 37, latest config 47 2025.04.02 05:21:29.433499 [ 37242 ] {} RaftInstance: config at index 38 is committed, prev config log idx 47 2025.04.02 05:21:29.433524 [ 37242 ] {} RaftInstance: skipped config 38, latest config 47 2025.04.02 05:21:29.433571 [ 37242 ] {} RaftInstance: config at index 39 is committed, prev config log idx 47 2025.04.02 05:21:29.433605 [ 37242 ] {} RaftInstance: skipped config 39, latest config 47 2025.04.02 05:21:29.433650 [ 37242 ] {} RaftInstance: config at index 40 is committed, prev config log idx 47 2025.04.02 05:21:29.433681 [ 37242 ] {} RaftInstance: skipped config 40, latest config 47 2025.04.02 05:21:29.433725 [ 37242 ] {} RaftInstance: config at index 41 is committed, prev config log idx 47 2025.04.02 05:21:29.433748 [ 37242 ] {} RaftInstance: skipped config 41, latest config 47 2025.04.02 05:21:29.433790 [ 37242 ] {} RaftInstance: config at index 42 is committed, prev config log idx 47 2025.04.02 05:21:29.433815 [ 37242 ] {} RaftInstance: skipped config 42, latest config 47 2025.04.02 05:21:29.433863 [ 37242 ] {} RaftInstance: config at index 43 is committed, prev config log idx 47 2025.04.02 05:21:29.433889 [ 37242 ] {} RaftInstance: skipped config 43, latest config 47 2025.04.02 05:21:29.433931 [ 37242 ] {} RaftInstance: config at index 44 is committed, prev config log idx 47 2025.04.02 05:21:29.433953 [ 37242 ] {} RaftInstance: skipped config 44, latest config 47 2025.04.02 05:21:29.433996 [ 37242 ] {} RaftInstance: config at index 45 is committed, prev config log idx 47 2025.04.02 05:21:29.434022 [ 37242 ] {} RaftInstance: skipped config 45, latest config 47 2025.04.02 05:21:29.434065 [ 37242 ] {} RaftInstance: config at index 46 is committed, prev config log idx 47 2025.04.02 05:21:29.434088 [ 37242 ] {} RaftInstance: skipped config 46, latest config 47 2025.04.02 05:21:29.434133 [ 37242 ] {} RaftInstance: config at index 47 is committed, prev config log idx 47 2025.04.02 05:21:29.434181 [ 37242 ] {} RaftInstance: skipped config 47, latest config 47 2025.04.02 05:21:29.434245 [ 37242 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:21:29.434280 [ 37242 ] {} KeeperServer: Preprocessing done 2025.04.02 05:21:29.434336 [ 37242 ] {} RaftInstance: config at index 48 is committed, prev config log idx 47 2025.04.02 05:21:29.434402 [ 37242 ] {} RaftInstance: new config log idx 48, prev log idx 47, cur config log idx 47, prev log idx 46 2025.04.02 05:21:29.434482 [ 37242 ] {} RaftInstance: new configuration: log idx 48, prev log idx 47 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 48 2025.04.02 05:21:29.434694 [ 36635 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:21:29.435651 [ 36635 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:21:29.437545 [ 36635 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:21:29.437902 [ 36635 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:21:29.450986 [ 36635 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:21:29.451104 [ 36635 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:21:29.452324 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:21:29.452710 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:21:29.453343 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:21:29.453666 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:21:29.453943 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:21:29.454206 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:21:29.454503 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:21:29.454864 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:21:29.459207 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:21:29.459608 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:21:29.459984 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:21:29.460411 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:21:29.460836 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:21:29.461287 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:21:29.461676 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:21:29.462140 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:21:29.462612 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:21:29.463202 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:21:29.463639 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:21:29.464014 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:21:29.464389 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:21:29.464826 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:21:29.465579 [ 36635 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:21:29.472956 [ 36635 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:21:29.473178 [ 36635 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:21:29.480415 [ 36635 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:21:29.480524 [ 36635 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:29.483705 [ 36635 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:21:29.485021 [ 36635 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:21:29.485711 [ 36635 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:21:29.486417 [ 37248 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:21:29.495745 [ 36635 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:21:29.499133 [ 36635 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:21:29.505708 [ 36635 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:21:29.509070 [ 36635 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:21:29.514957 [ 36635 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:21:29.517835 [ 36635 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:21:29.520446 [ 36635 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:21:29.522358 [ 36635 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:21:29.522545 [ 36635 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:21:29.522617 [ 36645 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:21:29.523585 [ 36645 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:34.189524 [ 36635 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:34.189908 [ 36635 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:34.190331 [ 36635 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:34.190411 [ 36635 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:34.190603 [ 36644 ] {} CancellationChecker: Execution took 5297 ms. 2025.04.02 05:21:34.190862 [ 36635 ] {} Application: Shutting down storages. 2025.04.02 05:21:34.190918 [ 36635 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:34.192565 [ 36635 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:34.192604 [ 36635 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:34.192630 [ 36635 ] {} Context: Shutting down named sessions 2025.04.02 05:21:34.192685 [ 36635 ] {} Context: Shutting down database catalog 2025.04.02 05:21:34.192720 [ 36635 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:34.192771 [ 36635 ] {} Context: Shutting down merges executor 2025.04.02 05:21:34.193219 [ 36635 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:34.193684 [ 36635 ] {} Context: Shutting down moves executor 2025.04.02 05:21:34.194058 [ 36635 ] {} Context: Shutting down common executor 2025.04.02 05:21:34.194450 [ 36635 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:34.194514 [ 36635 ] {} Context: Shutting down caches 2025.04.02 05:21:34.194579 [ 36635 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:34.194942 [ 36635 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:34.198244 [ 36635 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:34.204488 [ 36635 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:34.204796 [ 36635 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:34.205376 [ 36635 ] {} Application: Shut down storages. 2025.04.02 05:21:34.205424 [ 36635 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:34.694665 [ 36635 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:34.694797 [ 36635 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:34.694855 [ 36635 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:34.937858 [ 36635 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:34.937979 [ 36635 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:34.938066 [ 36635 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:34.938120 [ 36635 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:34.938170 [ 36635 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:34.938209 [ 36635 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:34.938351 [ 36635 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:34.938569 [ 36635 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:34.938653 [ 37243 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:34.938962 [ 36635 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:34.939017 [ 36635 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:34.939055 [ 36635 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:34.939457 [ 37229 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:21:34.939748 [ 37228 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:21:34.939798 [ 37226 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:34.940086 [ 37235 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:21:34.940109 [ 37234 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:34.940468 [ 37240 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:34.940301 [ 37230 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:34.940885 [ 37229 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:34.940486 [ 37241 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:34.940464 [ 37227 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:34.940977 [ 37238 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:34.940950 [ 37231 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:34.940819 [ 37239 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:34.940635 [ 37237 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:34.940754 [ 37236 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:34.940978 [ 37232 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:34.940839 [ 37233 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:34.941924 [ 36635 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:34.941960 [ 37224 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:34.942142 [ 37225 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:21:34.943029 [ 36635 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:34.943250 [ 36635 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:34.943333 [ 36635 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:34.943420 [ 36635 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:34.943495 [ 36635 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:34.943676 [ 36635 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:34.943751 [ 36635 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:34.948217 [ 36635 ] {} Application: Destroyed global context. 2025.04.02 05:21:34.948698 [ 36635 ] {} Application: Waiting for background threads 2025.04.02 05:21:35.039485 [ 36635 ] {} Application: Background threads finished in 90 ms 2025.04.02 05:21:35.040222 [ 36635 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:35.040344 [ 36635 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:35.059714 [ 36635 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:35.060044 [ 36635 ] {} Application: shutting down 2025.04.02 05:21:35.060101 [ 36635 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:35.068414 [ 36638 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:35.068522 [ 36638 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:35.168067 [ 36633 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:21:35.468899 [ 37360 ] {} Application: Will watch for the process with pid 37362 2025.04.02 05:21:35.470187 [ 37362 ] {} Application: Forked a child process to watch 2025.04.02 05:21:35.471609 [ 37362 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:21:35.971077 [ 37362 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 37362 2025.04.02 05:21:35.971983 [ 37362 ] {} Application: starting up 2025.04.02 05:21:35.972067 [ 37362 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:21:36.003640 [ 37362 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:21:36.003850 [ 37362 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:21:36.003912 [ 37362 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:21:36.003982 [ 37362 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:21:36.004022 [ 37362 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:21:36.005412 [ 37362 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:21:36.005838 [ 37362 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:21:36.005883 [ 37362 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:21:36.006046 [ 37362 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:21:36.006096 [ 37362 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:21:36.847637 [ 37362 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:21:36.849763 [ 37362 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:21:36.849841 [ 37362 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:21:36.849992 [ 37362 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:21:36.850656 [ 37362 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:21:37.027965 [ 37371 ] {} CancellationChecker: Started worker function 2025.04.02 05:21:37.028543 [ 37362 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:21:37.028662 [ 37362 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:21:37.030473 [ 37362 ] {} Application: Initializing DateLUT. 2025.04.02 05:21:37.030523 [ 37362 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:21:37.030814 [ 37362 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:21:37.031221 [ 37362 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:21:37.045011 [ 37362 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:21:37.045163 [ 37362 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:21:37.045517 [ 37362 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:21:37.046028 [ 37362 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:21:37.046119 [ 37362 ] {} Application: Initializing interserver credentials. 2025.04.02 05:21:37.047127 [ 37362 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:21:37.055066 [ 37362 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:37.055157 [ 37362 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:21:37.055331 [ 37362 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:21:37.055879 [ 37362 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:21:37.068432 [ 37362 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:21:37.068524 [ 37362 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:21:37.076206 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:21:37.077187 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:21:37.077553 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:21:37.078056 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:21:37.078495 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:21:37.082876 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:21:37.083434 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:21:37.083869 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:21:37.084202 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:21:37.084547 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:21:37.085042 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:21:37.085385 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:21:37.085716 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:21:37.086041 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:21:37.086574 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:21:37.086913 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:21:37.087277 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:21:37.087632 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:21:37.088028 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:21:37.088407 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:21:37.088803 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:21:37.089182 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:21:37.089878 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:21:37.090956 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:21:37.091318 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:21:37.092268 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:21:37.093390 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:21:37.093805 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:21:37.094154 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:21:37.094575 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:21:37.094985 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:21:37.095435 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:21:37.095931 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:21:37.096293 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:21:37.096747 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:21:37.097101 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:21:37.097571 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:21:37.098107 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:21:37.098667 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:21:37.099837 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:21:37.100440 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:21:37.100834 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:21:37.101306 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:21:37.101743 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:21:37.102217 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:21:37.102780 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:21:37.103225 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:21:37.103746 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:21:37.104201 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:21:37.106692 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:21:37.107548 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:21:37.108495 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:21:37.109089 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:21:37.109538 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:21:37.109920 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:21:37.110653 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:21:37.111141 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:21:37.111743 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:21:37.112133 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:21:37.112571 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:21:37.112980 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:21:37.113643 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:21:37.114063 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:21:37.114590 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:21:37.115270 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:21:37.115766 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:21:37.117567 [ 37362 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:21:37.163000 [ 37362 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:21:37.164729 [ 37362 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:21:37.199732 [ 37362 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:21:37.199828 [ 37362 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:21:37.199872 [ 37362 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:21:37.214929 [ 37362 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:21:37.214985 [ 37362 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:21:37.215034 [ 37362 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:21:37.215154 [ 37362 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:37.220712 [ 37362 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:37.226138 [ 37362 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:37.237270 [ 37362 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:37.237679 [ 37362 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:21:37.237812 [ 37362 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:37.239935 [ 37362 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:21:37.240596 [ 37362 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:21:37.240891 [ 37362 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:21:37.241883 [ 37362 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:21:37.241946 [ 37362 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:21:37.243338 [ 37362 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:21:37.243376 [ 37362 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:21:37.243400 [ 37362 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:21:37.243440 [ 37362 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:21:37.243463 [ 37362 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:21:37.243625 [ 37362 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:37.243681 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.311537 [ 37362 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:37.321016 [ 37362 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:37.321089 [ 37362 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:37.321962 [ 37362 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:37.322088 [ 37362 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk 2025.04.02 05:21:37.322150 [ 37362 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk 2025.04.02 05:21:37.322198 [ 37362 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk, size 4 2025.04.02 05:21:37.322722 [ 37362 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk. 2025.04.02 05:21:37.322877 [ 37943 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk 2025.04.02 05:21:37.329406 [ 37943 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk, size 4 2025.04.02 05:21:37.330101 [ 37362 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/tif/ltvmamznljwkjvqczrdanryxmxgwk. 2025.04.02 05:21:37.330408 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tif/ltvmamznljwkjvqczrdanryxmxgwk (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.333328 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/tif/ltvmamznljwkjvqczrdanryxmxgwk (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.333423 [ 37362 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/tif/ltvmamznljwkjvqczrdanryxmxgwk, Version: Latest, Offset: 2 2025.04.02 05:21:37.339254 [ 37362 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/tif/ltvmamznljwkjvqczrdanryxmxgwk 2025.04.02 05:21:37.339335 [ 37362 ] {} deleteFileFromS3: Object with path s3/tif/ltvmamznljwkjvqczrdanryxmxgwk was removed from S3 2025.04.02 05:21:37.339400 [ 37362 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:21:37.339510 [ 37362 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:21:37.343259 [ 37362 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:37.355714 [ 37362 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:37.355818 [ 37362 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:37.356734 [ 37362 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:37.365885 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.371467 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.371571 [ 37362 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:21:37.378807 [ 37362 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:21:37.379033 [ 37362 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:21:37 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832624F0B5AAFB7 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:21:37.379202 [ 37362 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:21:37.383654 [ 37362 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:37.383710 [ 37362 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:21:37.383767 [ 37362 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:21:37.383817 [ 37362 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:21:37.383949 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.384062 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.384147 [ 37362 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:37.384219 [ 37362 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:37.384338 [ 37362 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:21:37.384411 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.384503 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.384616 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.384711 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.384808 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.388582 [ 37362 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:37.398075 [ 37362 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:37.398146 [ 37362 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:37.398851 [ 37362 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:37.404914 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/mep/nyrxtjzhrgbkbatqsvasoathuppax (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.407922 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/mep/nyrxtjzhrgbkbatqsvasoathuppax (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.407989 [ 37362 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/mep/nyrxtjzhrgbkbatqsvasoathuppax, Version: Latest, Offset: 2 2025.04.02 05:21:37.414026 [ 37362 ] {} deleteFileFromS3: No blob storage log, not writing blob special/mep/nyrxtjzhrgbkbatqsvasoathuppax 2025.04.02 05:21:37.414082 [ 37362 ] {} deleteFileFromS3: Object with path special/mep/nyrxtjzhrgbkbatqsvasoathuppax was removed from S3 2025.04.02 05:21:37.414125 [ 37362 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:21:37.414159 [ 37362 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:21:37.417596 [ 37362 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:37.427497 [ 37362 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:37.427593 [ 37362 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:37.428289 [ 37362 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:37.434492 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/nmz/frofdmkupseuhpqxujajwwwehevis (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.436987 [ 37362 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/nmz/frofdmkupseuhpqxujajwwwehevis (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:37.437051 [ 37362 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/nmz/frofdmkupseuhpqxujajwwwehevis, Version: Latest, Offset: 2 2025.04.02 05:21:37.442475 [ 37362 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/nmz/frofdmkupseuhpqxujajwwwehevis 2025.04.02 05:21:37.442529 [ 37362 ] {} deleteFileFromS3: Object with path test_02944/nmz/frofdmkupseuhpqxujajwwwehevis was removed from S3 2025.04.02 05:21:37.442568 [ 37362 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:21:37.442601 [ 37362 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:21:37.442719 [ 37362 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:37.445855 [ 37362 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:37.449901 [ 37362 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:21:37.450028 [ 37362 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:21:37.452024 [ 37362 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:21:37.452196 [ 37362 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:21:37.453186 [ 37362 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:21:37.453241 [ 37362 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:21:37.453283 [ 37362 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:21:37.453330 [ 37362 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:21:37.453385 [ 37362 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:21:37.454007 [ 37362 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 48 entries 2025.04.02 05:21:37.454092 [ 37362 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:21:37.454193 [ 37362 ] {} KeeperServer: Last local log idx 48 2025.04.02 05:21:37.454241 [ 37362 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 48 2025.04.02 05:21:37.455481 [ 37362 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:21:37.465947 [ 37362 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:21:37.466334 [ 37362 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:21:37.466454 [ 37362 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:21:37.466512 [ 37362 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:21:37.466581 [ 37362 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:21:37.466631 [ 37362 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:21:37.466710 [ 37362 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 48 election timer allowed log store start 1, end 48 config log idx 48, prev log idx 47 -- ASYNC REPLICATION -- 2025.04.02 05:21:37.466753 [ 37362 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:21:37.466827 [ 37362 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:21:37.466885 [ 37362 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:21:37.467863 [ 37362 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:21:37.467950 [ 37970 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:21:37.518357 [ 37953 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:21:37.518601 [ 37953 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:21:37.518742 [ 37953 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 48, state term 48, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:21:37.518814 [ 37953 ] {} RaftInstance: pre-vote term (0) is different, reset it to 48 2025.04.02 05:21:37.518862 [ 37362 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:21:37.519107 [ 37953 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:21:37.521907 [ 37953 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 49, log idx 48, log term 48, priority (target 1 / mine 1) 2025.04.02 05:21:37.521975 [ 37953 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:21:37.522034 [ 37953 ] {} RaftInstance: state machine commit index 0, precommit index 48, last log index 48 2025.04.02 05:21:37.522091 [ 37953 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:21:37.522332 [ 37951 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:21:37.522485 [ 37953 ] {} RaftInstance: [BECOME LEADER] appended new config at 49 2025.04.02 05:21:37.522788 [ 37969 ] {} RaftInstance: config at index 1 is committed, prev config log idx 48 2025.04.02 05:21:37.522856 [ 37969 ] {} RaftInstance: skipped config 1, latest config 48 2025.04.02 05:21:37.522955 [ 37969 ] {} RaftInstance: config at index 2 is committed, prev config log idx 48 2025.04.02 05:21:37.522992 [ 37969 ] {} RaftInstance: skipped config 2, latest config 48 2025.04.02 05:21:37.523063 [ 37969 ] {} RaftInstance: config at index 3 is committed, prev config log idx 48 2025.04.02 05:21:37.523103 [ 37969 ] {} RaftInstance: skipped config 3, latest config 48 2025.04.02 05:21:37.523172 [ 37969 ] {} RaftInstance: config at index 4 is committed, prev config log idx 48 2025.04.02 05:21:37.523205 [ 37969 ] {} RaftInstance: skipped config 4, latest config 48 2025.04.02 05:21:37.523269 [ 37969 ] {} RaftInstance: config at index 5 is committed, prev config log idx 48 2025.04.02 05:21:37.523302 [ 37969 ] {} RaftInstance: skipped config 5, latest config 48 2025.04.02 05:21:37.523386 [ 37969 ] {} RaftInstance: config at index 6 is committed, prev config log idx 48 2025.04.02 05:21:37.523418 [ 37969 ] {} RaftInstance: skipped config 6, latest config 48 2025.04.02 05:21:37.523488 [ 37969 ] {} RaftInstance: config at index 7 is committed, prev config log idx 48 2025.04.02 05:21:37.523545 [ 37969 ] {} RaftInstance: skipped config 7, latest config 48 2025.04.02 05:21:37.523620 [ 37969 ] {} RaftInstance: config at index 8 is committed, prev config log idx 48 2025.04.02 05:21:37.523657 [ 37969 ] {} RaftInstance: skipped config 8, latest config 48 2025.04.02 05:21:37.523711 [ 37969 ] {} RaftInstance: config at index 9 is committed, prev config log idx 48 2025.04.02 05:21:37.523735 [ 37969 ] {} RaftInstance: skipped config 9, latest config 48 2025.04.02 05:21:37.523783 [ 37969 ] {} RaftInstance: config at index 10 is committed, prev config log idx 48 2025.04.02 05:21:37.523808 [ 37969 ] {} RaftInstance: skipped config 10, latest config 48 2025.04.02 05:21:37.523874 [ 37969 ] {} RaftInstance: config at index 11 is committed, prev config log idx 48 2025.04.02 05:21:37.523904 [ 37969 ] {} RaftInstance: skipped config 11, latest config 48 2025.04.02 05:21:37.523952 [ 37969 ] {} RaftInstance: config at index 12 is committed, prev config log idx 48 2025.04.02 05:21:37.523975 [ 37969 ] {} RaftInstance: skipped config 12, latest config 48 2025.04.02 05:21:37.524025 [ 37969 ] {} RaftInstance: config at index 13 is committed, prev config log idx 48 2025.04.02 05:21:37.524055 [ 37969 ] {} RaftInstance: skipped config 13, latest config 48 2025.04.02 05:21:37.524103 [ 37969 ] {} RaftInstance: config at index 14 is committed, prev config log idx 48 2025.04.02 05:21:37.524128 [ 37969 ] {} RaftInstance: skipped config 14, latest config 48 2025.04.02 05:21:37.524178 [ 37969 ] {} RaftInstance: config at index 15 is committed, prev config log idx 48 2025.04.02 05:21:37.524201 [ 37969 ] {} RaftInstance: skipped config 15, latest config 48 2025.04.02 05:21:37.524259 [ 37969 ] {} RaftInstance: config at index 16 is committed, prev config log idx 48 2025.04.02 05:21:37.524285 [ 37969 ] {} RaftInstance: skipped config 16, latest config 48 2025.04.02 05:21:37.524347 [ 37969 ] {} RaftInstance: config at index 17 is committed, prev config log idx 48 2025.04.02 05:21:37.524386 [ 37969 ] {} RaftInstance: skipped config 17, latest config 48 2025.04.02 05:21:37.524437 [ 37969 ] {} RaftInstance: config at index 18 is committed, prev config log idx 48 2025.04.02 05:21:37.524473 [ 37969 ] {} RaftInstance: skipped config 18, latest config 48 2025.04.02 05:21:37.524522 [ 37969 ] {} RaftInstance: config at index 19 is committed, prev config log idx 48 2025.04.02 05:21:37.524547 [ 37969 ] {} RaftInstance: skipped config 19, latest config 48 2025.04.02 05:21:37.524600 [ 37969 ] {} RaftInstance: config at index 20 is committed, prev config log idx 48 2025.04.02 05:21:37.524628 [ 37969 ] {} RaftInstance: skipped config 20, latest config 48 2025.04.02 05:21:37.524686 [ 37969 ] {} RaftInstance: config at index 21 is committed, prev config log idx 48 2025.04.02 05:21:37.524714 [ 37969 ] {} RaftInstance: skipped config 21, latest config 48 2025.04.02 05:21:37.524767 [ 37969 ] {} RaftInstance: config at index 22 is committed, prev config log idx 48 2025.04.02 05:21:37.524797 [ 37969 ] {} RaftInstance: skipped config 22, latest config 48 2025.04.02 05:21:37.524849 [ 37969 ] {} RaftInstance: config at index 23 is committed, prev config log idx 48 2025.04.02 05:21:37.524880 [ 37969 ] {} RaftInstance: skipped config 23, latest config 48 2025.04.02 05:21:37.524962 [ 37969 ] {} RaftInstance: config at index 24 is committed, prev config log idx 48 2025.04.02 05:21:37.524995 [ 37969 ] {} RaftInstance: skipped config 24, latest config 48 2025.04.02 05:21:37.525049 [ 37969 ] {} RaftInstance: config at index 25 is committed, prev config log idx 48 2025.04.02 05:21:37.525082 [ 37969 ] {} RaftInstance: skipped config 25, latest config 48 2025.04.02 05:21:37.525135 [ 37969 ] {} RaftInstance: config at index 26 is committed, prev config log idx 48 2025.04.02 05:21:37.525162 [ 37969 ] {} RaftInstance: skipped config 26, latest config 48 2025.04.02 05:21:37.525214 [ 37969 ] {} RaftInstance: config at index 27 is committed, prev config log idx 48 2025.04.02 05:21:37.525241 [ 37969 ] {} RaftInstance: skipped config 27, latest config 48 2025.04.02 05:21:37.525297 [ 37969 ] {} RaftInstance: config at index 28 is committed, prev config log idx 48 2025.04.02 05:21:37.525351 [ 37969 ] {} RaftInstance: skipped config 28, latest config 48 2025.04.02 05:21:37.525427 [ 37969 ] {} RaftInstance: config at index 29 is committed, prev config log idx 48 2025.04.02 05:21:37.525458 [ 37969 ] {} RaftInstance: skipped config 29, latest config 48 2025.04.02 05:21:37.525510 [ 37969 ] {} RaftInstance: config at index 30 is committed, prev config log idx 48 2025.04.02 05:21:37.525541 [ 37969 ] {} RaftInstance: skipped config 30, latest config 48 2025.04.02 05:21:37.525594 [ 37969 ] {} RaftInstance: config at index 31 is committed, prev config log idx 48 2025.04.02 05:21:37.525633 [ 37969 ] {} RaftInstance: skipped config 31, latest config 48 2025.04.02 05:21:37.525691 [ 37969 ] {} RaftInstance: config at index 32 is committed, prev config log idx 48 2025.04.02 05:21:37.525719 [ 37969 ] {} RaftInstance: skipped config 32, latest config 48 2025.04.02 05:21:37.525775 [ 37969 ] {} RaftInstance: config at index 33 is committed, prev config log idx 48 2025.04.02 05:21:37.525804 [ 37969 ] {} RaftInstance: skipped config 33, latest config 48 2025.04.02 05:21:37.525863 [ 37969 ] {} RaftInstance: config at index 34 is committed, prev config log idx 48 2025.04.02 05:21:37.525892 [ 37969 ] {} RaftInstance: skipped config 34, latest config 48 2025.04.02 05:21:37.525947 [ 37969 ] {} RaftInstance: config at index 35 is committed, prev config log idx 48 2025.04.02 05:21:37.525978 [ 37969 ] {} RaftInstance: skipped config 35, latest config 48 2025.04.02 05:21:37.526031 [ 37969 ] {} RaftInstance: config at index 36 is committed, prev config log idx 48 2025.04.02 05:21:37.526067 [ 37969 ] {} RaftInstance: skipped config 36, latest config 48 2025.04.02 05:21:37.526120 [ 37969 ] {} RaftInstance: config at index 37 is committed, prev config log idx 48 2025.04.02 05:21:37.526146 [ 37969 ] {} RaftInstance: skipped config 37, latest config 48 2025.04.02 05:21:37.526204 [ 37969 ] {} RaftInstance: config at index 38 is committed, prev config log idx 48 2025.04.02 05:21:37.526233 [ 37969 ] {} RaftInstance: skipped config 38, latest config 48 2025.04.02 05:21:37.526288 [ 37969 ] {} RaftInstance: config at index 39 is committed, prev config log idx 48 2025.04.02 05:21:37.526335 [ 37969 ] {} RaftInstance: skipped config 39, latest config 48 2025.04.02 05:21:37.526411 [ 37969 ] {} RaftInstance: config at index 40 is committed, prev config log idx 48 2025.04.02 05:21:37.526444 [ 37969 ] {} RaftInstance: skipped config 40, latest config 48 2025.04.02 05:21:37.526498 [ 37969 ] {} RaftInstance: config at index 41 is committed, prev config log idx 48 2025.04.02 05:21:37.526527 [ 37969 ] {} RaftInstance: skipped config 41, latest config 48 2025.04.02 05:21:37.526594 [ 37969 ] {} RaftInstance: config at index 42 is committed, prev config log idx 48 2025.04.02 05:21:37.526625 [ 37969 ] {} RaftInstance: skipped config 42, latest config 48 2025.04.02 05:21:37.526688 [ 37969 ] {} RaftInstance: config at index 43 is committed, prev config log idx 48 2025.04.02 05:21:37.526719 [ 37969 ] {} RaftInstance: skipped config 43, latest config 48 2025.04.02 05:21:37.526771 [ 37969 ] {} RaftInstance: config at index 44 is committed, prev config log idx 48 2025.04.02 05:21:37.526798 [ 37969 ] {} RaftInstance: skipped config 44, latest config 48 2025.04.02 05:21:37.526851 [ 37969 ] {} RaftInstance: config at index 45 is committed, prev config log idx 48 2025.04.02 05:21:37.526889 [ 37969 ] {} RaftInstance: skipped config 45, latest config 48 2025.04.02 05:21:37.526942 [ 37969 ] {} RaftInstance: config at index 46 is committed, prev config log idx 48 2025.04.02 05:21:37.526971 [ 37969 ] {} RaftInstance: skipped config 46, latest config 48 2025.04.02 05:21:37.527026 [ 37969 ] {} RaftInstance: config at index 47 is committed, prev config log idx 48 2025.04.02 05:21:37.527054 [ 37969 ] {} RaftInstance: skipped config 47, latest config 48 2025.04.02 05:21:37.527112 [ 37969 ] {} RaftInstance: config at index 48 is committed, prev config log idx 48 2025.04.02 05:21:37.527139 [ 37969 ] {} RaftInstance: skipped config 48, latest config 48 2025.04.02 05:21:37.527204 [ 37969 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:21:37.527242 [ 37969 ] {} KeeperServer: Preprocessing done 2025.04.02 05:21:37.527288 [ 37969 ] {} RaftInstance: config at index 49 is committed, prev config log idx 48 2025.04.02 05:21:37.527361 [ 37969 ] {} RaftInstance: new config log idx 49, prev log idx 48, cur config log idx 48, prev log idx 47 2025.04.02 05:21:37.527460 [ 37969 ] {} RaftInstance: new configuration: log idx 49, prev log idx 48 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 49 2025.04.02 05:21:37.527605 [ 37362 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:21:37.528210 [ 37362 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:21:37.530067 [ 37362 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:21:37.530482 [ 37362 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:21:37.543588 [ 37362 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:21:37.543671 [ 37362 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:21:37.544756 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:21:37.545150 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:21:37.545739 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:21:37.546005 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:21:37.546243 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:21:37.546521 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:21:37.546772 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:21:37.547066 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:21:37.550932 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:21:37.551251 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:21:37.551557 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:21:37.551875 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:21:37.552187 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:21:37.552522 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:21:37.552811 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:21:37.553154 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:21:37.553518 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:21:37.553922 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:21:37.554255 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:21:37.554634 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:21:37.554953 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:21:37.555399 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:21:37.556120 [ 37362 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:21:37.563177 [ 37362 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:21:37.563369 [ 37362 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:21:37.569725 [ 37362 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:21:37.569810 [ 37362 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:37.572768 [ 37362 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:21:37.573904 [ 37362 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:21:37.574361 [ 37362 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:21:37.574692 [ 37975 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:21:37.581951 [ 37362 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:21:37.584679 [ 37362 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:21:37.589601 [ 37362 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:21:37.592456 [ 37362 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:21:37.597854 [ 37362 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:21:37.599892 [ 37362 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:21:37.601271 [ 37362 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:21:37.602437 [ 37362 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:21:37.602521 [ 37362 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:21:37.602582 [ 37372 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:21:37.603422 [ 37372 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:42.044043 [ 37362 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:42.044466 [ 37362 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:42.044857 [ 37362 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:42.044915 [ 37362 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:42.045114 [ 37371 ] {} CancellationChecker: Execution took 5017 ms. 2025.04.02 05:21:42.045845 [ 37362 ] {} Application: Shutting down storages. 2025.04.02 05:21:42.045896 [ 37362 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:42.047414 [ 37362 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:42.047458 [ 37362 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:42.047496 [ 37362 ] {} Context: Shutting down named sessions 2025.04.02 05:21:42.047558 [ 37362 ] {} Context: Shutting down database catalog 2025.04.02 05:21:42.047591 [ 37362 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:42.047651 [ 37362 ] {} Context: Shutting down merges executor 2025.04.02 05:21:42.048157 [ 37362 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:42.048581 [ 37362 ] {} Context: Shutting down moves executor 2025.04.02 05:21:42.048903 [ 37362 ] {} Context: Shutting down common executor 2025.04.02 05:21:42.049173 [ 37362 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:42.049201 [ 37362 ] {} Context: Shutting down caches 2025.04.02 05:21:42.049228 [ 37362 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:42.049480 [ 37362 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:42.051613 [ 37362 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:42.067940 [ 37362 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:42.068280 [ 37362 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:42.068980 [ 37362 ] {} Application: Shut down storages. 2025.04.02 05:21:42.069086 [ 37362 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:42.536625 [ 37362 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:42.536749 [ 37362 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:42.537454 [ 37362 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:43.030130 [ 37362 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:43.030235 [ 37362 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:43.030295 [ 37362 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:43.030358 [ 37362 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:43.030410 [ 37362 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:43.030462 [ 37362 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:43.030497 [ 37362 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:43.030686 [ 37362 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:43.030758 [ 37970 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:43.030988 [ 37362 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:43.031051 [ 37362 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:43.031094 [ 37362 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:43.031364 [ 37956 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:21:43.031451 [ 37953 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:21:43.031513 [ 37957 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:43.031707 [ 37954 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:43.032080 [ 37956 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:43.031961 [ 37966 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:43.031960 [ 37968 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:43.032058 [ 37967 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:43.032113 [ 37965 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:43.032082 [ 37955 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:43.032244 [ 37963 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:43.031861 [ 37959 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:43.031989 [ 37960 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:43.032137 [ 37964 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:43.032213 [ 37961 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:43.032253 [ 37958 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:43.032177 [ 37962 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:43.032869 [ 37362 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:43.032912 [ 37951 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:43.033033 [ 37952 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:21:43.033741 [ 37362 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:43.033917 [ 37362 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:43.033972 [ 37362 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:43.034048 [ 37362 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:43.034117 [ 37362 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:43.034351 [ 37362 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:43.034460 [ 37362 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:43.038738 [ 37362 ] {} Application: Destroyed global context. 2025.04.02 05:21:43.039373 [ 37362 ] {} Application: Waiting for background threads 2025.04.02 05:21:43.109439 [ 37362 ] {} Application: Background threads finished in 70 ms 2025.04.02 05:21:43.110132 [ 37362 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:43.110218 [ 37362 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:43.127239 [ 37362 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:43.127662 [ 37362 ] {} Application: shutting down 2025.04.02 05:21:43.127726 [ 37362 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:43.136633 [ 37365 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:43.136776 [ 37365 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:43.242865 [ 37360 ] {} Application: Child process exited normally with code 233. 2025.04.02 05:21:43.632863 [ 38087 ] {} Application: Will watch for the process with pid 38089 2025.04.02 05:21:43.633869 [ 38089 ] {} Application: Forked a child process to watch 2025.04.02 05:21:43.635469 [ 38089 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 05:21:44.214895 [ 38089 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 38089 2025.04.02 05:21:44.215812 [ 38089 ] {} Application: starting up 2025.04.02 05:21:44.215908 [ 38089 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 05:21:44.249615 [ 38089 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 05:21:44.249955 [ 38089 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 05:21:44.250056 [ 38089 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 05:21:44.250105 [ 38089 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 05:21:44.250140 [ 38089 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 05:21:44.251907 [ 38089 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 05:21:44.252549 [ 38089 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 05:21:44.252627 [ 38089 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 05:21:44.252861 [ 38089 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 05:21:44.252924 [ 38089 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 05:21:45.132600 [ 38089 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 05:21:45.134756 [ 38089 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 05:21:45.134833 [ 38089 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 05:21:45.134999 [ 38089 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 05:21:45.135693 [ 38089 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 05:21:45.288893 [ 38102 ] {} CancellationChecker: Started worker function 2025.04.02 05:21:45.289142 [ 38089 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 05:21:45.289226 [ 38089 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 05:21:45.289282 [ 38089 ] {} Application: Initializing DateLUT. 2025.04.02 05:21:45.289335 [ 38089 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 05:21:45.289620 [ 38089 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 05:21:45.290048 [ 38089 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 05:21:45.304333 [ 38089 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 05:21:45.304470 [ 38089 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 05:21:45.304807 [ 38089 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 05:21:45.305354 [ 38089 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 05:21:45.305450 [ 38089 ] {} Application: Initializing interserver credentials. 2025.04.02 05:21:45.306468 [ 38089 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 05:21:45.311553 [ 38089 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:45.311609 [ 38089 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 05:21:45.311692 [ 38089 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 05:21:45.312101 [ 38089 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 05:21:45.322643 [ 38089 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 05:21:45.322719 [ 38089 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 05:21:45.330172 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 05:21:45.331205 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 05:21:45.331618 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 05:21:45.332090 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 05:21:45.332504 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 05:21:45.336889 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 05:21:45.337264 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 05:21:45.337648 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 05:21:45.338003 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 05:21:45.338348 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 05:21:45.338816 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 05:21:45.339153 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 05:21:45.339501 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 05:21:45.339828 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 05:21:45.340306 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 05:21:45.340642 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 05:21:45.341004 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 05:21:45.341367 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 05:21:45.341783 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 05:21:45.342160 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 05:21:45.342593 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 05:21:45.342964 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 05:21:45.343659 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 05:21:45.344718 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 05:21:45.345059 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 05:21:45.345988 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 05:21:45.347132 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 05:21:45.347573 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 05:21:45.347924 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 05:21:45.348288 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 05:21:45.348675 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 05:21:45.349062 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 05:21:45.349552 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 05:21:45.349922 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 05:21:45.350414 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 05:21:45.350785 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 05:21:45.351245 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 05:21:45.351751 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 05:21:45.352183 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 05:21:45.353335 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 05:21:45.353918 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 05:21:45.354344 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 05:21:45.354812 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 05:21:45.355253 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 05:21:45.355698 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 05:21:45.356249 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 05:21:45.356681 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 05:21:45.357137 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 05:21:45.357616 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 05:21:45.360122 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 05:21:45.360901 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 05:21:45.361848 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 05:21:45.362487 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 05:21:45.362889 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 05:21:45.363284 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 05:21:45.364047 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 05:21:45.364524 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 05:21:45.365103 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 05:21:45.365525 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 05:21:45.366107 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 05:21:45.366781 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 05:21:45.367465 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 05:21:45.367900 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 05:21:45.368428 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 05:21:45.369108 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 05:21:45.369612 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 05:21:45.371476 [ 38089 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 05:21:45.417055 [ 38089 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 05:21:45.418818 [ 38089 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 05:21:45.453342 [ 38089 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 05:21:45.453430 [ 38089 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 05:21:45.453468 [ 38089 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 05:21:45.468375 [ 38089 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 05:21:45.468441 [ 38089 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 05:21:45.468501 [ 38089 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 05:21:45.468634 [ 38089 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:45.474352 [ 38089 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:45.479192 [ 38089 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 05:21:45.490268 [ 38089 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 05:21:45.490688 [ 38089 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 05:21:45.490816 [ 38089 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:45.492972 [ 38089 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 05:21:45.493571 [ 38089 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 05:21:45.493839 [ 38089 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 05:21:45.494855 [ 38089 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 05:21:45.494916 [ 38089 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 05:21:45.496394 [ 38089 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 05:21:45.496432 [ 38089 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 05:21:45.496456 [ 38089 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 05:21:45.496498 [ 38089 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 05:21:45.496520 [ 38089 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 05:21:45.496684 [ 38089 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:45.496741 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.564152 [ 38089 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:45.574432 [ 38089 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:45.574515 [ 38089 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:45.575541 [ 38089 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:45.575675 [ 38089 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu 2025.04.02 05:21:45.575741 [ 38089 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu 2025.04.02 05:21:45.575795 [ 38089 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu, size 4 2025.04.02 05:21:45.576208 [ 38089 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu. 2025.04.02 05:21:45.576301 [ 38670 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu 2025.04.02 05:21:45.582602 [ 38670 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu, size 4 2025.04.02 05:21:45.583138 [ 38089 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu. 2025.04.02 05:21:45.583376 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.586053 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.586132 [ 38089 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu, Version: Latest, Offset: 2 2025.04.02 05:21:45.591471 [ 38089 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu 2025.04.02 05:21:45.591525 [ 38089 ] {} deleteFileFromS3: Object with path s3/kma/bobatlcykwhfjmiyacrjcflvsvxxu was removed from S3 2025.04.02 05:21:45.591583 [ 38089 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 05:21:45.591641 [ 38089 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 05:21:45.594832 [ 38089 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:45.604446 [ 38089 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:45.604506 [ 38089 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:45.605007 [ 38089 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:45.612339 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.616606 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.616679 [ 38089 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 05:21:45.621988 [ 38089 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 05:21:45.622167 [ 38089 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 03:21:45 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326250F6B20F53 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 05:21:45.622312 [ 38089 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 05:21:45.626216 [ 38089 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:45.626269 [ 38089 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 05:21:45.626336 [ 38089 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 05:21:45.626378 [ 38089 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 05:21:45.626516 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.626575 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.626639 [ 38089 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:45.626705 [ 38089 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:45.626766 [ 38089 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 05:21:45.626824 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.626873 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.626925 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.626976 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.627031 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.629879 [ 38089 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:45.639041 [ 38089 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:45.639091 [ 38089 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:45.639730 [ 38089 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:45.647179 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ctb/jlmugstvqrjbrgxchhfozyfcjnegc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.649441 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ctb/jlmugstvqrjbrgxchhfozyfcjnegc (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.649504 [ 38089 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ctb/jlmugstvqrjbrgxchhfozyfcjnegc, Version: Latest, Offset: 2 2025.04.02 05:21:45.653926 [ 38089 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ctb/jlmugstvqrjbrgxchhfozyfcjnegc 2025.04.02 05:21:45.653978 [ 38089 ] {} deleteFileFromS3: Object with path special/ctb/jlmugstvqrjbrgxchhfozyfcjnegc was removed from S3 2025.04.02 05:21:45.654024 [ 38089 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 05:21:45.654059 [ 38089 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 05:21:45.657082 [ 38089 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 05:21:45.666358 [ 38089 ] {} S3Client: Provider type: Unknown 2025.04.02 05:21:45.666435 [ 38089 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 05:21:45.667123 [ 38089 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 05:21:45.672893 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/psf/kfcftzgqrcazznnsrnuqpmurgkcja (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.675232 [ 38089 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/psf/kfcftzgqrcazznnsrnuqpmurgkcja (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 05:21:45.675295 [ 38089 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/psf/kfcftzgqrcazznnsrnuqpmurgkcja, Version: Latest, Offset: 2 2025.04.02 05:21:45.679679 [ 38089 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/psf/kfcftzgqrcazznnsrnuqpmurgkcja 2025.04.02 05:21:45.679723 [ 38089 ] {} deleteFileFromS3: Object with path test_02944/psf/kfcftzgqrcazznnsrnuqpmurgkcja was removed from S3 2025.04.02 05:21:45.679763 [ 38089 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 05:21:45.679806 [ 38089 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 05:21:45.679937 [ 38089 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 05:21:45.682635 [ 38089 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 05:21:45.686408 [ 38089 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 05:21:45.686549 [ 38089 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 05:21:45.687972 [ 38089 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 05:21:45.688137 [ 38089 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 05:21:45.689089 [ 38089 ] {} KeeperLogStore: force_sync disabled 2025.04.02 05:21:45.689137 [ 38089 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 05:21:45.689178 [ 38089 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 05:21:45.689213 [ 38089 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 05:21:45.689246 [ 38089 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 05:21:45.689862 [ 38089 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 49 entries 2025.04.02 05:21:45.689928 [ 38089 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 05:21:45.690015 [ 38089 ] {} KeeperServer: Last local log idx 49 2025.04.02 05:21:45.690061 [ 38089 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 49 2025.04.02 05:21:45.691170 [ 38089 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 05:21:45.701235 [ 38089 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 05:21:45.701546 [ 38089 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 05:21:45.701633 [ 38089 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 05:21:45.701686 [ 38089 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 05:21:45.701755 [ 38089 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 05:21:45.701794 [ 38089 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 05:21:45.701867 [ 38089 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 49 election timer allowed log store start 1, end 49 config log idx 49, prev log idx 48 -- ASYNC REPLICATION -- 2025.04.02 05:21:45.701908 [ 38089 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 05:21:45.701976 [ 38089 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 05:21:45.702027 [ 38089 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 05:21:45.702643 [ 38089 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 05:21:45.702754 [ 38698 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 05:21:45.753094 [ 38681 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 05:21:45.753374 [ 38681 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 05:21:45.753503 [ 38681 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 49, state term 49, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 05:21:45.753539 [ 38089 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 05:21:45.753577 [ 38681 ] {} RaftInstance: pre-vote term (0) is different, reset it to 49 2025.04.02 05:21:45.753937 [ 38681 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 05:21:45.756991 [ 38681 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 50, log idx 49, log term 49, priority (target 1 / mine 1) 2025.04.02 05:21:45.757076 [ 38681 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 05:21:45.757139 [ 38681 ] {} RaftInstance: state machine commit index 0, precommit index 49, last log index 49 2025.04.02 05:21:45.757197 [ 38681 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 05:21:45.757465 [ 38679 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 05:21:45.757618 [ 38681 ] {} RaftInstance: [BECOME LEADER] appended new config at 50 2025.04.02 05:21:45.757865 [ 38697 ] {} RaftInstance: config at index 1 is committed, prev config log idx 49 2025.04.02 05:21:45.757938 [ 38697 ] {} RaftInstance: skipped config 1, latest config 49 2025.04.02 05:21:45.758043 [ 38697 ] {} RaftInstance: config at index 2 is committed, prev config log idx 49 2025.04.02 05:21:45.758086 [ 38697 ] {} RaftInstance: skipped config 2, latest config 49 2025.04.02 05:21:45.758165 [ 38697 ] {} RaftInstance: config at index 3 is committed, prev config log idx 49 2025.04.02 05:21:45.758210 [ 38697 ] {} RaftInstance: skipped config 3, latest config 49 2025.04.02 05:21:45.758285 [ 38697 ] {} RaftInstance: config at index 4 is committed, prev config log idx 49 2025.04.02 05:21:45.758338 [ 38697 ] {} RaftInstance: skipped config 4, latest config 49 2025.04.02 05:21:45.758430 [ 38697 ] {} RaftInstance: config at index 5 is committed, prev config log idx 49 2025.04.02 05:21:45.758468 [ 38697 ] {} RaftInstance: skipped config 5, latest config 49 2025.04.02 05:21:45.758557 [ 38697 ] {} RaftInstance: config at index 6 is committed, prev config log idx 49 2025.04.02 05:21:45.758596 [ 38697 ] {} RaftInstance: skipped config 6, latest config 49 2025.04.02 05:21:45.758665 [ 38697 ] {} RaftInstance: config at index 7 is committed, prev config log idx 49 2025.04.02 05:21:45.758701 [ 38697 ] {} RaftInstance: skipped config 7, latest config 49 2025.04.02 05:21:45.758770 [ 38697 ] {} RaftInstance: config at index 8 is committed, prev config log idx 49 2025.04.02 05:21:45.758821 [ 38697 ] {} RaftInstance: skipped config 8, latest config 49 2025.04.02 05:21:45.758922 [ 38697 ] {} RaftInstance: config at index 9 is committed, prev config log idx 49 2025.04.02 05:21:45.758958 [ 38697 ] {} RaftInstance: skipped config 9, latest config 49 2025.04.02 05:21:45.759025 [ 38697 ] {} RaftInstance: config at index 10 is committed, prev config log idx 49 2025.04.02 05:21:45.759060 [ 38697 ] {} RaftInstance: skipped config 10, latest config 49 2025.04.02 05:21:45.759127 [ 38697 ] {} RaftInstance: config at index 11 is committed, prev config log idx 49 2025.04.02 05:21:45.759157 [ 38697 ] {} RaftInstance: skipped config 11, latest config 49 2025.04.02 05:21:45.759211 [ 38697 ] {} RaftInstance: config at index 12 is committed, prev config log idx 49 2025.04.02 05:21:45.759238 [ 38697 ] {} RaftInstance: skipped config 12, latest config 49 2025.04.02 05:21:45.759293 [ 38697 ] {} RaftInstance: config at index 13 is committed, prev config log idx 49 2025.04.02 05:21:45.759342 [ 38697 ] {} RaftInstance: skipped config 13, latest config 49 2025.04.02 05:21:45.759407 [ 38697 ] {} RaftInstance: config at index 14 is committed, prev config log idx 49 2025.04.02 05:21:45.759437 [ 38697 ] {} RaftInstance: skipped config 14, latest config 49 2025.04.02 05:21:45.759498 [ 38697 ] {} RaftInstance: config at index 15 is committed, prev config log idx 49 2025.04.02 05:21:45.759525 [ 38697 ] {} RaftInstance: skipped config 15, latest config 49 2025.04.02 05:21:45.759588 [ 38697 ] {} RaftInstance: config at index 16 is committed, prev config log idx 49 2025.04.02 05:21:45.759618 [ 38697 ] {} RaftInstance: skipped config 16, latest config 49 2025.04.02 05:21:45.759671 [ 38697 ] {} RaftInstance: config at index 17 is committed, prev config log idx 49 2025.04.02 05:21:45.759701 [ 38697 ] {} RaftInstance: skipped config 17, latest config 49 2025.04.02 05:21:45.759753 [ 38697 ] {} RaftInstance: config at index 18 is committed, prev config log idx 49 2025.04.02 05:21:45.759786 [ 38697 ] {} RaftInstance: skipped config 18, latest config 49 2025.04.02 05:21:45.759839 [ 38697 ] {} RaftInstance: config at index 19 is committed, prev config log idx 49 2025.04.02 05:21:45.759868 [ 38697 ] {} RaftInstance: skipped config 19, latest config 49 2025.04.02 05:21:45.759920 [ 38697 ] {} RaftInstance: config at index 20 is committed, prev config log idx 49 2025.04.02 05:21:45.759948 [ 38697 ] {} RaftInstance: skipped config 20, latest config 49 2025.04.02 05:21:45.760008 [ 38697 ] {} RaftInstance: config at index 21 is committed, prev config log idx 49 2025.04.02 05:21:45.760036 [ 38697 ] {} RaftInstance: skipped config 21, latest config 49 2025.04.02 05:21:45.760093 [ 38697 ] {} RaftInstance: config at index 22 is committed, prev config log idx 49 2025.04.02 05:21:45.760122 [ 38697 ] {} RaftInstance: skipped config 22, latest config 49 2025.04.02 05:21:45.760175 [ 38697 ] {} RaftInstance: config at index 23 is committed, prev config log idx 49 2025.04.02 05:21:45.760206 [ 38697 ] {} RaftInstance: skipped config 23, latest config 49 2025.04.02 05:21:45.760266 [ 38697 ] {} RaftInstance: config at index 24 is committed, prev config log idx 49 2025.04.02 05:21:45.760295 [ 38697 ] {} RaftInstance: skipped config 24, latest config 49 2025.04.02 05:21:45.760362 [ 38697 ] {} RaftInstance: config at index 25 is committed, prev config log idx 49 2025.04.02 05:21:45.760397 [ 38697 ] {} RaftInstance: skipped config 25, latest config 49 2025.04.02 05:21:45.760465 [ 38697 ] {} RaftInstance: config at index 26 is committed, prev config log idx 49 2025.04.02 05:21:45.760495 [ 38697 ] {} RaftInstance: skipped config 26, latest config 49 2025.04.02 05:21:45.760552 [ 38697 ] {} RaftInstance: config at index 27 is committed, prev config log idx 49 2025.04.02 05:21:45.760581 [ 38697 ] {} RaftInstance: skipped config 27, latest config 49 2025.04.02 05:21:45.760636 [ 38697 ] {} RaftInstance: config at index 28 is committed, prev config log idx 49 2025.04.02 05:21:45.760667 [ 38697 ] {} RaftInstance: skipped config 28, latest config 49 2025.04.02 05:21:45.760728 [ 38697 ] {} RaftInstance: config at index 29 is committed, prev config log idx 49 2025.04.02 05:21:45.760758 [ 38697 ] {} RaftInstance: skipped config 29, latest config 49 2025.04.02 05:21:45.760812 [ 38697 ] {} RaftInstance: config at index 30 is committed, prev config log idx 49 2025.04.02 05:21:45.760844 [ 38697 ] {} RaftInstance: skipped config 30, latest config 49 2025.04.02 05:21:45.760912 [ 38697 ] {} RaftInstance: config at index 31 is committed, prev config log idx 49 2025.04.02 05:21:45.760950 [ 38697 ] {} RaftInstance: skipped config 31, latest config 49 2025.04.02 05:21:45.761014 [ 38697 ] {} RaftInstance: config at index 32 is committed, prev config log idx 49 2025.04.02 05:21:45.761064 [ 38697 ] {} RaftInstance: skipped config 32, latest config 49 2025.04.02 05:21:45.761127 [ 38697 ] {} RaftInstance: config at index 33 is committed, prev config log idx 49 2025.04.02 05:21:45.761156 [ 38697 ] {} RaftInstance: skipped config 33, latest config 49 2025.04.02 05:21:45.761207 [ 38697 ] {} RaftInstance: config at index 34 is committed, prev config log idx 49 2025.04.02 05:21:45.761235 [ 38697 ] {} RaftInstance: skipped config 34, latest config 49 2025.04.02 05:21:45.761290 [ 38697 ] {} RaftInstance: config at index 35 is committed, prev config log idx 49 2025.04.02 05:21:45.761344 [ 38697 ] {} RaftInstance: skipped config 35, latest config 49 2025.04.02 05:21:45.761399 [ 38697 ] {} RaftInstance: config at index 36 is committed, prev config log idx 49 2025.04.02 05:21:45.761431 [ 38697 ] {} RaftInstance: skipped config 36, latest config 49 2025.04.02 05:21:45.761485 [ 38697 ] {} RaftInstance: config at index 37 is committed, prev config log idx 49 2025.04.02 05:21:45.761512 [ 38697 ] {} RaftInstance: skipped config 37, latest config 49 2025.04.02 05:21:45.761570 [ 38697 ] {} RaftInstance: config at index 38 is committed, prev config log idx 49 2025.04.02 05:21:45.761599 [ 38697 ] {} RaftInstance: skipped config 38, latest config 49 2025.04.02 05:21:45.761655 [ 38697 ] {} RaftInstance: config at index 39 is committed, prev config log idx 49 2025.04.02 05:21:45.761684 [ 38697 ] {} RaftInstance: skipped config 39, latest config 49 2025.04.02 05:21:45.761739 [ 38697 ] {} RaftInstance: config at index 40 is committed, prev config log idx 49 2025.04.02 05:21:45.761769 [ 38697 ] {} RaftInstance: skipped config 40, latest config 49 2025.04.02 05:21:45.761822 [ 38697 ] {} RaftInstance: config at index 41 is committed, prev config log idx 49 2025.04.02 05:21:45.761858 [ 38697 ] {} RaftInstance: skipped config 41, latest config 49 2025.04.02 05:21:45.761912 [ 38697 ] {} RaftInstance: config at index 42 is committed, prev config log idx 49 2025.04.02 05:21:45.761940 [ 38697 ] {} RaftInstance: skipped config 42, latest config 49 2025.04.02 05:21:45.762001 [ 38697 ] {} RaftInstance: config at index 43 is committed, prev config log idx 49 2025.04.02 05:21:45.762033 [ 38697 ] {} RaftInstance: skipped config 43, latest config 49 2025.04.02 05:21:45.762084 [ 38697 ] {} RaftInstance: config at index 44 is committed, prev config log idx 49 2025.04.02 05:21:45.762112 [ 38697 ] {} RaftInstance: skipped config 44, latest config 49 2025.04.02 05:21:45.762166 [ 38697 ] {} RaftInstance: config at index 45 is committed, prev config log idx 49 2025.04.02 05:21:45.762197 [ 38697 ] {} RaftInstance: skipped config 45, latest config 49 2025.04.02 05:21:45.762250 [ 38697 ] {} RaftInstance: config at index 46 is committed, prev config log idx 49 2025.04.02 05:21:45.762280 [ 38697 ] {} RaftInstance: skipped config 46, latest config 49 2025.04.02 05:21:45.762360 [ 38697 ] {} RaftInstance: config at index 47 is committed, prev config log idx 49 2025.04.02 05:21:45.762426 [ 38697 ] {} RaftInstance: skipped config 47, latest config 49 2025.04.02 05:21:45.762492 [ 38697 ] {} RaftInstance: config at index 48 is committed, prev config log idx 49 2025.04.02 05:21:45.762519 [ 38697 ] {} RaftInstance: skipped config 48, latest config 49 2025.04.02 05:21:45.762571 [ 38697 ] {} RaftInstance: config at index 49 is committed, prev config log idx 49 2025.04.02 05:21:45.762609 [ 38697 ] {} RaftInstance: skipped config 49, latest config 49 2025.04.02 05:21:45.762674 [ 38697 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 05:21:45.762715 [ 38697 ] {} KeeperServer: Preprocessing done 2025.04.02 05:21:45.762761 [ 38697 ] {} RaftInstance: config at index 50 is committed, prev config log idx 49 2025.04.02 05:21:45.762817 [ 38697 ] {} RaftInstance: new config log idx 50, prev log idx 49, cur config log idx 49, prev log idx 48 2025.04.02 05:21:45.762907 [ 38697 ] {} RaftInstance: new configuration: log idx 50, prev log idx 49 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 50 2025.04.02 05:21:45.763029 [ 38089 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 05:21:45.763755 [ 38089 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 05:21:45.765489 [ 38089 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 05:21:45.765881 [ 38089 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 05:21:45.778254 [ 38089 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 05:21:45.778350 [ 38089 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 05:21:45.779466 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 05:21:45.779839 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 05:21:45.780378 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 05:21:45.780647 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 05:21:45.780921 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 05:21:45.781195 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 05:21:45.781449 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 05:21:45.781792 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 05:21:45.785468 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 05:21:45.785786 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 05:21:45.786070 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 05:21:45.786439 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 05:21:45.786753 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 05:21:45.787050 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 05:21:45.787378 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 05:21:45.787743 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 05:21:45.788086 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 05:21:45.788535 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 05:21:45.788852 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 05:21:45.789222 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 05:21:45.789551 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 05:21:45.789964 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 05:21:45.790737 [ 38089 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 05:21:45.797703 [ 38089 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 05:21:45.797909 [ 38089 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 05:21:45.804398 [ 38089 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 05:21:45.804477 [ 38089 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 05:21:45.807371 [ 38089 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 05:21:45.808511 [ 38089 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 05:21:45.809046 [ 38089 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 05:21:45.809408 [ 38705 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 05:21:45.816761 [ 38089 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 05:21:45.819678 [ 38089 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 05:21:45.824964 [ 38089 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 05:21:45.827532 [ 38089 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 05:21:45.833126 [ 38089 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 05:21:45.834888 [ 38089 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 05:21:45.836230 [ 38089 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 05:21:45.837377 [ 38089 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 05:21:45.837463 [ 38089 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 05:21:45.837531 [ 38103 ] {} DNSResolver: Updating DNS cache 2025.04.02 05:21:45.838205 [ 38103 ] {} DNSResolver: Updated DNS cache 2025.04.02 05:21:50.187384 [ 38089 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:50.188103 [ 38089 ] {} Application: Stopping AsyncLoader. 2025.04.02 05:21:50.188613 [ 38089 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 05:21:50.188699 [ 38089 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 05:21:50.188893 [ 38102 ] {} CancellationChecker: Execution took 4900 ms. 2025.04.02 05:21:50.189314 [ 38089 ] {} Application: Shutting down storages. 2025.04.02 05:21:50.189423 [ 38089 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 05:21:50.191121 [ 38089 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 05:21:50.191246 [ 38089 ] {} Context: Shutting down workload entity storage 2025.04.02 05:21:50.191292 [ 38089 ] {} Context: Shutting down named sessions 2025.04.02 05:21:50.191398 [ 38089 ] {} Context: Shutting down database catalog 2025.04.02 05:21:50.191454 [ 38089 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 05:21:50.191551 [ 38089 ] {} Context: Shutting down merges executor 2025.04.02 05:21:50.192191 [ 38089 ] {} Context: Shutting down fetches executor 2025.04.02 05:21:50.192616 [ 38089 ] {} Context: Shutting down moves executor 2025.04.02 05:21:50.192832 [ 38089 ] {} Context: Shutting down common executor 2025.04.02 05:21:50.193092 [ 38089 ] {} Context: Shutting down DDLWorker 2025.04.02 05:21:50.193138 [ 38089 ] {} Context: Shutting down caches 2025.04.02 05:21:50.193179 [ 38089 ] {} Context: Shutting down AccessControl 2025.04.02 05:21:50.193482 [ 38089 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 05:21:50.196086 [ 38089 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 05:21:50.209174 [ 38089 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 05:21:50.209529 [ 38089 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 05:21:50.210032 [ 38089 ] {} Application: Shut down storages. 2025.04.02 05:21:50.210087 [ 38089 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 05:21:50.522001 [ 38089 ] {} Application: Closed all listening sockets. 2025.04.02 05:21:50.522147 [ 38089 ] {} Application: Closed connections to servers for tables. 2025.04.02 05:21:50.522215 [ 38089 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 05:21:50.766110 [ 38089 ] {} RaftInstance: shutting down raft core 2025.04.02 05:21:50.766291 [ 38089 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 05:21:50.767121 [ 38089 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 05:21:50.767252 [ 38089 ] {} RaftInstance: commit thread stopped. 2025.04.02 05:21:50.767395 [ 38089 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 05:21:50.767467 [ 38089 ] {} RaftInstance: reset all pointers. 2025.04.02 05:21:50.767534 [ 38089 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 05:21:50.767678 [ 38089 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 05:21:50.767687 [ 38698 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 05:21:50.767888 [ 38089 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 05:21:50.767973 [ 38089 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 05:21:50.768040 [ 38089 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 05:21:50.768465 [ 38684 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 05:21:50.768722 [ 38681 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 05:21:50.768816 [ 38682 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 05:21:50.768975 [ 38684 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 05:21:50.768852 [ 38686 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 05:21:50.769085 [ 38687 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 05:21:50.769375 [ 38693 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 05:21:50.769409 [ 38688 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 05:21:50.769421 [ 38694 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 05:21:50.769467 [ 38692 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 05:21:50.769673 [ 38685 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 05:21:50.769607 [ 38690 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 05:21:50.769561 [ 38696 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 05:21:50.769640 [ 38695 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 05:21:50.769493 [ 38683 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 05:21:50.769467 [ 38691 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 05:21:50.769562 [ 38689 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 05:21:50.770484 [ 38089 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:50.770501 [ 38679 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 05:21:50.770671 [ 38680 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 05:21:50.771315 [ 38089 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 05:21:50.771523 [ 38089 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 05:21:50.771613 [ 38089 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 05:21:50.771699 [ 38089 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 05:21:50.771769 [ 38089 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:50.771944 [ 38089 ] {} Context: Destructing local fs threadpool reader 2025.04.02 05:21:50.772060 [ 38089 ] {} Context: Destructing threadpool writer 2025.04.02 05:21:50.776015 [ 38089 ] {} Application: Destroyed global context. 2025.04.02 05:21:50.776858 [ 38089 ] {} Application: Waiting for background threads 2025.04.02 05:21:50.856252 [ 38089 ] {} Application: Background threads finished in 79 ms 2025.04.02 05:21:50.857077 [ 38089 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 05:21:50.857170 [ 38089 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 05:21:50.881330 [ 38089 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 05:21:50.881827 [ 38089 ] {} Application: shutting down 2025.04.02 05:21:50.881900 [ 38089 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 05:21:50.892767 [ 38092 ] {} BaseDaemon: Received signal -2 2025.04.02 05:21:50.893012 [ 38092 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 05:21:51.035581 [ 38087 ] {} Application: Child process exited normally with code 233.