2025.04.02 03:27:07.649701 [ 7287 ] {} Application: Will watch for the process with pid 7288 2025.04.02 03:27:07.649863 [ 7288 ] {} Application: Forked a child process to watch 2025.04.02 03:27:07.650530 [ 7288 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:27:07.741786 [ 7288 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 7288 2025.04.02 03:27:07.742144 [ 7288 ] {} Application: starting up 2025.04.02 03:27:07.742162 [ 7288 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:27:07.751269 [ 7288 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:27:07.752916 [ 7288 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:27:07.754637 [ 7288 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:27:07.755608 [ 7288 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:27:07.756811 [ 7288 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:27:07.761692 [ 7288 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:27:07.766961 [ 7288 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:27:07.768194 [ 7288 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:27:07.768719 [ 7288 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:27:07.769537 [ 7288 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:27:07.770218 [ 7288 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:27:09.108813 [ 7288 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:27:09.111220 [ 7288 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:27:09.172416 [ 7288 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:27:09.189473 [ 7288 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:27:09.206215 [ 7288 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:27:09.826201 [ 7288 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:27:09.826842 [ 7288 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:27:09.912330 [ 7297 ] {} CancellationChecker: Started worker function 2025.04.02 03:27:09.912997 [ 7288 ] {} Application: Initializing DateLUT. 2025.04.02 03:27:09.976769 [ 7288 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:27:09.978787 [ 7288 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:27:09.982514 [ 7288 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:27:09.987373 [ 7288 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:27:09.988155 [ 7288 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:27:09.990368 [ 7288 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:27:09.993021 [ 7288 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:27:09.994297 [ 7288 ] {} Application: Initializing interserver credentials. 2025.04.02 03:27:10.002569 [ 7288 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:27:10.404198 [ 7288 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:27:10.406550 [ 7288 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:27:10.438898 [ 7288 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:27:10.439606 [ 7288 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:27:10.444072 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:27:10.445781 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:27:10.447203 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:27:10.448669 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:27:10.450072 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:27:10.452622 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:27:10.454170 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:27:10.455824 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:27:10.457239 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:27:10.458593 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:27:10.460052 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:27:10.461369 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:27:10.462485 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:27:10.463786 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:27:10.465352 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:27:10.466525 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:27:10.467778 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:27:10.469094 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:27:10.470535 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:27:10.471873 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:27:10.473029 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:27:10.474221 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:27:10.475610 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:27:10.484137 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:27:10.485546 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:27:10.486628 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:27:10.488585 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:27:10.489990 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:27:10.491480 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:27:10.492840 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:27:10.494370 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:27:10.495843 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:27:10.497244 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:27:10.498615 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:27:10.500098 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:27:10.501856 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:27:10.503481 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:27:10.505023 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:27:10.506442 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:27:10.507998 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:27:10.509508 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:27:10.510721 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:27:10.512157 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:27:10.601384 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:27:10.603425 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:27:10.604963 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:27:10.614987 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:27:10.616576 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:27:10.628487 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:27:10.630309 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:27:10.632062 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:27:10.633596 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:27:10.635151 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:27:10.636510 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:27:10.638026 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:27:10.639523 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:27:10.640593 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:27:10.642116 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:27:10.643716 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:27:10.645290 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:27:10.647009 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:27:10.648485 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:27:10.649921 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:27:10.651589 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:27:10.652844 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:27:10.655008 [ 7288 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:27:10.679055 [ 7288 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:27:10.684784 [ 7288 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:27:12.818938 [ 7288 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:27:12.837240 [ 7288 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:27:12.841541 [ 7288 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:27:13.781988 [ 7288 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:27:13.782835 [ 7288 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:27:13.784388 [ 7288 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:27:13.786597 [ 7288 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:13.792580 [ 7288 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:13.798604 [ 7288 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:13.979693 [ 7288 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:27:13.980820 [ 7288 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:13.988576 [ 7288 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:27:13.993111 [ 7288 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:13.995139 [ 7288 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:13.997331 [ 7288 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:27:13.998502 [ 7288 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:27:14.008120 [ 7288 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:27:14.008753 [ 7288 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:27:14.058899 [ 7288 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:27:14.059649 [ 7288 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:27:14.060439 [ 7288 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:27:14.061802 [ 7288 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:14.062991 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.121432 [ 7288 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:14.124724 [ 7288 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:14.125446 [ 7288 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:14.158238 [ 7288 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/lwn/jhamwshgrndpsjrxuqwifvurfgrxe 2025.04.02 03:27:14.159738 [ 7288 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/lwn/jhamwshgrndpsjrxuqwifvurfgrxe. 2025.04.02 03:27:14.175767 [ 7887 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/lwn/jhamwshgrndpsjrxuqwifvurfgrxe, size 4 2025.04.02 03:27:14.177094 [ 7288 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/lwn/jhamwshgrndpsjrxuqwifvurfgrxe. 2025.04.02 03:27:14.202134 [ 7288 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/lwn/jhamwshgrndpsjrxuqwifvurfgrxe 2025.04.02 03:27:14.202687 [ 7288 ] {} deleteFileFromS3: Object with path s3/lwn/jhamwshgrndpsjrxuqwifvurfgrxe was removed from S3 2025.04.02 03:27:14.203304 [ 7288 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:27:14.204112 [ 7288 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:27:14.223083 [ 7288 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:14.226057 [ 7288 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:14.226692 [ 7288 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:14.273444 [ 7288 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:27:14.274329 [ 7288 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:27:14 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C111A5FD67B x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:27:14.290389 [ 7288 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:27:14.390080 [ 7288 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:27:14.390857 [ 7288 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:27:14.391486 [ 7288 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:27:14.392419 [ 7288 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:27:14.394272 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.399875 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.401130 [ 7288 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:14.413968 [ 7288 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:14.422223 [ 7288 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:27:14.438100 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.440778 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.442012 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.454089 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.469530 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.651645 [ 7288 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:14.656461 [ 7288 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:14.657273 [ 7288 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:14.719999 [ 7288 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ris/iymnvdqpoehzhbkpbblvlkzgsxcdx 2025.04.02 03:27:14.720524 [ 7288 ] {} deleteFileFromS3: Object with path special/ris/iymnvdqpoehzhbkpbblvlkzgsxcdx was removed from S3 2025.04.02 03:27:14.721101 [ 7288 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:27:14.722024 [ 7288 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:27:14.742125 [ 7288 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:14.744837 [ 7288 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:14.745543 [ 7288 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:14.800314 [ 7288 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/xic/goggycrqqpyrjunmgjpntrqyqmmww 2025.04.02 03:27:14.800997 [ 7288 ] {} deleteFileFromS3: Object with path test_02944/xic/goggycrqqpyrjunmgjpntrqyqmmww was removed from S3 2025.04.02 03:27:14.801723 [ 7288 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:27:14.802537 [ 7288 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:27:14.803698 [ 7288 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:14.855188 [ 7288 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:14.874309 [ 7288 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:27:14.875023 [ 7288 ] {} KeeperSnapshotManager: Found snapshot_8.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:14.875493 [ 7288 ] {} KeeperSnapshotManager: Found snapshot_9.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:14.876149 [ 7288 ] {} KeeperSnapshotManager: Found snapshot_7.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:14.885840 [ 7288 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:27:14.886603 [ 7288 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:27:14.888058 [ 7288 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:27:14.888718 [ 7288 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:27:14.889286 [ 7288 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:27:14.889825 [ 7288 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 9 2025.04.02 03:27:14.896597 [ 7288 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:27:14.897833 [ 7288 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 9 2025.04.02 03:27:14.900487 [ 7288 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 9 entries 2025.04.02 03:27:14.901311 [ 7288 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:27:14.902415 [ 7288 ] {} KeeperServer: Last local log idx 9 2025.04.02 03:27:14.903524 [ 7288 ] {} KeeperServer: Will use config from log store with log index 9 2025.04.02 03:27:14.912035 [ 7288 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:27:14.952304 [ 7288 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:27:14.955659 [ 7288 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:27:14.957874 [ 7288 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:27:14.958618 [ 7288 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:27:14.959500 [ 7288 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:27:14.960810 [ 7288 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:27:14.962306 [ 7288 ] {} RaftInstance: === INIT RAFT SERVER === commit index 9 term 9 election timer allowed log store start 1, end 9 config log idx 9, prev log idx 8 -- ASYNC REPLICATION -- 2025.04.02 03:27:14.963182 [ 7288 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:27:14.964607 [ 7288 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:27:14.965883 [ 7288 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:27:14.966187 [ 7918 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:27:15.018359 [ 7903 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:27:15.019399 [ 7903 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:27:15.019550 [ 7288 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:27:15.020761 [ 7903 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 9, state term 9, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:27:15.021450 [ 7903 ] {} RaftInstance: pre-vote term (0) is different, reset it to 9 2025.04.02 03:27:15.022612 [ 7903 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:27:15.027384 [ 7903 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 10, log idx 9, log term 9, priority (target 1 / mine 1) 2025.04.02 03:27:15.028592 [ 7903 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:27:15.030512 [ 7903 ] {} RaftInstance: state machine commit index 9, precommit index 9, last log index 9 2025.04.02 03:27:15.034062 [ 7903 ] {} RaftInstance: [BECOME LEADER] appended new config at 10 2025.04.02 03:27:15.038118 [ 7917 ] {} RaftInstance: config at index 10 is committed, prev config log idx 9 2025.04.02 03:27:15.038993 [ 7917 ] {} RaftInstance: new config log idx 10, prev log idx 9, cur config log idx 9, prev log idx 8 2025.04.02 03:27:15.041094 [ 7917 ] {} RaftInstance: new configuration: log idx 10, prev log idx 9 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 10 2025.04.02 03:27:15.043984 [ 7288 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:27:15.045162 [ 7288 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:27:15.052553 [ 7288 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:27:15.053411 [ 7288 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:27:15.063974 [ 7288 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:27:15.064569 [ 7288 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:27:15.066373 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:27:15.067621 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:27:15.068461 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:27:15.069589 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:27:15.070629 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:27:15.071627 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:27:15.072466 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:27:15.078741 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:27:15.080710 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:27:15.081943 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:27:15.083217 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:27:15.084459 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:27:15.085687 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:27:15.086963 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:27:15.095967 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:27:15.097515 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:27:15.098760 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:27:15.099978 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:27:15.101251 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:27:15.102537 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:27:15.103682 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:27:15.105009 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:27:15.106487 [ 7288 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:27:15.112947 [ 7288 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:27:15.113621 [ 7288 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:27:15.866415 [ 7288 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:27:15.874166 [ 7288 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:15.876247 [ 7288 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:27:15.879254 [ 7288 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:27:15.886157 [ 7288 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:27:15.886676 [ 7927 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:27:15.978623 [ 7288 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:27:15.984200 [ 7288 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:27:16.077721 [ 7288 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:27:16.155896 [ 7288 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:27:16.189341 [ 7288 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:27:16.212583 [ 7288 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:27:16.266993 [ 7288 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:27:16.279815 [ 7298 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:27:16.279987 [ 7288 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:27:16.300887 [ 7298 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:27:21.040013 [ 7288 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:27:21.041225 [ 7288 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:27:21.072896 [ 7288 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:27:21.073603 [ 7288 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:27:21.074708 [ 7297 ] {} CancellationChecker: Execution took 11250 ms. 2025.04.02 03:27:21.082806 [ 7288 ] {} Application: Shutting down storages. 2025.04.02 03:27:21.085962 [ 7288 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:27:21.129038 [ 7288 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:27:21.143139 [ 7288 ] {} Context: Shutting down workload entity storage 2025.04.02 03:27:21.146609 [ 7288 ] {} Context: Shutting down named sessions 2025.04.02 03:27:21.162383 [ 7288 ] {} Context: Shutting down database catalog 2025.04.02 03:27:21.181452 [ 7288 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:27:21.197456 [ 7288 ] {} Context: Shutting down merges executor 2025.04.02 03:27:21.200326 [ 7288 ] {} Context: Shutting down fetches executor 2025.04.02 03:27:21.217624 [ 7288 ] {} Context: Shutting down moves executor 2025.04.02 03:27:21.254913 [ 7288 ] {} Context: Shutting down common executor 2025.04.02 03:27:21.285587 [ 7288 ] {} Context: Shutting down DDLWorker 2025.04.02 03:27:21.301845 [ 7288 ] {} Context: Shutting down caches 2025.04.02 03:27:21.305814 [ 7288 ] {} Context: Shutting down AccessControl 2025.04.02 03:27:21.314926 [ 7288 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:27:21.321473 [ 7288 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:27:21.473227 [ 7288 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:27:21.478325 [ 7288 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:27:21.491702 [ 7288 ] {} Application: Shut down storages. 2025.04.02 03:27:21.492296 [ 7288 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:27:21.812679 [ 7288 ] {} Application: Closed all listening sockets. 2025.04.02 03:27:21.813336 [ 7288 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:27:21.814530 [ 7288 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:27:22.062628 [ 7288 ] {} RaftInstance: shutting down raft core 2025.04.02 03:27:22.064614 [ 7288 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:27:22.077459 [ 7288 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:27:22.078179 [ 7288 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:27:22.096393 [ 7288 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:27:22.097468 [ 7288 ] {} RaftInstance: reset all pointers. 2025.04.02 03:27:22.098297 [ 7288 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:27:22.099160 [ 7918 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:27:22.099335 [ 7288 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:27:22.100130 [ 7288 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:27:22.100831 [ 7288 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:27:22.101560 [ 7288 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:27:22.102097 [ 7288 ] {} RaftInstance: manually create a snapshot on 10 2025.04.02 03:27:22.103630 [ 7288 ] {} RaftInstance: creating a snapshot for index 10 2025.04.02 03:27:22.104329 [ 7288 ] {} RaftInstance: create snapshot idx 10 log_term 10 2025.04.02 03:27:22.105124 [ 7288 ] {} KeeperStateMachine: Creating snapshot 10 2025.04.02 03:27:22.105970 [ 7288 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:27:22.108783 [ 7288 ] {} KeeperStateMachine: Created persistent snapshot 10 with path snapshot_10.bin.zstd 2025.04.02 03:27:22.109488 [ 7288 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:27:22.109964 [ 7288 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:27:22.110807 [ 7288 ] {} RaftInstance: snapshot idx 10 log_term 10 created, compact the log store if needed 2025.04.02 03:27:22.112136 [ 7288 ] {} RaftInstance: create snapshot idx 10 log_term 10 done: 7061 us elapsed 2025.04.02 03:27:22.113233 [ 7902 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:27:22.114709 [ 7908 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 03:27:22.115004 [ 7909 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:27:22.115210 [ 7911 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:27:22.115275 [ 7915 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:27:22.115586 [ 7902 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:27:22.115505 [ 7914 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:27:22.115410 [ 7913 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:27:22.115705 [ 7916 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:27:22.115925 [ 7905 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.115934 [ 7907 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.115976 [ 7901 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.116226 [ 7904 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.116121 [ 7903 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.116311 [ 7910 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.116393 [ 7906 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.116498 [ 7912 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:22.120360 [ 7288 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:27:22.120971 [ 7900 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:27:22.123600 [ 7288 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:27:22.124637 [ 7288 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:27:22.125229 [ 7288 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:27:22.126815 [ 7288 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:27:22.127742 [ 7288 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:27:22.129256 [ 7288 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:27:22.129858 [ 7288 ] {} Context: Destructing threadpool writer 2025.04.02 03:27:22.191411 [ 7288 ] {} Application: Destroyed global context. 2025.04.02 03:27:22.193124 [ 7288 ] {} Application: Waiting for background threads 2025.04.02 03:27:22.327870 [ 7288 ] {} Application: Background threads finished in 134 ms 2025.04.02 03:27:22.331776 [ 7288 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:27:22.332248 [ 7288 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:27:22.405250 [ 7288 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:27:22.406585 [ 7288 ] {} Application: shutting down 2025.04.02 03:27:22.407419 [ 7288 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:27:22.414357 [ 7289 ] {} BaseDaemon: Received signal -2 2025.04.02 03:27:22.415333 [ 7289 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:27:22.509390 [ 7287 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:27:23.065262 [ 8033 ] {} Application: Will watch for the process with pid 8034 2025.04.02 03:27:23.065306 [ 8034 ] {} Application: Forked a child process to watch 2025.04.02 03:27:23.065710 [ 8034 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:27:23.152533 [ 8034 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 8034 2025.04.02 03:27:23.152982 [ 8034 ] {} Application: starting up 2025.04.02 03:27:23.153003 [ 8034 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:27:23.161978 [ 8034 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:27:23.163374 [ 8034 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:27:23.164800 [ 8034 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:27:23.165626 [ 8034 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:27:23.166407 [ 8034 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:27:23.167266 [ 8034 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:27:23.171536 [ 8034 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:27:23.172629 [ 8034 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:27:23.173143 [ 8034 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:27:23.173969 [ 8034 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:27:23.174587 [ 8034 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:27:24.450445 [ 8034 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:27:24.452571 [ 8034 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:27:24.486727 [ 8034 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:27:24.488391 [ 8034 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:27:24.490742 [ 8034 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:27:24.988129 [ 8558 ] {} CancellationChecker: Started worker function 2025.04.02 03:27:24.989031 [ 8034 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:27:24.989591 [ 8034 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:27:24.991149 [ 8034 ] {} Application: Initializing DateLUT. 2025.04.02 03:27:24.991708 [ 8034 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:27:24.993143 [ 8034 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:27:24.995872 [ 8034 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:27:25.003679 [ 8034 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:27:25.004688 [ 8034 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:27:25.005718 [ 8034 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:27:25.008003 [ 8034 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:27:25.009090 [ 8034 ] {} Application: Initializing interserver credentials. 2025.04.02 03:27:25.016957 [ 8034 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:27:25.084046 [ 8034 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:27:25.086586 [ 8034 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:27:25.092230 [ 8034 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:27:25.093101 [ 8034 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:27:25.100377 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:27:25.102164 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:27:25.103512 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:27:25.104970 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:27:25.106382 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:27:25.110114 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:27:25.111890 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:27:25.113640 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:27:25.114898 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:27:25.116423 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:27:25.117895 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:27:25.119178 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:27:25.120621 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:27:25.122055 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:27:25.123696 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:27:25.125067 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:27:25.126314 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:27:25.127618 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:27:25.128910 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:27:25.130099 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:27:25.131367 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:27:25.132660 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:27:25.133818 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:27:25.135462 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:27:25.136670 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:27:25.137746 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:27:25.139074 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:27:25.140582 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:27:25.141880 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:27:25.143030 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:27:25.144351 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:27:25.145655 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:27:25.147000 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:27:25.148180 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:27:25.149670 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:27:25.150841 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:27:25.152244 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:27:25.153508 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:27:25.154833 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:27:25.156057 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:27:25.230348 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:27:25.232223 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:27:25.258541 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:27:25.260074 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:27:25.262637 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:27:25.264394 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:27:25.265933 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:27:25.267236 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:27:25.269947 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:27:25.271793 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:27:25.273585 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:27:25.275247 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:27:25.276711 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:27:25.278128 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:27:25.279658 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:27:25.281317 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:27:25.282541 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:27:25.284111 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:27:25.285413 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:27:25.286692 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:27:25.288286 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:27:25.289611 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:27:25.291439 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:27:25.292903 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:27:25.294453 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:27:25.296750 [ 8034 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:27:25.430122 [ 8034 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:27:25.439818 [ 8034 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:27:26.356991 [ 8034 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:27:26.357827 [ 8034 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:27:26.358541 [ 8034 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:27:26.972664 [ 8034 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:27:26.973397 [ 8034 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:27:26.975297 [ 8034 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:27:26.977334 [ 8034 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:26.984215 [ 8034 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:26.991100 [ 8034 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:27.098422 [ 8034 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:27:27.099342 [ 8034 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:27.105034 [ 8034 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:27:27.110281 [ 8034 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:27.112548 [ 8034 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:27.114846 [ 8034 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:27:27.116156 [ 8034 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:27:27.125542 [ 8034 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:27:27.126243 [ 8034 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:27:27.126870 [ 8034 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:27:27.127619 [ 8034 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:27:27.128276 [ 8034 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:27:27.129712 [ 8034 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:27.130776 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.199626 [ 8034 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:27.204018 [ 8034 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:27.204705 [ 8034 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:27.242892 [ 8034 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/fbw/nnxrmsdawwuxvpnywpydxesfcroyy 2025.04.02 03:27:27.277377 [ 8034 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/fbw/nnxrmsdawwuxvpnywpydxesfcroyy. 2025.04.02 03:27:27.437935 [ 8622 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/fbw/nnxrmsdawwuxvpnywpydxesfcroyy, size 4 2025.04.02 03:27:27.461350 [ 8034 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/fbw/nnxrmsdawwuxvpnywpydxesfcroyy. 2025.04.02 03:27:27.666494 [ 8034 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/fbw/nnxrmsdawwuxvpnywpydxesfcroyy 2025.04.02 03:27:27.667238 [ 8034 ] {} deleteFileFromS3: Object with path s3/fbw/nnxrmsdawwuxvpnywpydxesfcroyy was removed from S3 2025.04.02 03:27:27.668034 [ 8034 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:27:27.668993 [ 8034 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:27:27.692012 [ 8034 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:27.695301 [ 8034 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:27.696032 [ 8034 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:27.743129 [ 8034 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:27:27.744147 [ 8034 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:27:27 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C143D3AA3C3 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:27:27.746234 [ 8034 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:27:27.757797 [ 8034 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:27:27.758507 [ 8034 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:27:27.759180 [ 8034 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:27:27.760035 [ 8034 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:27:27.761303 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.762454 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.763497 [ 8034 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:27.764482 [ 8034 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:27.765581 [ 8034 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:27:27.766696 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.767683 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.768673 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.769842 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.770906 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.802420 [ 8034 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:27.806780 [ 8034 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:27.807548 [ 8034 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:27.851182 [ 8034 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ixu/dvzttkohzqpjhjofxprtwyepddcow 2025.04.02 03:27:27.851863 [ 8034 ] {} deleteFileFromS3: Object with path special/ixu/dvzttkohzqpjhjofxprtwyepddcow was removed from S3 2025.04.02 03:27:27.852628 [ 8034 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:27:27.853556 [ 8034 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:27:27.883302 [ 8034 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:27.887645 [ 8034 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:27.888387 [ 8034 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:27.933385 [ 8034 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/gyc/fxdqehetufxebjnujoskvfcxzceje 2025.04.02 03:27:27.933993 [ 8034 ] {} deleteFileFromS3: Object with path test_02944/gyc/fxdqehetufxebjnujoskvfcxzceje was removed from S3 2025.04.02 03:27:27.934623 [ 8034 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:27:27.935362 [ 8034 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:27:27.936321 [ 8034 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:27.968307 [ 8034 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:27.990446 [ 8034 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:27:27.991141 [ 8034 ] {} KeeperSnapshotManager: Found snapshot_8.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:27.991794 [ 8034 ] {} KeeperSnapshotManager: Found snapshot_10.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:27.992391 [ 8034 ] {} KeeperSnapshotManager: Found snapshot_9.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:28.003436 [ 8034 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:27:28.004198 [ 8034 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:27:28.006038 [ 8034 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:27:28.006908 [ 8034 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:27:28.007626 [ 8034 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:27:28.008214 [ 8034 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 10 2025.04.02 03:27:28.014753 [ 8034 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:27:28.016060 [ 8034 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 10 2025.04.02 03:27:28.018906 [ 8034 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 10 entries 2025.04.02 03:27:28.019838 [ 8034 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:27:28.020850 [ 8034 ] {} KeeperServer: Last local log idx 10 2025.04.02 03:27:28.021894 [ 8034 ] {} KeeperServer: Will use config from log store with log index 10 2025.04.02 03:27:28.031246 [ 8034 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:27:28.043686 [ 8034 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:27:28.047381 [ 8034 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:27:28.049746 [ 8034 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:27:28.050635 [ 8034 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:27:28.051781 [ 8034 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:27:28.053107 [ 8034 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:27:28.054829 [ 8034 ] {} RaftInstance: === INIT RAFT SERVER === commit index 10 term 10 election timer allowed log store start 1, end 10 config log idx 10, prev log idx 9 -- ASYNC REPLICATION -- 2025.04.02 03:27:28.055949 [ 8034 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:27:28.057388 [ 8034 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:27:28.058626 [ 8034 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:27:28.058910 [ 8652 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:27:28.111377 [ 8635 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:27:28.112294 [ 8635 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:27:28.112504 [ 8034 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:27:28.113638 [ 8635 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 10, state term 10, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:27:28.114230 [ 8635 ] {} RaftInstance: pre-vote term (0) is different, reset it to 10 2025.04.02 03:27:28.116111 [ 8635 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:27:28.121292 [ 8635 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 11, log idx 10, log term 10, priority (target 1 / mine 1) 2025.04.02 03:27:28.122551 [ 8635 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:27:28.124561 [ 8635 ] {} RaftInstance: state machine commit index 10, precommit index 10, last log index 10 2025.04.02 03:27:28.128069 [ 8635 ] {} RaftInstance: [BECOME LEADER] appended new config at 11 2025.04.02 03:27:28.132100 [ 8651 ] {} RaftInstance: config at index 11 is committed, prev config log idx 10 2025.04.02 03:27:28.133055 [ 8651 ] {} RaftInstance: new config log idx 11, prev log idx 10, cur config log idx 10, prev log idx 9 2025.04.02 03:27:28.134027 [ 8651 ] {} RaftInstance: new configuration: log idx 11, prev log idx 10 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 11 2025.04.02 03:27:28.136840 [ 8034 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:27:28.138027 [ 8034 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:27:28.146129 [ 8034 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:27:28.146925 [ 8034 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:27:28.169560 [ 8034 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:27:28.170327 [ 8034 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:27:28.172187 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:27:28.201801 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:27:28.217492 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:27:28.241356 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:27:28.242880 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:27:28.266190 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:27:28.281435 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:27:28.283032 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:27:28.284475 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:27:28.285842 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:27:28.297999 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:27:28.314241 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:27:28.322912 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:27:28.338015 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:27:28.346022 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:27:28.366275 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:27:28.367567 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:27:28.385147 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:27:28.402173 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:27:28.403823 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:27:28.417337 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:27:28.433996 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:27:28.435977 [ 8034 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:27:28.477420 [ 8034 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:27:28.478465 [ 8034 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:27:29.033789 [ 8034 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:27:29.034762 [ 8034 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:29.036745 [ 8034 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:27:29.039265 [ 8034 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:27:29.044611 [ 8034 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:27:29.045078 [ 8661 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:27:29.392030 [ 8034 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:27:29.397898 [ 8034 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:27:29.491056 [ 8034 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:27:29.528365 [ 8034 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:27:29.537162 [ 8034 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:27:29.543095 [ 8034 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:27:29.552384 [ 8034 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:27:29.553446 [ 8034 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:27:29.553720 [ 8043 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:27:29.561794 [ 8043 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:27:33.796609 [ 8034 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:27:33.797515 [ 8034 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:27:33.801462 [ 8034 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:27:33.802229 [ 8034 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:27:33.803074 [ 8558 ] {} CancellationChecker: Execution took 8815 ms. 2025.04.02 03:27:33.804692 [ 8034 ] {} Application: Shutting down storages. 2025.04.02 03:27:33.805299 [ 8034 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:27:33.811801 [ 8034 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:27:33.812402 [ 8034 ] {} Context: Shutting down workload entity storage 2025.04.02 03:27:33.812946 [ 8034 ] {} Context: Shutting down named sessions 2025.04.02 03:27:33.814425 [ 8034 ] {} Context: Shutting down database catalog 2025.04.02 03:27:33.815157 [ 8034 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:27:33.816479 [ 8034 ] {} Context: Shutting down merges executor 2025.04.02 03:27:33.818987 [ 8034 ] {} Context: Shutting down fetches executor 2025.04.02 03:27:33.821349 [ 8034 ] {} Context: Shutting down moves executor 2025.04.02 03:27:33.823059 [ 8034 ] {} Context: Shutting down common executor 2025.04.02 03:27:33.824783 [ 8034 ] {} Context: Shutting down DDLWorker 2025.04.02 03:27:33.825532 [ 8034 ] {} Context: Shutting down caches 2025.04.02 03:27:33.826895 [ 8034 ] {} Context: Shutting down AccessControl 2025.04.02 03:27:33.830918 [ 8034 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:27:33.838080 [ 8034 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:27:34.311044 [ 8034 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:27:34.316258 [ 8034 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:27:34.331389 [ 8034 ] {} Application: Shut down storages. 2025.04.02 03:27:34.332096 [ 8034 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:27:34.656384 [ 8034 ] {} Application: Closed all listening sockets. 2025.04.02 03:27:34.657272 [ 8034 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:27:34.658679 [ 8034 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:27:35.144038 [ 8034 ] {} RaftInstance: shutting down raft core 2025.04.02 03:27:35.145840 [ 8034 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:27:35.146450 [ 8034 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:27:35.147153 [ 8034 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:27:35.148369 [ 8034 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:27:35.149303 [ 8034 ] {} RaftInstance: reset all pointers. 2025.04.02 03:27:35.150327 [ 8034 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:27:35.151394 [ 8652 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:27:35.151540 [ 8034 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:27:35.152682 [ 8034 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:27:35.153502 [ 8034 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:27:35.154377 [ 8034 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:27:35.155087 [ 8034 ] {} RaftInstance: manually create a snapshot on 11 2025.04.02 03:27:35.156707 [ 8034 ] {} RaftInstance: creating a snapshot for index 11 2025.04.02 03:27:35.157622 [ 8034 ] {} RaftInstance: create snapshot idx 11 log_term 11 2025.04.02 03:27:35.158447 [ 8034 ] {} KeeperStateMachine: Creating snapshot 11 2025.04.02 03:27:35.159546 [ 8034 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:27:35.162960 [ 8034 ] {} KeeperStateMachine: Created persistent snapshot 11 with path snapshot_11.bin.zstd 2025.04.02 03:27:35.163752 [ 8034 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:27:35.164376 [ 8034 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:27:35.165131 [ 8034 ] {} RaftInstance: snapshot idx 11 log_term 11 created, compact the log store if needed 2025.04.02 03:27:35.166757 [ 8034 ] {} RaftInstance: create snapshot idx 11 log_term 11 done: 8293 us elapsed 2025.04.02 03:27:35.167787 [ 8638 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:27:35.169438 [ 8640 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:27:35.171229 [ 8644 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.171412 [ 8641 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.171526 [ 8647 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.171704 [ 8642 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.171871 [ 8643 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.171937 [ 8649 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172050 [ 8646 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172150 [ 8648 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172239 [ 8650 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172441 [ 8639 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172570 [ 8635 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.173111 [ 8638 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172793 [ 8637 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172953 [ 8636 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.172748 [ 8645 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:35.183717 [ 8034 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:27:35.184270 [ 8634 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:27:35.187681 [ 8034 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:27:35.188888 [ 8034 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:27:35.189555 [ 8034 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:27:35.191363 [ 8034 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:27:35.192443 [ 8034 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:27:35.194402 [ 8034 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:27:35.195108 [ 8034 ] {} Context: Destructing threadpool writer 2025.04.02 03:27:35.254952 [ 8034 ] {} Application: Destroyed global context. 2025.04.02 03:27:35.256781 [ 8034 ] {} Application: Waiting for background threads 2025.04.02 03:27:35.387872 [ 8034 ] {} Application: Background threads finished in 130 ms 2025.04.02 03:27:35.391736 [ 8034 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:27:35.392349 [ 8034 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:27:35.413077 [ 8034 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:27:35.414150 [ 8034 ] {} Application: shutting down 2025.04.02 03:27:35.414792 [ 8034 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:27:35.416362 [ 8035 ] {} BaseDaemon: Received signal -2 2025.04.02 03:27:35.417249 [ 8035 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:27:35.522008 [ 8033 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:27:36.005793 [ 8767 ] {} Application: Will watch for the process with pid 8768 2025.04.02 03:27:36.006006 [ 8768 ] {} Application: Forked a child process to watch 2025.04.02 03:27:36.006867 [ 8768 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:27:36.115521 [ 8768 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 8768 2025.04.02 03:27:36.116123 [ 8768 ] {} Application: starting up 2025.04.02 03:27:36.116142 [ 8768 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:27:36.125440 [ 8768 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:27:36.126949 [ 8768 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:27:36.128882 [ 8768 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:27:36.129646 [ 8768 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:27:36.130668 [ 8768 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:27:36.131644 [ 8768 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:27:36.136627 [ 8768 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:27:36.138057 [ 8768 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:27:36.138659 [ 8768 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:27:36.139578 [ 8768 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:27:36.140303 [ 8768 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:27:37.628961 [ 8768 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:27:37.638562 [ 8768 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:27:37.718714 [ 8768 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:27:37.741767 [ 8768 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:27:37.749664 [ 8768 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:27:38.041542 [ 8780 ] {} CancellationChecker: Started worker function 2025.04.02 03:27:38.042689 [ 8768 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:27:38.043351 [ 8768 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:27:38.045327 [ 8768 ] {} Application: Initializing DateLUT. 2025.04.02 03:27:38.045930 [ 8768 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:27:38.047619 [ 8768 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:27:38.088365 [ 8768 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:27:38.188174 [ 8768 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:27:38.189613 [ 8768 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:27:38.190634 [ 8768 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:27:38.193246 [ 8768 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:27:38.194217 [ 8768 ] {} Application: Initializing interserver credentials. 2025.04.02 03:27:38.202572 [ 8768 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:27:38.537815 [ 8768 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:27:38.540209 [ 8768 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:27:38.545646 [ 8768 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:27:38.546377 [ 8768 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:27:38.550437 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:27:38.551953 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:27:38.553455 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:27:38.555117 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:27:38.556665 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:27:38.559975 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:27:38.561551 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:27:38.562890 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:27:38.564196 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:27:38.565590 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:27:38.567060 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:27:38.568345 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:27:38.569519 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:27:38.570787 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:27:38.571929 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:27:38.573434 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:27:38.575052 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:27:38.576409 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:27:38.577985 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:27:38.579123 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:27:38.580381 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:27:38.581637 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:27:38.587759 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:27:38.589318 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:27:38.590694 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:27:38.591888 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:27:38.593553 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:27:38.594974 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:27:38.605095 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:27:38.606518 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:27:38.607999 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:27:38.621101 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:27:38.622978 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:27:38.624411 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:27:38.626039 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:27:38.627452 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:27:38.628989 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:27:38.630516 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:27:38.632003 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:27:38.705012 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:27:38.707069 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:27:38.708706 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:27:38.710187 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:27:38.711536 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:27:38.712663 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:27:38.714132 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:27:38.715553 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:27:38.716992 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:27:38.718961 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:27:38.720931 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:27:38.723287 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:27:38.725370 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:27:38.726808 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:27:38.728364 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:27:38.772710 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:27:38.774677 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:27:38.776004 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:27:38.777570 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:27:38.779244 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:27:38.780677 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:27:38.782501 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:27:38.783986 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:27:38.785531 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:27:38.786960 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:27:38.788332 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:27:38.790634 [ 8768 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:27:38.813648 [ 8768 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:27:38.819435 [ 8768 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:27:39.707290 [ 8768 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:27:39.708015 [ 8768 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:27:39.708674 [ 8768 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:27:40.524876 [ 8768 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:27:40.525681 [ 8768 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:27:40.527376 [ 8768 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:27:40.529726 [ 8768 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:40.536768 [ 8768 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:40.543692 [ 8768 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:40.615204 [ 8768 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:27:40.616235 [ 8768 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:40.621468 [ 8768 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:27:40.626013 [ 8768 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:40.628215 [ 8768 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:40.630341 [ 8768 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:27:40.631641 [ 8768 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:27:40.657950 [ 8768 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:27:40.658684 [ 8768 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:27:40.659288 [ 8768 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:27:40.659853 [ 8768 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:27:40.660529 [ 8768 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:27:40.661866 [ 8768 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:40.662943 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:40.775974 [ 8768 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:40.780693 [ 8768 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:40.781425 [ 8768 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:40.792091 [ 8768 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/ogl/esbszwetyeibhcbvfobbxsqhvflyd 2025.04.02 03:27:40.793694 [ 8768 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/ogl/esbszwetyeibhcbvfobbxsqhvflyd. 2025.04.02 03:27:40.810387 [ 9359 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/ogl/esbszwetyeibhcbvfobbxsqhvflyd, size 4 2025.04.02 03:27:40.811839 [ 8768 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/ogl/esbszwetyeibhcbvfobbxsqhvflyd. 2025.04.02 03:27:41.024690 [ 8768 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/ogl/esbszwetyeibhcbvfobbxsqhvflyd 2025.04.02 03:27:41.033353 [ 8768 ] {} deleteFileFromS3: Object with path s3/ogl/esbszwetyeibhcbvfobbxsqhvflyd was removed from S3 2025.04.02 03:27:41.034299 [ 8768 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:27:41.050146 [ 8768 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:27:41.163205 [ 8768 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:41.167512 [ 8768 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:41.168287 [ 8768 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:41.273052 [ 8768 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:27:41.273993 [ 8768 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:27:41 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C1763AF120F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:27:41.282900 [ 8768 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:27:41.297911 [ 8768 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:27:41.298537 [ 8768 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:27:41.299202 [ 8768 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:27:41.300013 [ 8768 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:27:41.301119 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.302390 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.303676 [ 8768 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:41.304844 [ 8768 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:41.306040 [ 8768 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:27:41.307149 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.308389 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.309653 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.310751 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.311936 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:41.411811 [ 8768 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:41.415213 [ 8768 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:41.415946 [ 8768 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:41.473240 [ 8768 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ztu/iwuvpmezuxkalxnqtrvkquccxlwtt 2025.04.02 03:27:41.473841 [ 8768 ] {} deleteFileFromS3: Object with path special/ztu/iwuvpmezuxkalxnqtrvkquccxlwtt was removed from S3 2025.04.02 03:27:41.474368 [ 8768 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:27:41.475077 [ 8768 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:27:41.497941 [ 8768 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:41.502178 [ 8768 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:41.502763 [ 8768 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:41.636168 [ 8768 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/jnw/juhpiohcpirmoetttzneivynnmagj 2025.04.02 03:27:41.636870 [ 8768 ] {} deleteFileFromS3: Object with path test_02944/jnw/juhpiohcpirmoetttzneivynnmagj was removed from S3 2025.04.02 03:27:41.637543 [ 8768 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:27:41.643740 [ 8768 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:27:41.644881 [ 8768 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:42.040599 [ 8768 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:42.061704 [ 8768 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:27:42.062384 [ 8768 ] {} KeeperSnapshotManager: Found snapshot_10.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:42.063029 [ 8768 ] {} KeeperSnapshotManager: Found snapshot_9.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:42.063630 [ 8768 ] {} KeeperSnapshotManager: Found snapshot_11.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:42.083501 [ 8768 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:27:42.084326 [ 8768 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:27:42.085964 [ 8768 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:27:42.086747 [ 8768 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:27:42.087465 [ 8768 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:27:42.088032 [ 8768 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 11 2025.04.02 03:27:42.095433 [ 8768 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:27:42.096816 [ 8768 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 11 2025.04.02 03:27:42.100113 [ 8768 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 11 entries 2025.04.02 03:27:42.101088 [ 8768 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:27:42.102207 [ 8768 ] {} KeeperServer: Last local log idx 11 2025.04.02 03:27:42.103413 [ 8768 ] {} KeeperServer: Will use config from log store with log index 11 2025.04.02 03:27:42.116414 [ 8768 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:27:42.141364 [ 8768 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:27:42.144998 [ 8768 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:27:42.147531 [ 8768 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:27:42.148386 [ 8768 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:27:42.149502 [ 8768 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:27:42.151038 [ 8768 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:27:42.152726 [ 8768 ] {} RaftInstance: === INIT RAFT SERVER === commit index 11 term 11 election timer allowed log store start 1, end 11 config log idx 11, prev log idx 10 -- ASYNC REPLICATION -- 2025.04.02 03:27:42.153832 [ 8768 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:27:42.155584 [ 8768 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:27:42.156951 [ 8768 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:27:42.157303 [ 9394 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:27:42.209743 [ 9379 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:27:42.210832 [ 9379 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:27:42.210919 [ 8768 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:27:42.212547 [ 9379 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 11, state term 11, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:27:42.213427 [ 9379 ] {} RaftInstance: pre-vote term (0) is different, reset it to 11 2025.04.02 03:27:42.214711 [ 9379 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:27:42.220115 [ 9379 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 12, log idx 11, log term 11, priority (target 1 / mine 1) 2025.04.02 03:27:42.221335 [ 9379 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:27:42.223538 [ 9379 ] {} RaftInstance: state machine commit index 11, precommit index 11, last log index 11 2025.04.02 03:27:42.227497 [ 9379 ] {} RaftInstance: [BECOME LEADER] appended new config at 12 2025.04.02 03:27:42.231664 [ 9393 ] {} RaftInstance: config at index 12 is committed, prev config log idx 11 2025.04.02 03:27:42.232864 [ 9393 ] {} RaftInstance: new config log idx 12, prev log idx 11, cur config log idx 11, prev log idx 10 2025.04.02 03:27:42.233865 [ 9393 ] {} RaftInstance: new configuration: log idx 12, prev log idx 11 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 12 2025.04.02 03:27:42.237574 [ 8768 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:27:42.239179 [ 8768 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:27:42.246788 [ 8768 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:27:42.247690 [ 8768 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:27:42.260409 [ 8768 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:27:42.261031 [ 8768 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:27:42.262754 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:27:42.273211 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:27:42.274281 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:27:42.275691 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:27:42.276955 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:27:42.278190 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:27:42.279423 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:27:42.280555 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:27:42.306690 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:27:42.308321 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:27:42.309785 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:27:42.311251 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:27:42.312847 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:27:42.314350 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:27:42.315978 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:27:42.317321 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:27:42.318693 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:27:42.320041 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:27:42.321336 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:27:42.322916 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:27:42.324240 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:27:42.325589 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:27:42.327108 [ 8768 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:27:42.333156 [ 8768 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:27:42.334011 [ 8768 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:27:43.223238 [ 8768 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:27:43.224092 [ 8768 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:43.226161 [ 8768 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:27:43.228661 [ 8768 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:27:43.234217 [ 8768 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:27:43.234627 [ 9403 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:27:43.293883 [ 8768 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:27:43.299014 [ 8768 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:27:43.308603 [ 8768 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:27:43.376717 [ 8768 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:27:43.384786 [ 8768 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:27:43.395081 [ 8768 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:27:43.404156 [ 8768 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:27:43.405539 [ 8768 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:27:43.405674 [ 8781 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:27:43.413646 [ 8781 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:27:47.786174 [ 8768 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:27:47.787278 [ 8768 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:27:47.791115 [ 8768 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:27:47.791683 [ 8768 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:27:47.802776 [ 8780 ] {} CancellationChecker: Execution took 9751 ms. 2025.04.02 03:27:47.804460 [ 8768 ] {} Application: Shutting down storages. 2025.04.02 03:27:47.805091 [ 8768 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:27:47.849120 [ 8768 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:27:47.849984 [ 8768 ] {} Context: Shutting down workload entity storage 2025.04.02 03:27:47.850718 [ 8768 ] {} Context: Shutting down named sessions 2025.04.02 03:27:47.852439 [ 8768 ] {} Context: Shutting down database catalog 2025.04.02 03:27:47.853286 [ 8768 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:27:47.854563 [ 8768 ] {} Context: Shutting down merges executor 2025.04.02 03:27:47.857081 [ 8768 ] {} Context: Shutting down fetches executor 2025.04.02 03:27:47.859725 [ 8768 ] {} Context: Shutting down moves executor 2025.04.02 03:27:47.861393 [ 8768 ] {} Context: Shutting down common executor 2025.04.02 03:27:47.863551 [ 8768 ] {} Context: Shutting down DDLWorker 2025.04.02 03:27:47.864109 [ 8768 ] {} Context: Shutting down caches 2025.04.02 03:27:47.865393 [ 8768 ] {} Context: Shutting down AccessControl 2025.04.02 03:27:47.870785 [ 8768 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:27:47.883000 [ 8768 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:27:48.042016 [ 8768 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:27:48.046536 [ 8768 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:27:48.062800 [ 8768 ] {} Application: Shut down storages. 2025.04.02 03:27:48.063479 [ 8768 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:27:48.521948 [ 8768 ] {} Application: Closed all listening sockets. 2025.04.02 03:27:48.523037 [ 8768 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:27:48.529282 [ 8768 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:27:48.745311 [ 8768 ] {} RaftInstance: shutting down raft core 2025.04.02 03:27:48.747201 [ 8768 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:27:48.748306 [ 8768 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:27:48.749436 [ 8768 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:27:48.751135 [ 8768 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:27:48.752250 [ 8768 ] {} RaftInstance: reset all pointers. 2025.04.02 03:27:48.753723 [ 8768 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:27:48.755229 [ 9394 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:27:48.755400 [ 8768 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:27:48.756869 [ 8768 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:27:48.757707 [ 8768 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:27:48.758831 [ 8768 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:27:48.759739 [ 8768 ] {} RaftInstance: manually create a snapshot on 12 2025.04.02 03:27:48.762099 [ 8768 ] {} RaftInstance: creating a snapshot for index 12 2025.04.02 03:27:48.763284 [ 8768 ] {} RaftInstance: create snapshot idx 12 log_term 12 2025.04.02 03:27:48.764346 [ 8768 ] {} KeeperStateMachine: Creating snapshot 12 2025.04.02 03:27:48.765269 [ 8768 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:27:48.798058 [ 8768 ] {} KeeperStateMachine: Created persistent snapshot 12 with path snapshot_12.bin.zstd 2025.04.02 03:27:48.799172 [ 8768 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:27:48.800101 [ 8768 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:27:48.800867 [ 8768 ] {} RaftInstance: snapshot idx 12 log_term 12 created, compact the log store if needed 2025.04.02 03:27:48.802949 [ 8768 ] {} RaftInstance: create snapshot idx 12 log_term 12 done: 38591 us elapsed 2025.04.02 03:27:48.804568 [ 9378 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:27:48.806783 [ 9387 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:27:48.806754 [ 9384 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:27:48.807226 [ 9382 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:27:48.807325 [ 9389 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:27:48.807437 [ 9385 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:27:48.807587 [ 9383 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:27:48.807833 [ 9378 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:27:48.807879 [ 9391 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:27:48.808246 [ 9377 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:48.808145 [ 9379 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:27:48.807969 [ 9380 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:27:48.808304 [ 9388 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:48.808726 [ 9392 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:48.808637 [ 9386 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:48.808485 [ 9381 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:48.808861 [ 9390 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:27:48.813163 [ 8768 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:27:48.814187 [ 9376 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:27:48.817289 [ 8768 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:27:48.818463 [ 8768 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:27:48.819042 [ 8768 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:27:48.820631 [ 8768 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:27:48.821680 [ 8768 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:27:48.823481 [ 8768 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:27:48.824097 [ 8768 ] {} Context: Destructing threadpool writer 2025.04.02 03:27:48.876122 [ 8768 ] {} Application: Destroyed global context. 2025.04.02 03:27:48.878240 [ 8768 ] {} Application: Waiting for background threads 2025.04.02 03:27:48.942331 [ 8768 ] {} Application: Background threads finished in 64 ms 2025.04.02 03:27:48.945888 [ 8768 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:27:48.946547 [ 8768 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:27:48.968882 [ 8768 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:27:48.969855 [ 8768 ] {} Application: shutting down 2025.04.02 03:27:48.970496 [ 8768 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:27:48.972365 [ 8769 ] {} BaseDaemon: Received signal -2 2025.04.02 03:27:48.973237 [ 8769 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:27:49.159056 [ 8767 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:27:49.591455 [ 9505 ] {} Application: Will watch for the process with pid 9506 2025.04.02 03:27:49.591650 [ 9506 ] {} Application: Forked a child process to watch 2025.04.02 03:27:49.592406 [ 9506 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:27:49.680931 [ 9506 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 9506 2025.04.02 03:27:49.681519 [ 9506 ] {} Application: starting up 2025.04.02 03:27:49.681541 [ 9506 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:27:49.690560 [ 9506 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:27:49.692225 [ 9506 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:27:49.694078 [ 9506 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:27:49.695029 [ 9506 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:27:49.696021 [ 9506 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:27:49.697080 [ 9506 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:27:49.702245 [ 9506 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:27:49.703352 [ 9506 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:27:49.704011 [ 9506 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:27:49.704887 [ 9506 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:27:49.705667 [ 9506 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:27:51.096240 [ 9506 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:27:51.101899 [ 9506 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:27:51.165766 [ 9506 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:27:51.169875 [ 9506 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:27:51.181864 [ 9506 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:27:51.725459 [ 9516 ] {} CancellationChecker: Started worker function 2025.04.02 03:27:51.726451 [ 9506 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:27:51.727078 [ 9506 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:27:51.728451 [ 9506 ] {} Application: Initializing DateLUT. 2025.04.02 03:27:51.729057 [ 9506 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:27:51.730649 [ 9506 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:27:51.733065 [ 9506 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:27:51.754558 [ 9506 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:27:51.755425 [ 9506 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:27:51.756254 [ 9506 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:27:51.758675 [ 9506 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:27:51.759903 [ 9506 ] {} Application: Initializing interserver credentials. 2025.04.02 03:27:51.768103 [ 9506 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:27:52.051317 [ 9506 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:27:52.071269 [ 9506 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:27:52.100106 [ 9506 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:27:52.100767 [ 9506 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:27:52.105525 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:27:52.107179 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:27:52.133566 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:27:52.151012 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:27:52.159040 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:27:52.192402 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:27:52.194063 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:27:52.209257 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:27:52.210851 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:27:52.226539 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:27:52.246258 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:27:52.247911 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:27:52.254899 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:27:52.272819 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:27:52.274820 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:27:52.276206 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:27:52.277690 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:27:52.279373 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:27:52.280740 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:27:52.282144 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:27:52.283655 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:27:52.285260 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:27:52.286970 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:27:52.288813 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:27:52.289979 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:27:52.291071 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:27:52.292882 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:27:52.294342 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:27:52.295705 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:27:52.297032 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:27:52.298616 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:27:52.299925 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:27:52.301707 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:27:52.303023 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:27:52.304325 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:27:52.305623 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:27:52.306978 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:27:52.308149 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:27:52.311349 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:27:52.312994 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:27:52.314493 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:27:52.315865 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:27:52.317293 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:27:52.318793 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:27:52.320070 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:27:52.321451 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:27:52.322861 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:27:52.324264 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:27:52.426559 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:27:52.428737 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:27:52.430969 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:27:52.432850 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:27:52.434425 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:27:52.436092 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:27:52.437679 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:27:52.439240 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:27:52.440397 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:27:52.441773 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:27:52.443373 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:27:52.444691 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:27:52.446354 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:27:52.447631 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:27:52.449327 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:27:52.450978 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:27:52.452365 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:27:52.454345 [ 9506 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:27:52.489603 [ 9506 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:27:52.495595 [ 9506 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:27:53.343565 [ 9506 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:27:53.344287 [ 9506 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:27:53.344883 [ 9506 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:27:54.042540 [ 9506 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:27:54.043263 [ 9506 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:27:54.045028 [ 9506 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:27:54.047193 [ 9506 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:54.053655 [ 9506 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:54.059517 [ 9506 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:27:54.141403 [ 9506 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:27:54.142508 [ 9506 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:54.226432 [ 9506 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:27:54.232057 [ 9506 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:54.234365 [ 9506 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:27:54.236762 [ 9506 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:27:54.238387 [ 9506 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:27:54.249225 [ 9506 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:27:54.249814 [ 9506 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:27:54.250444 [ 9506 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:27:54.251075 [ 9506 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:27:54.251873 [ 9506 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:27:54.253279 [ 9506 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:54.254431 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.326334 [ 9506 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:54.330671 [ 9506 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:54.331344 [ 9506 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:54.377572 [ 9506 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/cwl/ukgsnyevwubnoukdupgnjqsexmflx 2025.04.02 03:27:54.379561 [ 9506 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/cwl/ukgsnyevwubnoukdupgnjqsexmflx. 2025.04.02 03:27:54.406027 [ 10097 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/cwl/ukgsnyevwubnoukdupgnjqsexmflx, size 4 2025.04.02 03:27:54.407432 [ 9506 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/cwl/ukgsnyevwubnoukdupgnjqsexmflx. 2025.04.02 03:27:54.436874 [ 9506 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/cwl/ukgsnyevwubnoukdupgnjqsexmflx 2025.04.02 03:27:54.437529 [ 9506 ] {} deleteFileFromS3: Object with path s3/cwl/ukgsnyevwubnoukdupgnjqsexmflx was removed from S3 2025.04.02 03:27:54.438289 [ 9506 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:27:54.439793 [ 9506 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:27:54.461774 [ 9506 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:54.466011 [ 9506 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:54.466831 [ 9506 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:54.714945 [ 9506 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:27:54.716113 [ 9506 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:27:54 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C1A84DDC26F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:27:54.745717 [ 9506 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:27:54.865428 [ 9506 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:27:54.866342 [ 9506 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:27:54.867258 [ 9506 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:27:54.875076 [ 9506 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:27:54.887751 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.889072 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.890529 [ 9506 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:54.891830 [ 9506 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:54.893105 [ 9506 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:27:54.894477 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.895733 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.897007 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.898375 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.899637 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:54.921580 [ 9506 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:54.925684 [ 9506 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:54.926413 [ 9506 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:55.068222 [ 9506 ] {} deleteFileFromS3: No blob storage log, not writing blob special/aiz/kwdzftawvcmsdbtestwdiwttkjedz 2025.04.02 03:27:55.068895 [ 9506 ] {} deleteFileFromS3: Object with path special/aiz/kwdzftawvcmsdbtestwdiwttkjedz was removed from S3 2025.04.02 03:27:55.069613 [ 9506 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:27:55.070470 [ 9506 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:27:55.091609 [ 9506 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:27:55.095871 [ 9506 ] {} S3Client: Provider type: Unknown 2025.04.02 03:27:55.096601 [ 9506 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:27:55.150249 [ 9506 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/xwn/fojtlsuilmjxmxztqeiadgasdqhfm 2025.04.02 03:27:55.150912 [ 9506 ] {} deleteFileFromS3: Object with path test_02944/xwn/fojtlsuilmjxmxztqeiadgasdqhfm was removed from S3 2025.04.02 03:27:55.151481 [ 9506 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:27:55.152325 [ 9506 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:27:55.153530 [ 9506 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:27:55.179048 [ 9506 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:27:55.230241 [ 9506 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:27:55.230894 [ 9506 ] {} KeeperSnapshotManager: Found snapshot_12.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:55.231461 [ 9506 ] {} KeeperSnapshotManager: Found snapshot_10.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:55.232058 [ 9506 ] {} KeeperSnapshotManager: Found snapshot_11.bin.zstd on LocalSnapshotDisk 2025.04.02 03:27:55.241711 [ 9506 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:27:55.242412 [ 9506 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:27:55.244005 [ 9506 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:27:55.244725 [ 9506 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:27:55.245310 [ 9506 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:27:55.245824 [ 9506 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 12 2025.04.02 03:27:55.252151 [ 9506 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:27:55.253307 [ 9506 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 12 2025.04.02 03:27:55.256390 [ 9506 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 12 entries 2025.04.02 03:27:55.257278 [ 9506 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:27:55.258269 [ 9506 ] {} KeeperServer: Last local log idx 12 2025.04.02 03:27:55.259309 [ 9506 ] {} KeeperServer: Will use config from log store with log index 12 2025.04.02 03:27:55.267437 [ 9506 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:27:55.277990 [ 9506 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:27:55.280947 [ 9506 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:27:55.283191 [ 9506 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:27:55.283964 [ 9506 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:27:55.284901 [ 9506 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:27:55.286238 [ 9506 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:27:55.287774 [ 9506 ] {} RaftInstance: === INIT RAFT SERVER === commit index 12 term 12 election timer allowed log store start 1, end 12 config log idx 12, prev log idx 11 -- ASYNC REPLICATION -- 2025.04.02 03:27:55.288665 [ 9506 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:27:55.290151 [ 9506 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:27:55.291476 [ 9506 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:27:55.291755 [ 10128 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:27:55.344237 [ 10112 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:27:55.345094 [ 9506 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:27:55.345223 [ 10112 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:27:55.346781 [ 10112 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 12, state term 12, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:27:55.347417 [ 10112 ] {} RaftInstance: pre-vote term (0) is different, reset it to 12 2025.04.02 03:27:55.348700 [ 10112 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:27:55.353666 [ 10112 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 13, log idx 12, log term 12, priority (target 1 / mine 1) 2025.04.02 03:27:55.354785 [ 10112 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:27:55.356669 [ 10112 ] {} RaftInstance: state machine commit index 12, precommit index 12, last log index 12 2025.04.02 03:27:55.417538 [ 10112 ] {} RaftInstance: [BECOME LEADER] appended new config at 13 2025.04.02 03:27:55.473559 [ 10127 ] {} RaftInstance: config at index 13 is committed, prev config log idx 12 2025.04.02 03:27:55.506291 [ 10127 ] {} RaftInstance: new config log idx 13, prev log idx 12, cur config log idx 12, prev log idx 11 2025.04.02 03:27:55.524389 [ 10127 ] {} RaftInstance: new configuration: log idx 13, prev log idx 12 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 13 2025.04.02 03:27:55.551047 [ 9506 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:27:55.573468 [ 9506 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:27:55.640331 [ 9506 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:27:55.641231 [ 9506 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:27:55.795048 [ 9506 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:27:55.795775 [ 9506 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:27:55.797936 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:27:55.799523 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:27:55.800445 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:27:55.801875 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:27:55.802981 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:27:55.804163 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:27:55.805498 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:27:55.806835 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:27:55.808901 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:27:55.810401 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:27:55.811810 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:27:55.813003 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:27:55.814388 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:27:55.815607 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:27:55.816843 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:27:55.818241 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:27:55.819439 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:27:55.820658 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:27:55.822137 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:27:55.823507 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:27:55.824715 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:27:55.825892 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:27:55.827451 [ 9506 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:27:55.896004 [ 9506 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:27:55.897139 [ 9506 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:27:57.070607 [ 9506 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:27:57.071711 [ 9506 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:27:57.073846 [ 9506 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:27:57.076503 [ 9506 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:27:57.082258 [ 9506 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:27:57.082819 [ 10141 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:27:57.141090 [ 9506 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:27:57.240437 [ 9506 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:27:57.333700 [ 9506 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:27:57.377500 [ 9506 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:27:57.404555 [ 9506 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:27:57.438692 [ 9506 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:27:57.490248 [ 9506 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:27:57.495191 [ 9506 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:27:57.495315 [ 9517 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:27:57.502683 [ 9517 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:28:02.283149 [ 9506 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:02.289616 [ 9506 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:28:02.299762 [ 9506 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:28:02.300388 [ 9506 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:28:02.301444 [ 9516 ] {} CancellationChecker: Execution took 10576 ms. 2025.04.02 03:28:02.303468 [ 9506 ] {} Application: Shutting down storages. 2025.04.02 03:28:02.304064 [ 9506 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:28:02.318337 [ 9506 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:28:02.319059 [ 9506 ] {} Context: Shutting down workload entity storage 2025.04.02 03:28:02.319710 [ 9506 ] {} Context: Shutting down named sessions 2025.04.02 03:28:02.420404 [ 9506 ] {} Context: Shutting down database catalog 2025.04.02 03:28:02.421644 [ 9506 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:28:02.423361 [ 9506 ] {} Context: Shutting down merges executor 2025.04.02 03:28:02.426272 [ 9506 ] {} Context: Shutting down fetches executor 2025.04.02 03:28:02.429121 [ 9506 ] {} Context: Shutting down moves executor 2025.04.02 03:28:02.445202 [ 9506 ] {} Context: Shutting down common executor 2025.04.02 03:28:02.447581 [ 9506 ] {} Context: Shutting down DDLWorker 2025.04.02 03:28:02.448149 [ 9506 ] {} Context: Shutting down caches 2025.04.02 03:28:02.453777 [ 9506 ] {} Context: Shutting down AccessControl 2025.04.02 03:28:02.458092 [ 9506 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:28:02.465778 [ 9506 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:28:02.702884 [ 9506 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:28:02.709606 [ 9506 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:28:02.725443 [ 9506 ] {} Application: Shut down storages. 2025.04.02 03:28:02.726195 [ 9506 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:28:03.151881 [ 9506 ] {} Application: Closed all listening sockets. 2025.04.02 03:28:03.152681 [ 9506 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:28:03.154377 [ 9506 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:28:03.580953 [ 9506 ] {} RaftInstance: shutting down raft core 2025.04.02 03:28:03.582974 [ 9506 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:28:03.583879 [ 9506 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:28:03.584886 [ 9506 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:28:03.586250 [ 9506 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:28:03.587212 [ 9506 ] {} RaftInstance: reset all pointers. 2025.04.02 03:28:03.588362 [ 9506 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:28:03.589473 [ 10128 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:28:03.589622 [ 9506 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:28:03.590756 [ 9506 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:28:03.591469 [ 9506 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:28:03.592471 [ 9506 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:28:03.593076 [ 9506 ] {} RaftInstance: manually create a snapshot on 13 2025.04.02 03:28:03.595071 [ 9506 ] {} RaftInstance: creating a snapshot for index 13 2025.04.02 03:28:03.596095 [ 9506 ] {} RaftInstance: create snapshot idx 13 log_term 13 2025.04.02 03:28:03.597151 [ 9506 ] {} KeeperStateMachine: Creating snapshot 13 2025.04.02 03:28:03.598234 [ 9506 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:28:03.602170 [ 9506 ] {} KeeperStateMachine: Created persistent snapshot 13 with path snapshot_13.bin.zstd 2025.04.02 03:28:03.603393 [ 9506 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:28:03.617680 [ 9506 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:28:03.618622 [ 9506 ] {} RaftInstance: snapshot idx 13 log_term 13 created, compact the log store if needed 2025.04.02 03:28:03.650375 [ 9506 ] {} RaftInstance: create snapshot idx 13 log_term 13 done: 53184 us elapsed 2025.04.02 03:28:03.652051 [ 10114 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:28:03.654816 [ 10111 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:28:03.654902 [ 10118 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:28:03.655100 [ 10117 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:28:03.655467 [ 10121 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:28:03.655566 [ 10125 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:03.655691 [ 10122 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:03.656023 [ 10124 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:28:03.656083 [ 10126 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:28:03.656155 [ 10112 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:28:03.656271 [ 10123 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:28:03.659224 [ 10119 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:03.659348 [ 10116 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:03.659579 [ 10113 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:03.659777 [ 10120 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:03.659673 [ 10115 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:03.659927 [ 10114 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:03.706748 [ 9506 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:03.707293 [ 10110 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:28:03.758961 [ 9506 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:28:03.760289 [ 9506 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:28:03.777316 [ 9506 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:28:03.797068 [ 9506 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:28:03.809958 [ 9506 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:03.811900 [ 9506 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:03.825298 [ 9506 ] {} Context: Destructing threadpool writer 2025.04.02 03:28:04.023981 [ 9506 ] {} Application: Destroyed global context. 2025.04.02 03:28:04.033819 [ 9506 ] {} Application: Waiting for background threads 2025.04.02 03:28:04.092185 [ 9506 ] {} Application: Background threads finished in 58 ms 2025.04.02 03:28:04.095621 [ 9506 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:28:04.096157 [ 9506 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:04.115513 [ 9506 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:04.116486 [ 9506 ] {} Application: shutting down 2025.04.02 03:28:04.117026 [ 9506 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:28:04.118737 [ 9507 ] {} BaseDaemon: Received signal -2 2025.04.02 03:28:04.119480 [ 9507 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:28:04.226702 [ 9505 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:28:05.006376 [ 10251 ] {} Application: Will watch for the process with pid 10252 2025.04.02 03:28:05.006634 [ 10252 ] {} Application: Forked a child process to watch 2025.04.02 03:28:05.007767 [ 10252 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:28:05.119765 [ 10252 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 10252 2025.04.02 03:28:05.120212 [ 10252 ] {} Application: starting up 2025.04.02 03:28:05.120232 [ 10252 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:28:05.129912 [ 10252 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:28:05.131620 [ 10252 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:28:05.133743 [ 10252 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:28:05.143008 [ 10252 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:28:05.144325 [ 10252 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:28:05.145543 [ 10252 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:28:05.151199 [ 10252 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:28:05.152762 [ 10252 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:28:05.153689 [ 10252 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:28:05.154618 [ 10252 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:28:05.155255 [ 10252 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:28:07.186411 [ 10252 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:28:07.188371 [ 10252 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:28:07.248050 [ 10252 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:28:07.249440 [ 10252 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:28:07.251126 [ 10252 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:28:07.721295 [ 10264 ] {} CancellationChecker: Started worker function 2025.04.02 03:28:07.722289 [ 10252 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:28:07.723118 [ 10252 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:28:07.725139 [ 10252 ] {} Application: Initializing DateLUT. 2025.04.02 03:28:07.725914 [ 10252 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:28:07.727419 [ 10252 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:28:07.730698 [ 10252 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:28:07.748636 [ 10252 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:28:07.749986 [ 10252 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:28:07.751220 [ 10252 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:28:07.753945 [ 10252 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:28:07.755040 [ 10252 ] {} Application: Initializing interserver credentials. 2025.04.02 03:28:07.771145 [ 10252 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:28:07.828503 [ 10252 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:28:07.831037 [ 10252 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:28:07.870308 [ 10252 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:28:07.871283 [ 10252 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:28:07.875556 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:28:07.877581 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:28:07.879289 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:28:07.880867 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:28:07.882453 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:28:07.885756 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:28:07.887628 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:28:07.888975 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:28:07.893820 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:28:07.895147 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:28:07.896621 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:28:07.898182 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:28:07.899662 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:28:07.901104 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:28:07.902632 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:28:07.904164 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:28:07.905492 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:28:07.908976 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:28:07.910470 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:28:07.911811 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:28:07.913263 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:28:07.914794 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:28:07.916350 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:28:07.918143 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:28:07.919590 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:28:07.920642 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:28:07.922775 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:28:07.924466 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:28:07.925977 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:28:07.927618 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:28:07.929163 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:28:07.930577 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:28:07.932029 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:28:07.933517 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:28:07.934923 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:28:07.936148 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:28:07.937614 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:28:07.938867 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:28:07.940165 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:28:07.994872 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:28:07.996931 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:28:07.998382 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:28:08.000076 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:28:08.001690 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:28:08.003064 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:28:08.004578 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:28:08.006005 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:28:08.007772 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:28:08.010426 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:28:08.011831 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:28:08.013669 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:28:08.019203 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:28:08.020627 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:28:08.021838 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:28:08.023408 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:28:08.024996 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:28:08.026103 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:28:08.027497 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:28:08.028637 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:28:08.030006 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:28:08.031694 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:28:08.033008 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:28:08.034304 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:28:08.035897 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:28:08.037234 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:28:08.039666 [ 10252 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:28:08.084907 [ 10252 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:28:08.090609 [ 10252 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:28:08.899531 [ 10252 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:28:08.900512 [ 10252 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:28:08.901338 [ 10252 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:28:09.639412 [ 10252 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:28:09.640169 [ 10252 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:28:09.642273 [ 10252 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:28:09.644953 [ 10252 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:09.652642 [ 10252 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:09.659782 [ 10252 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:09.755661 [ 10252 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:28:09.756799 [ 10252 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:09.762749 [ 10252 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:28:09.768453 [ 10252 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:09.866216 [ 10252 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:09.868964 [ 10252 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:28:09.870292 [ 10252 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:28:09.885841 [ 10252 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:28:09.886685 [ 10252 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:28:09.887377 [ 10252 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:28:09.888123 [ 10252 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:28:09.888894 [ 10252 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:28:09.890354 [ 10252 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:09.891565 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.111577 [ 10252 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:10.125604 [ 10252 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:10.141385 [ 10252 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:10.255771 [ 10252 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/nlq/kotxhfnosijqctnzixawxihdfsjuv 2025.04.02 03:28:10.287021 [ 10252 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/nlq/kotxhfnosijqctnzixawxihdfsjuv. 2025.04.02 03:28:10.416666 [ 10846 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/nlq/kotxhfnosijqctnzixawxihdfsjuv, size 4 2025.04.02 03:28:10.418587 [ 10252 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/nlq/kotxhfnosijqctnzixawxihdfsjuv. 2025.04.02 03:28:10.445531 [ 10252 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/nlq/kotxhfnosijqctnzixawxihdfsjuv 2025.04.02 03:28:10.446234 [ 10252 ] {} deleteFileFromS3: Object with path s3/nlq/kotxhfnosijqctnzixawxihdfsjuv was removed from S3 2025.04.02 03:28:10.446878 [ 10252 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:28:10.448032 [ 10252 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:28:10.469840 [ 10252 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:10.472393 [ 10252 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:10.473099 [ 10252 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:10.699347 [ 10252 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:28:10.700479 [ 10252 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:28:10 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C1E3D9EE710 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:28:10.703150 [ 10252 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:28:10.716318 [ 10252 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:28:10.716985 [ 10252 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:28:10.717832 [ 10252 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:28:10.718931 [ 10252 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:28:10.720394 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.721624 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.722957 [ 10252 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:10.724266 [ 10252 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:10.725765 [ 10252 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:28:10.726998 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.728235 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.729368 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.730493 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.731642 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:10.759900 [ 10252 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:10.764180 [ 10252 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:10.765022 [ 10252 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:10.944682 [ 10252 ] {} deleteFileFromS3: No blob storage log, not writing blob special/mzm/ictefsdysbhdobhzefgliwcaoohxf 2025.04.02 03:28:10.949233 [ 10252 ] {} deleteFileFromS3: Object with path special/mzm/ictefsdysbhdobhzefgliwcaoohxf was removed from S3 2025.04.02 03:28:10.989336 [ 10252 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:28:10.995022 [ 10252 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:28:11.237932 [ 10252 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:11.242548 [ 10252 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:11.254037 [ 10252 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:11.363786 [ 10252 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/jvt/xdyskyhtdzuqzaalfgvxcrgpdjsud 2025.04.02 03:28:11.364549 [ 10252 ] {} deleteFileFromS3: Object with path test_02944/jvt/xdyskyhtdzuqzaalfgvxcrgpdjsud was removed from S3 2025.04.02 03:28:11.365285 [ 10252 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:28:11.366214 [ 10252 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:28:11.367428 [ 10252 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:11.395292 [ 10252 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:11.417926 [ 10252 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:28:11.418766 [ 10252 ] {} KeeperSnapshotManager: Found snapshot_12.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:11.419492 [ 10252 ] {} KeeperSnapshotManager: Found snapshot_11.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:11.420146 [ 10252 ] {} KeeperSnapshotManager: Found snapshot_13.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:11.437358 [ 10252 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:28:11.438164 [ 10252 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:28:11.448857 [ 10252 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:28:11.449717 [ 10252 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:28:11.450429 [ 10252 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:28:11.450971 [ 10252 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 13 2025.04.02 03:28:11.458220 [ 10252 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:28:11.459562 [ 10252 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 13 2025.04.02 03:28:11.462706 [ 10252 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 13 entries 2025.04.02 03:28:11.463776 [ 10252 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:28:11.464693 [ 10252 ] {} KeeperServer: Last local log idx 13 2025.04.02 03:28:11.465892 [ 10252 ] {} KeeperServer: Will use config from log store with log index 13 2025.04.02 03:28:11.474528 [ 10252 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:28:11.485494 [ 10252 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:28:11.488995 [ 10252 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:28:11.491663 [ 10252 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:28:11.492489 [ 10252 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:28:11.493740 [ 10252 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:28:11.495262 [ 10252 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:28:11.496806 [ 10252 ] {} RaftInstance: === INIT RAFT SERVER === commit index 13 term 13 election timer allowed log store start 1, end 13 config log idx 13, prev log idx 12 -- ASYNC REPLICATION -- 2025.04.02 03:28:11.497883 [ 10252 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:28:11.499611 [ 10252 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:28:11.500750 [ 10252 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:28:11.500983 [ 10878 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:28:11.553608 [ 10862 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:28:11.554477 [ 10862 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:28:11.556227 [ 10862 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 13, state term 13, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:28:11.556943 [ 10862 ] {} RaftInstance: pre-vote term (0) is different, reset it to 13 2025.04.02 03:28:11.558092 [ 10862 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:28:11.563114 [ 10252 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:28:11.563209 [ 10862 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 14, log idx 13, log term 13, priority (target 1 / mine 1) 2025.04.02 03:28:11.564337 [ 10862 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:28:11.566291 [ 10862 ] {} RaftInstance: state machine commit index 13, precommit index 13, last log index 13 2025.04.02 03:28:11.569685 [ 10862 ] {} RaftInstance: [BECOME LEADER] appended new config at 14 2025.04.02 03:28:11.573853 [ 10877 ] {} RaftInstance: config at index 14 is committed, prev config log idx 13 2025.04.02 03:28:11.574852 [ 10877 ] {} RaftInstance: new config log idx 14, prev log idx 13, cur config log idx 13, prev log idx 12 2025.04.02 03:28:11.575574 [ 10877 ] {} RaftInstance: new configuration: log idx 14, prev log idx 13 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 14 2025.04.02 03:28:11.578815 [ 10252 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:28:11.580076 [ 10252 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:28:11.587978 [ 10252 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:28:11.588850 [ 10252 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:28:11.600910 [ 10252 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:28:11.601567 [ 10252 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:28:11.603228 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:28:11.604495 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:28:11.605477 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:28:11.606742 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:28:11.607854 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:28:11.608955 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:28:11.610112 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:28:11.611362 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:28:11.613229 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:28:11.614569 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:28:11.615856 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:28:11.617229 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:28:11.618304 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:28:11.619595 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:28:11.620884 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:28:11.622185 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:28:11.623365 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:28:11.624641 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:28:11.625896 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:28:11.627212 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:28:11.628404 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:28:11.629908 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:28:11.631306 [ 10252 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:28:11.635706 [ 10252 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:28:11.636530 [ 10252 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:28:12.446895 [ 10252 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:28:12.447946 [ 10252 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:12.450058 [ 10252 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:28:12.453038 [ 10252 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:28:12.459013 [ 10252 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:28:12.459744 [ 10887 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:28:12.516329 [ 10252 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:28:12.522017 [ 10252 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:28:12.531188 [ 10252 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:28:12.565117 [ 10252 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:28:12.573499 [ 10252 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:28:12.579035 [ 10252 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:28:12.588336 [ 10252 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:28:12.589650 [ 10252 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:28:12.590161 [ 10265 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:28:12.693378 [ 10265 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:28:17.345214 [ 10252 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:17.346271 [ 10252 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:28:17.350422 [ 10252 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:28:17.351127 [ 10252 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:28:17.352117 [ 10264 ] {} CancellationChecker: Execution took 9631 ms. 2025.04.02 03:28:17.427060 [ 10252 ] {} Application: Shutting down storages. 2025.04.02 03:28:17.435791 [ 10252 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:28:17.442516 [ 10252 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:28:17.443108 [ 10252 ] {} Context: Shutting down workload entity storage 2025.04.02 03:28:17.443779 [ 10252 ] {} Context: Shutting down named sessions 2025.04.02 03:28:17.445267 [ 10252 ] {} Context: Shutting down database catalog 2025.04.02 03:28:17.446099 [ 10252 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:28:17.447364 [ 10252 ] {} Context: Shutting down merges executor 2025.04.02 03:28:17.449858 [ 10252 ] {} Context: Shutting down fetches executor 2025.04.02 03:28:17.452451 [ 10252 ] {} Context: Shutting down moves executor 2025.04.02 03:28:17.454331 [ 10252 ] {} Context: Shutting down common executor 2025.04.02 03:28:17.460074 [ 10252 ] {} Context: Shutting down DDLWorker 2025.04.02 03:28:17.460801 [ 10252 ] {} Context: Shutting down caches 2025.04.02 03:28:17.462039 [ 10252 ] {} Context: Shutting down AccessControl 2025.04.02 03:28:17.466690 [ 10252 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:28:17.481961 [ 10252 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:28:17.637440 [ 10252 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:28:17.758586 [ 10252 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:28:17.997390 [ 10252 ] {} Application: Shut down storages. 2025.04.02 03:28:18.009737 [ 10252 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:28:18.348973 [ 10252 ] {} Application: Closed all listening sockets. 2025.04.02 03:28:18.350309 [ 10252 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:28:18.352092 [ 10252 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:28:18.587138 [ 10252 ] {} RaftInstance: shutting down raft core 2025.04.02 03:28:18.617402 [ 10252 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:28:18.629819 [ 10252 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:28:18.645731 [ 10252 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:28:18.667020 [ 10252 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:28:18.668103 [ 10252 ] {} RaftInstance: reset all pointers. 2025.04.02 03:28:18.669482 [ 10252 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:28:18.681777 [ 10878 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:28:18.683210 [ 10252 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:28:18.709706 [ 10252 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:28:18.710650 [ 10252 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:28:18.711842 [ 10252 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:28:18.712785 [ 10252 ] {} RaftInstance: manually create a snapshot on 14 2025.04.02 03:28:18.718883 [ 10252 ] {} RaftInstance: creating a snapshot for index 14 2025.04.02 03:28:18.745833 [ 10252 ] {} RaftInstance: create snapshot idx 14 log_term 14 2025.04.02 03:28:18.761864 [ 10252 ] {} KeeperStateMachine: Creating snapshot 14 2025.04.02 03:28:18.763107 [ 10252 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:28:18.780970 [ 10252 ] {} KeeperStateMachine: Created persistent snapshot 14 with path snapshot_14.bin.zstd 2025.04.02 03:28:18.781891 [ 10252 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:28:18.809686 [ 10252 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:28:18.810758 [ 10252 ] {} RaftInstance: snapshot idx 14 log_term 14 created, compact the log store if needed 2025.04.02 03:28:18.825467 [ 10252 ] {} RaftInstance: create snapshot idx 14 log_term 14 done: 51302 us elapsed 2025.04.02 03:28:18.842953 [ 10865 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:28:18.844418 [ 10866 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:28:18.844809 [ 10873 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:28:18.844913 [ 10870 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:28:18.845050 [ 10869 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:18.844925 [ 10868 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:28:18.845363 [ 10872 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:18.845172 [ 10871 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:18.845730 [ 10861 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:18.845572 [ 10876 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:28:18.845408 [ 10875 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:28:18.845830 [ 10862 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:28:18.845983 [ 10863 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:18.846069 [ 10867 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:18.846212 [ 10874 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:18.846383 [ 10864 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:18.846519 [ 10865 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:18.850384 [ 10252 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:18.851294 [ 10860 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:28:18.910074 [ 10252 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:28:18.911479 [ 10252 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:28:18.912280 [ 10252 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:28:18.935341 [ 10252 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:28:18.936624 [ 10252 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:18.938870 [ 10252 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:18.939796 [ 10252 ] {} Context: Destructing threadpool writer 2025.04.02 03:28:19.052486 [ 10252 ] {} Application: Destroyed global context. 2025.04.02 03:28:19.054548 [ 10252 ] {} Application: Waiting for background threads 2025.04.02 03:28:19.154120 [ 10252 ] {} Application: Background threads finished in 99 ms 2025.04.02 03:28:19.158186 [ 10252 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:28:19.158858 [ 10252 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:19.278302 [ 10252 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:19.279422 [ 10252 ] {} Application: shutting down 2025.04.02 03:28:19.280019 [ 10252 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:28:19.281867 [ 10253 ] {} BaseDaemon: Received signal -2 2025.04.02 03:28:19.282768 [ 10253 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:28:19.391106 [ 10251 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:28:19.823206 [ 10993 ] {} Application: Will watch for the process with pid 10994 2025.04.02 03:28:19.823407 [ 10994 ] {} Application: Forked a child process to watch 2025.04.02 03:28:19.824430 [ 10994 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:28:19.931298 [ 10994 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 10994 2025.04.02 03:28:19.931742 [ 10994 ] {} Application: starting up 2025.04.02 03:28:19.931763 [ 10994 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:28:19.940908 [ 10994 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:28:19.943722 [ 10994 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:28:19.945554 [ 10994 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:28:19.946472 [ 10994 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:28:19.947618 [ 10994 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:28:19.948757 [ 10994 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:28:19.954114 [ 10994 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:28:19.955509 [ 10994 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:28:19.956311 [ 10994 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:28:19.957008 [ 10994 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:28:19.957833 [ 10994 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:28:21.557220 [ 10994 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:28:21.589885 [ 10994 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:28:21.650351 [ 10994 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:28:21.651920 [ 10994 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:28:21.654154 [ 10994 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:28:22.004089 [ 11006 ] {} CancellationChecker: Started worker function 2025.04.02 03:28:22.050329 [ 10994 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:28:22.051126 [ 10994 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:28:22.053094 [ 10994 ] {} Application: Initializing DateLUT. 2025.04.02 03:28:22.053888 [ 10994 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:28:22.055353 [ 10994 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:28:22.058405 [ 10994 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:28:22.065246 [ 10994 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:28:22.066162 [ 10994 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:28:22.067032 [ 10994 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:28:22.069657 [ 10994 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:28:22.070818 [ 10994 ] {} Application: Initializing interserver credentials. 2025.04.02 03:28:22.079042 [ 10994 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:28:22.496869 [ 10994 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:28:22.499769 [ 10994 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:28:22.506387 [ 10994 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:28:22.507206 [ 10994 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:28:22.511584 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:28:22.513316 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:28:22.514909 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:28:22.516305 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:28:22.517504 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:28:22.520748 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:28:22.522272 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:28:22.523778 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:28:22.525291 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:28:22.526873 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:28:22.528327 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:28:22.529961 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:28:22.531376 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:28:22.532924 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:28:22.534522 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:28:22.535935 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:28:22.607708 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:28:22.609229 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:28:22.611011 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:28:22.612643 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:28:22.614235 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:28:22.615616 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:28:22.617140 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:28:22.619054 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:28:22.620412 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:28:22.621654 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:28:22.626393 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:28:22.627672 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:28:22.629025 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:28:22.630479 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:28:22.631905 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:28:22.633285 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:28:22.634673 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:28:22.636107 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:28:22.637667 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:28:22.638942 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:28:22.640293 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:28:22.641822 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:28:22.643533 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:28:22.645527 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:28:22.647320 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:28:22.649015 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:28:22.655100 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:28:22.656785 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:28:22.658408 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:28:22.660089 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:28:22.661687 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:28:22.663136 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:28:22.665742 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:28:22.667487 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:28:22.669329 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:28:22.670914 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:28:22.672515 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:28:22.674058 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:28:22.675899 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:28:22.677320 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:28:22.678516 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:28:22.680010 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:28:22.681555 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:28:22.683168 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:28:22.684824 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:28:22.686409 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:28:22.687751 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:28:22.689327 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:28:22.691077 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:28:22.693548 [ 10994 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:28:22.720442 [ 10994 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:28:22.794919 [ 10994 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:28:23.726772 [ 10994 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:28:23.727579 [ 10994 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:28:23.728410 [ 10994 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:28:24.492694 [ 10994 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:28:24.493435 [ 10994 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:28:24.495369 [ 10994 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:28:24.504347 [ 10994 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:24.511849 [ 10994 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:24.519415 [ 10994 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:24.821837 [ 10994 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:28:24.838508 [ 10994 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:24.909451 [ 10994 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:28:24.966876 [ 10994 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:24.981942 [ 10994 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:24.997698 [ 10994 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:28:25.030538 [ 10994 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:28:25.147209 [ 10994 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:28:25.161284 [ 10994 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:28:25.162219 [ 10994 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:28:25.172782 [ 10994 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:28:25.173464 [ 10994 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:28:25.175149 [ 10994 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:25.176357 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.249634 [ 10994 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:25.253832 [ 10994 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:25.254499 [ 10994 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:25.264614 [ 10994 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/ikw/njkbowzzmqtrfopvuonsmgybymudr 2025.04.02 03:28:25.313503 [ 10994 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/ikw/njkbowzzmqtrfopvuonsmgybymudr. 2025.04.02 03:28:25.331813 [ 11589 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/ikw/njkbowzzmqtrfopvuonsmgybymudr, size 4 2025.04.02 03:28:25.333299 [ 10994 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/ikw/njkbowzzmqtrfopvuonsmgybymudr. 2025.04.02 03:28:25.358114 [ 10994 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/ikw/njkbowzzmqtrfopvuonsmgybymudr 2025.04.02 03:28:25.358716 [ 10994 ] {} deleteFileFromS3: Object with path s3/ikw/njkbowzzmqtrfopvuonsmgybymudr was removed from S3 2025.04.02 03:28:25.359380 [ 10994 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:28:25.360164 [ 10994 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:28:25.418103 [ 10994 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:25.422446 [ 10994 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:25.423313 [ 10994 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:25.471625 [ 10994 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:28:25.472672 [ 10994 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:28:25 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C21AE1E44EB x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:28:25.475116 [ 10994 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:28:25.487609 [ 10994 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:28:25.488312 [ 10994 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:28:25.489058 [ 10994 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:28:25.490106 [ 10994 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:28:25.491336 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.492588 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.493996 [ 10994 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:25.495184 [ 10994 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:25.496446 [ 10994 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:28:25.497720 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.498898 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.499777 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.500914 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.502015 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.524820 [ 10994 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:25.529060 [ 10994 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:25.529764 [ 10994 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:25.573895 [ 10994 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ogt/gkegrwyzfllvptbdrivazngamxjqo 2025.04.02 03:28:25.576705 [ 10994 ] {} deleteFileFromS3: Object with path special/ogt/gkegrwyzfllvptbdrivazngamxjqo was removed from S3 2025.04.02 03:28:25.577367 [ 10994 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:28:25.578211 [ 10994 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:28:25.601421 [ 10994 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:25.605845 [ 10994 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:25.606569 [ 10994 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:25.648200 [ 10994 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ivk/sgsyjdkaialvhujukqsdeczoasoxq 2025.04.02 03:28:25.648721 [ 10994 ] {} deleteFileFromS3: Object with path test_02944/ivk/sgsyjdkaialvhujukqsdeczoasoxq was removed from S3 2025.04.02 03:28:25.649445 [ 10994 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:28:25.650334 [ 10994 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:28:25.652676 [ 10994 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:25.739723 [ 10994 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:26.011561 [ 10994 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:28:26.012279 [ 10994 ] {} KeeperSnapshotManager: Found snapshot_12.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:26.012871 [ 10994 ] {} KeeperSnapshotManager: Found snapshot_14.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:26.013606 [ 10994 ] {} KeeperSnapshotManager: Found snapshot_13.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:26.042543 [ 10994 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:28:26.043238 [ 10994 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:28:26.044944 [ 10994 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:28:26.100922 [ 10994 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:28:26.112657 [ 10994 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:28:26.113650 [ 10994 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 14 2025.04.02 03:28:26.121546 [ 10994 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:28:26.123073 [ 10994 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 14 2025.04.02 03:28:26.126943 [ 10994 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 14 entries 2025.04.02 03:28:26.127929 [ 10994 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:28:26.128870 [ 10994 ] {} KeeperServer: Last local log idx 14 2025.04.02 03:28:26.130227 [ 10994 ] {} KeeperServer: Will use config from log store with log index 14 2025.04.02 03:28:26.150516 [ 10994 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:28:26.166789 [ 10994 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:28:26.170710 [ 10994 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:28:26.173098 [ 10994 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:28:26.174016 [ 10994 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:28:26.175078 [ 10994 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:28:26.176648 [ 10994 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:28:26.178524 [ 10994 ] {} RaftInstance: === INIT RAFT SERVER === commit index 14 term 14 election timer allowed log store start 1, end 14 config log idx 14, prev log idx 13 -- ASYNC REPLICATION -- 2025.04.02 03:28:26.179996 [ 10994 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:28:26.181600 [ 10994 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:28:26.182948 [ 10994 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:28:26.183310 [ 11620 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:28:26.235709 [ 11606 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:28:26.236519 [ 11606 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:28:26.237269 [ 10994 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:28:26.238277 [ 11606 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 14, state term 14, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:28:26.238837 [ 11606 ] {} RaftInstance: pre-vote term (0) is different, reset it to 14 2025.04.02 03:28:26.240116 [ 11606 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:28:26.333216 [ 11606 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 15, log idx 14, log term 14, priority (target 1 / mine 1) 2025.04.02 03:28:26.336984 [ 11606 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:28:26.339032 [ 11606 ] {} RaftInstance: state machine commit index 14, precommit index 14, last log index 14 2025.04.02 03:28:26.342407 [ 11606 ] {} RaftInstance: [BECOME LEADER] appended new config at 15 2025.04.02 03:28:26.346222 [ 11619 ] {} RaftInstance: config at index 15 is committed, prev config log idx 14 2025.04.02 03:28:26.347150 [ 11619 ] {} RaftInstance: new config log idx 15, prev log idx 14, cur config log idx 14, prev log idx 13 2025.04.02 03:28:26.347977 [ 11619 ] {} RaftInstance: new configuration: log idx 15, prev log idx 14 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 15 2025.04.02 03:28:26.351169 [ 10994 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:28:26.352408 [ 10994 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:28:26.359740 [ 10994 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:28:26.360474 [ 10994 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:28:26.413559 [ 10994 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:28:26.417872 [ 10994 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:28:26.419981 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:28:26.421380 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:28:26.422387 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:28:26.423638 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:28:26.425062 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:28:26.426261 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:28:26.427529 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:28:26.428972 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:28:26.430851 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:28:26.432082 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:28:26.433393 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:28:26.434871 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:28:26.436015 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:28:26.437338 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:28:26.438595 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:28:26.439869 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:28:26.440906 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:28:26.442151 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:28:26.443575 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:28:26.444975 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:28:26.446375 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:28:26.447877 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:28:26.449435 [ 10994 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:28:26.452675 [ 10994 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:28:26.453469 [ 10994 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:28:27.156737 [ 10994 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:28:27.157953 [ 10994 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:27.160017 [ 10994 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:28:27.162906 [ 10994 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:28:27.168966 [ 10994 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:28:27.169577 [ 11629 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:28:27.223673 [ 10994 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:28:27.229704 [ 10994 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:28:27.239340 [ 10994 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:28:27.244991 [ 10994 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:28:27.253046 [ 10994 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:28:27.258896 [ 10994 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:28:27.267438 [ 10994 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:28:27.268685 [ 10994 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:28:27.268750 [ 11007 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:28:27.276829 [ 11007 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:28:31.486112 [ 10994 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:31.492004 [ 10994 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:28:31.509506 [ 10994 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:28:31.510314 [ 10994 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:28:31.511399 [ 11006 ] {} CancellationChecker: Execution took 9507 ms. 2025.04.02 03:28:31.519137 [ 10994 ] {} Application: Shutting down storages. 2025.04.02 03:28:31.525358 [ 10994 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:28:31.587187 [ 10994 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:28:31.593566 [ 10994 ] {} Context: Shutting down workload entity storage 2025.04.02 03:28:31.609419 [ 10994 ] {} Context: Shutting down named sessions 2025.04.02 03:28:31.617571 [ 10994 ] {} Context: Shutting down database catalog 2025.04.02 03:28:31.618628 [ 10994 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:28:31.645233 [ 10994 ] {} Context: Shutting down merges executor 2025.04.02 03:28:31.648257 [ 10994 ] {} Context: Shutting down fetches executor 2025.04.02 03:28:31.650908 [ 10994 ] {} Context: Shutting down moves executor 2025.04.02 03:28:31.652907 [ 10994 ] {} Context: Shutting down common executor 2025.04.02 03:28:31.661139 [ 10994 ] {} Context: Shutting down DDLWorker 2025.04.02 03:28:31.668090 [ 10994 ] {} Context: Shutting down caches 2025.04.02 03:28:31.695860 [ 10994 ] {} Context: Shutting down AccessControl 2025.04.02 03:28:31.766009 [ 10994 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:28:31.896177 [ 10994 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:28:32.035361 [ 10994 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:28:32.041253 [ 10994 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:28:32.057252 [ 10994 ] {} Application: Shut down storages. 2025.04.02 03:28:32.057974 [ 10994 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:28:32.369553 [ 10994 ] {} Application: Closed all listening sockets. 2025.04.02 03:28:32.370392 [ 10994 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:28:32.371849 [ 10994 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:28:32.858565 [ 10994 ] {} RaftInstance: shutting down raft core 2025.04.02 03:28:32.860259 [ 10994 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:28:32.861105 [ 10994 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:28:32.861974 [ 10994 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:28:32.863484 [ 10994 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:28:32.864587 [ 10994 ] {} RaftInstance: reset all pointers. 2025.04.02 03:28:32.865840 [ 10994 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:28:32.867100 [ 11620 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:28:32.867316 [ 10994 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:28:32.868748 [ 10994 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:28:32.870582 [ 10994 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:28:32.871609 [ 10994 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:28:32.872366 [ 10994 ] {} RaftInstance: manually create a snapshot on 15 2025.04.02 03:28:32.874402 [ 10994 ] {} RaftInstance: creating a snapshot for index 15 2025.04.02 03:28:32.875409 [ 10994 ] {} RaftInstance: create snapshot idx 15 log_term 15 2025.04.02 03:28:32.876504 [ 10994 ] {} KeeperStateMachine: Creating snapshot 15 2025.04.02 03:28:32.877615 [ 10994 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:28:32.881146 [ 10994 ] {} KeeperStateMachine: Created persistent snapshot 15 with path snapshot_15.bin.zstd 2025.04.02 03:28:32.882036 [ 10994 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:28:32.882710 [ 10994 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:28:32.883568 [ 10994 ] {} RaftInstance: snapshot idx 15 log_term 15 created, compact the log store if needed 2025.04.02 03:28:32.885548 [ 10994 ] {} RaftInstance: create snapshot idx 15 log_term 15 done: 9041 us elapsed 2025.04.02 03:28:32.887187 [ 11603 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:28:32.889217 [ 11605 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:28:32.889392 [ 11610 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:28:32.889735 [ 11616 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:28:32.889809 [ 11618 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:32.890031 [ 11611 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:28:32.890061 [ 11608 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:28:32.890341 [ 11614 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:28:32.890124 [ 11612 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:28:32.890620 [ 11615 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:28:32.890716 [ 11613 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:28:32.890806 [ 11607 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:32.890980 [ 11604 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:32.891070 [ 11617 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:32.891511 [ 11603 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:32.891292 [ 11609 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:32.891185 [ 11606 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:32.898429 [ 10994 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:32.899242 [ 11602 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:28:32.903063 [ 10994 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:28:32.904435 [ 10994 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:28:32.905061 [ 10994 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:28:33.007064 [ 10994 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:28:33.008353 [ 10994 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:33.010712 [ 10994 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:33.011528 [ 10994 ] {} Context: Destructing threadpool writer 2025.04.02 03:28:33.053967 [ 10994 ] {} Application: Destroyed global context. 2025.04.02 03:28:33.055964 [ 10994 ] {} Application: Waiting for background threads 2025.04.02 03:28:33.231823 [ 10994 ] {} Application: Background threads finished in 175 ms 2025.04.02 03:28:33.297670 [ 10994 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:28:33.298497 [ 10994 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:33.542098 [ 10994 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:33.551527 [ 10994 ] {} Application: shutting down 2025.04.02 03:28:33.552168 [ 10994 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:28:33.554342 [ 10995 ] {} BaseDaemon: Received signal -2 2025.04.02 03:28:33.555347 [ 10995 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:28:33.664341 [ 10993 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:28:34.525484 [ 11735 ] {} Application: Will watch for the process with pid 11736 2025.04.02 03:28:34.525663 [ 11736 ] {} Application: Forked a child process to watch 2025.04.02 03:28:34.526472 [ 11736 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:28:34.634888 [ 11736 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 11736 2025.04.02 03:28:34.635323 [ 11736 ] {} Application: starting up 2025.04.02 03:28:34.635344 [ 11736 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:28:34.644675 [ 11736 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:28:34.646263 [ 11736 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:28:34.647813 [ 11736 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:28:34.648648 [ 11736 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:28:34.649556 [ 11736 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:28:34.650639 [ 11736 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:28:34.655538 [ 11736 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:28:34.656659 [ 11736 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:28:34.657427 [ 11736 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:28:34.658417 [ 11736 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:28:34.659178 [ 11736 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:28:36.637442 [ 11736 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:28:36.639530 [ 11736 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:28:36.703323 [ 11736 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:28:36.705045 [ 11736 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:28:36.707255 [ 11736 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:28:37.259179 [ 12264 ] {} CancellationChecker: Started worker function 2025.04.02 03:28:37.260035 [ 11736 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:28:37.260783 [ 11736 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:28:37.262667 [ 11736 ] {} Application: Initializing DateLUT. 2025.04.02 03:28:37.263323 [ 11736 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:28:37.264858 [ 11736 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:28:37.267933 [ 11736 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:28:37.274110 [ 11736 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:28:37.275061 [ 11736 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:28:37.275979 [ 11736 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:28:37.278470 [ 11736 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:28:37.279546 [ 11736 ] {} Application: Initializing interserver credentials. 2025.04.02 03:28:37.288274 [ 11736 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:28:37.337555 [ 11736 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:28:37.339816 [ 11736 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:28:37.346741 [ 11736 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:28:37.347470 [ 11736 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:28:37.351496 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:28:37.353228 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:28:37.354497 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:28:37.355971 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:28:37.412077 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:28:37.415600 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:28:37.417069 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:28:37.418656 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:28:37.420020 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:28:37.421514 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:28:37.422771 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:28:37.424068 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:28:37.425329 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:28:37.426443 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:28:37.427894 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:28:37.429429 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:28:37.430836 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:28:37.432349 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:28:37.520239 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:28:37.522052 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:28:37.523936 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:28:37.526965 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:28:37.528605 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:28:37.530617 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:28:37.532167 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:28:37.533446 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:28:37.535177 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:28:37.536849 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:28:37.538254 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:28:37.539762 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:28:37.541374 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:28:37.542846 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:28:37.553930 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:28:37.555590 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:28:37.557303 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:28:37.558861 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:28:37.560533 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:28:37.562163 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:28:37.563830 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:28:37.566038 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:28:37.567791 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:28:37.569621 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:28:37.571351 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:28:37.572807 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:28:37.574384 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:28:37.576031 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:28:37.577594 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:28:37.579084 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:28:37.581590 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:28:37.583351 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:28:37.585028 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:28:37.586828 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:28:37.588252 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:28:37.589951 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:28:37.591526 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:28:37.592797 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:28:37.593840 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:28:37.595351 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:28:37.596760 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:28:37.598312 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:28:37.599858 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:28:37.601401 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:28:37.602986 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:28:37.604570 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:28:37.605950 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:28:37.608088 [ 11736 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:28:37.753391 [ 11736 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:28:37.802412 [ 11736 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:28:38.860630 [ 11736 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:28:38.893577 [ 11736 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:28:38.894428 [ 11736 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:28:39.724033 [ 11736 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:28:39.724718 [ 11736 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:28:39.726379 [ 11736 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:28:39.728460 [ 11736 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:39.734612 [ 11736 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:39.740223 [ 11736 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:39.908814 [ 11736 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:28:39.909886 [ 11736 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:39.916125 [ 11736 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:28:39.962802 [ 11736 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:39.965061 [ 11736 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:39.967428 [ 11736 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:28:39.968925 [ 11736 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:28:40.074405 [ 11736 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:28:40.075096 [ 11736 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:28:40.075865 [ 11736 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:28:40.076632 [ 11736 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:28:40.077397 [ 11736 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:28:40.079045 [ 11736 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:40.080351 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.152854 [ 11736 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:40.157313 [ 11736 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:40.157988 [ 11736 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:40.175500 [ 11736 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/nnx/dciaaycyshsixkkdfhizitotjjqar 2025.04.02 03:28:40.177401 [ 11736 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/nnx/dciaaycyshsixkkdfhizitotjjqar. 2025.04.02 03:28:40.238097 [ 12331 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/nnx/dciaaycyshsixkkdfhizitotjjqar, size 4 2025.04.02 03:28:40.255163 [ 11736 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/nnx/dciaaycyshsixkkdfhizitotjjqar. 2025.04.02 03:28:40.538506 [ 11736 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/nnx/dciaaycyshsixkkdfhizitotjjqar 2025.04.02 03:28:40.539292 [ 11736 ] {} deleteFileFromS3: Object with path s3/nnx/dciaaycyshsixkkdfhizitotjjqar was removed from S3 2025.04.02 03:28:40.553829 [ 11736 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:28:40.589970 [ 11736 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:28:40.628983 [ 11736 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:40.633523 [ 11736 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:40.634133 [ 11736 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:40.716800 [ 11736 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:28:40.717917 [ 11736 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:28:40 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C253ACC98FD x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:28:40.720235 [ 11736 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:28:40.732549 [ 11736 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:28:40.733214 [ 11736 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:28:40.733963 [ 11736 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:28:40.734886 [ 11736 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:28:40.736038 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.737163 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.738301 [ 11736 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:40.739471 [ 11736 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:40.740598 [ 11736 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:28:40.741932 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.743082 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.744250 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.745292 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.746402 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.769311 [ 11736 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:40.773744 [ 11736 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:40.774640 [ 11736 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:40.875574 [ 11736 ] {} deleteFileFromS3: No blob storage log, not writing blob special/cch/jeppvkwafkfyivznsyfpjigelsxlw 2025.04.02 03:28:40.876321 [ 11736 ] {} deleteFileFromS3: Object with path special/cch/jeppvkwafkfyivznsyfpjigelsxlw was removed from S3 2025.04.02 03:28:40.877053 [ 11736 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:28:40.878140 [ 11736 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:28:40.909542 [ 11736 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:40.914679 [ 11736 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:40.915580 [ 11736 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:40.960301 [ 11736 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/dll/cmerosmlkqwessumixfkybmbkfpbt 2025.04.02 03:28:40.961128 [ 11736 ] {} deleteFileFromS3: Object with path test_02944/dll/cmerosmlkqwessumixfkybmbkfpbt was removed from S3 2025.04.02 03:28:40.961937 [ 11736 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:28:40.962852 [ 11736 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:28:40.964059 [ 11736 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:40.991603 [ 11736 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:41.013396 [ 11736 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:28:41.014204 [ 11736 ] {} KeeperSnapshotManager: Found snapshot_14.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:41.014777 [ 11736 ] {} KeeperSnapshotManager: Found snapshot_15.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:41.015319 [ 11736 ] {} KeeperSnapshotManager: Found snapshot_13.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:41.072368 [ 11736 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:28:41.073142 [ 11736 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:28:41.074849 [ 11736 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:28:41.075775 [ 11736 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:28:41.076499 [ 11736 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:28:41.077048 [ 11736 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 15 2025.04.02 03:28:41.087513 [ 11736 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:28:41.089004 [ 11736 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 15 2025.04.02 03:28:41.092355 [ 11736 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 15 entries 2025.04.02 03:28:41.093430 [ 11736 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:28:41.094532 [ 11736 ] {} KeeperServer: Last local log idx 15 2025.04.02 03:28:41.095579 [ 11736 ] {} KeeperServer: Will use config from log store with log index 15 2025.04.02 03:28:41.105361 [ 11736 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:28:41.241296 [ 11736 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:28:41.250905 [ 11736 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:28:41.260161 [ 11736 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:28:41.261154 [ 11736 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:28:41.262413 [ 11736 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:28:41.273495 [ 11736 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:28:41.278497 [ 11736 ] {} RaftInstance: === INIT RAFT SERVER === commit index 15 term 15 election timer allowed log store start 1, end 15 config log idx 15, prev log idx 14 -- ASYNC REPLICATION -- 2025.04.02 03:28:41.289762 [ 11736 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:28:41.332141 [ 11736 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:28:41.333802 [ 11736 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:28:41.334121 [ 12365 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:28:41.386903 [ 12345 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:28:41.388029 [ 11736 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:28:41.388576 [ 12345 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:28:41.417818 [ 12345 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 15, state term 15, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:28:41.437509 [ 12345 ] {} RaftInstance: pre-vote term (0) is different, reset it to 15 2025.04.02 03:28:41.439092 [ 12345 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:28:41.444378 [ 12345 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 16, log idx 15, log term 15, priority (target 1 / mine 1) 2025.04.02 03:28:41.454550 [ 12345 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:28:41.456841 [ 12345 ] {} RaftInstance: state machine commit index 15, precommit index 15, last log index 15 2025.04.02 03:28:41.460729 [ 12345 ] {} RaftInstance: [BECOME LEADER] appended new config at 16 2025.04.02 03:28:41.465458 [ 12364 ] {} RaftInstance: config at index 16 is committed, prev config log idx 15 2025.04.02 03:28:41.466666 [ 12364 ] {} RaftInstance: new config log idx 16, prev log idx 15, cur config log idx 15, prev log idx 14 2025.04.02 03:28:41.467623 [ 12364 ] {} RaftInstance: new configuration: log idx 16, prev log idx 15 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 16 2025.04.02 03:28:41.471359 [ 11736 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:28:41.472755 [ 11736 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:28:41.481817 [ 11736 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:28:41.482605 [ 11736 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:28:41.499176 [ 11736 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:28:41.499812 [ 11736 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:28:41.501609 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:28:41.503043 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:28:41.504043 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:28:41.505400 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:28:41.506829 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:28:41.508030 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:28:41.509357 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:28:41.510687 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:28:41.512822 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:28:41.514305 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:28:41.515582 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:28:41.516877 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:28:41.518226 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:28:41.519511 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:28:41.520621 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:28:41.521771 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:28:41.523094 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:28:41.524523 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:28:41.525968 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:28:41.527344 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:28:41.528596 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:28:41.529916 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:28:41.531379 [ 11736 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:28:41.537365 [ 11736 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:28:41.538105 [ 11736 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:28:42.117573 [ 11736 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:28:42.134570 [ 11736 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:42.136521 [ 11736 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:28:42.151665 [ 11736 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:28:42.209856 [ 11736 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:28:42.221820 [ 12374 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:28:42.433289 [ 11736 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:28:42.449501 [ 11736 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:28:42.460055 [ 11736 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:28:42.466052 [ 11736 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:28:42.474468 [ 11736 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:28:42.480407 [ 11736 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:28:42.489594 [ 11736 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:28:42.490991 [ 11736 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:28:42.491077 [ 11749 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:28:42.499648 [ 11749 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:28:47.012294 [ 11736 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:47.013539 [ 11736 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:28:47.029238 [ 11736 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:28:47.030141 [ 11736 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:28:47.031000 [ 12264 ] {} CancellationChecker: Execution took 9772 ms. 2025.04.02 03:28:47.040623 [ 11736 ] {} Application: Shutting down storages. 2025.04.02 03:28:47.041931 [ 11736 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:28:47.066051 [ 11736 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:28:47.072727 [ 11736 ] {} Context: Shutting down workload entity storage 2025.04.02 03:28:47.080030 [ 11736 ] {} Context: Shutting down named sessions 2025.04.02 03:28:47.101540 [ 11736 ] {} Context: Shutting down database catalog 2025.04.02 03:28:47.137573 [ 11736 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:28:47.153316 [ 11736 ] {} Context: Shutting down merges executor 2025.04.02 03:28:47.201249 [ 11736 ] {} Context: Shutting down fetches executor 2025.04.02 03:28:47.220098 [ 11736 ] {} Context: Shutting down moves executor 2025.04.02 03:28:47.237244 [ 11736 ] {} Context: Shutting down common executor 2025.04.02 03:28:47.249767 [ 11736 ] {} Context: Shutting down DDLWorker 2025.04.02 03:28:47.275382 [ 11736 ] {} Context: Shutting down caches 2025.04.02 03:28:47.276922 [ 11736 ] {} Context: Shutting down AccessControl 2025.04.02 03:28:47.281349 [ 11736 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:28:47.288859 [ 11736 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:28:47.442183 [ 11736 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:28:47.448184 [ 11736 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:28:47.461852 [ 11736 ] {} Application: Shut down storages. 2025.04.02 03:28:47.462480 [ 11736 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:28:47.560718 [ 11736 ] {} Application: Closed all listening sockets. 2025.04.02 03:28:47.561347 [ 11736 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:28:47.562488 [ 11736 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:28:48.013244 [ 11736 ] {} RaftInstance: shutting down raft core 2025.04.02 03:28:48.049757 [ 11736 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:28:48.065300 [ 11736 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:28:48.098964 [ 11736 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:28:48.106338 [ 11736 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:28:48.107502 [ 11736 ] {} RaftInstance: reset all pointers. 2025.04.02 03:28:48.108709 [ 11736 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:28:48.110169 [ 12365 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:28:48.110321 [ 11736 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:28:48.111715 [ 11736 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:28:48.112779 [ 11736 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:28:48.113688 [ 11736 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:28:48.114459 [ 11736 ] {} RaftInstance: manually create a snapshot on 16 2025.04.02 03:28:48.116171 [ 11736 ] {} RaftInstance: creating a snapshot for index 16 2025.04.02 03:28:48.117241 [ 11736 ] {} RaftInstance: create snapshot idx 16 log_term 16 2025.04.02 03:28:48.118454 [ 11736 ] {} KeeperStateMachine: Creating snapshot 16 2025.04.02 03:28:48.119354 [ 11736 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:28:48.123873 [ 11736 ] {} KeeperStateMachine: Created persistent snapshot 16 with path snapshot_16.bin.zstd 2025.04.02 03:28:48.124930 [ 11736 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:28:48.125845 [ 11736 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:28:48.126919 [ 11736 ] {} RaftInstance: snapshot idx 16 log_term 16 created, compact the log store if needed 2025.04.02 03:28:48.128886 [ 11736 ] {} RaftInstance: create snapshot idx 16 log_term 16 done: 10536 us elapsed 2025.04.02 03:28:48.130274 [ 12349 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:28:48.131881 [ 12350 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:28:48.132223 [ 12356 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:28:48.132390 [ 12352 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:48.132519 [ 12360 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:28:48.132699 [ 12355 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:28:48.132770 [ 12351 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:28:48.132968 [ 12347 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:28:48.133058 [ 12346 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:48.133131 [ 12358 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:48.133264 [ 12353 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:48.133365 [ 12345 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:28:48.133479 [ 12354 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:48.133624 [ 12361 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:28:48.133675 [ 12359 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:48.133756 [ 12348 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:48.134241 [ 12349 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:28:48.138709 [ 11736 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:48.139670 [ 12344 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:28:48.143085 [ 11736 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:28:48.144264 [ 11736 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:28:48.144870 [ 11736 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:28:48.146727 [ 11736 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:28:48.147718 [ 11736 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:48.149806 [ 11736 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:28:48.150446 [ 11736 ] {} Context: Destructing threadpool writer 2025.04.02 03:28:48.235425 [ 11736 ] {} Application: Destroyed global context. 2025.04.02 03:28:48.237460 [ 11736 ] {} Application: Waiting for background threads 2025.04.02 03:28:48.310101 [ 11736 ] {} Application: Background threads finished in 72 ms 2025.04.02 03:28:48.313983 [ 11736 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:28:48.314572 [ 11736 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:28:48.339066 [ 11736 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:28:48.340166 [ 11736 ] {} Application: shutting down 2025.04.02 03:28:48.340951 [ 11736 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:28:48.343129 [ 11737 ] {} BaseDaemon: Received signal -2 2025.04.02 03:28:48.344035 [ 11737 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:28:48.462001 [ 11735 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:28:49.122542 [ 12477 ] {} Application: Will watch for the process with pid 12478 2025.04.02 03:28:49.122670 [ 12478 ] {} Application: Forked a child process to watch 2025.04.02 03:28:49.123286 [ 12478 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:28:49.222160 [ 12478 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 12478 2025.04.02 03:28:49.222600 [ 12478 ] {} Application: starting up 2025.04.02 03:28:49.222620 [ 12478 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:28:49.231901 [ 12478 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:28:49.233512 [ 12478 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:28:49.235092 [ 12478 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:28:49.235933 [ 12478 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:28:49.237125 [ 12478 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:28:49.238196 [ 12478 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:28:49.253294 [ 12478 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:28:49.254736 [ 12478 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:28:49.255686 [ 12478 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:28:49.256527 [ 12478 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:28:49.257353 [ 12478 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:28:50.629559 [ 12478 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:28:50.635249 [ 12478 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:28:50.709215 [ 12478 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:28:50.733771 [ 12478 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:28:50.735940 [ 12478 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:28:51.087713 [ 12488 ] {} CancellationChecker: Started worker function 2025.04.02 03:28:51.088710 [ 12478 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:28:51.089453 [ 12478 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:28:51.091214 [ 12478 ] {} Application: Initializing DateLUT. 2025.04.02 03:28:51.091945 [ 12478 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:28:51.093577 [ 12478 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:28:51.096177 [ 12478 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:28:51.103757 [ 12478 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:28:51.104747 [ 12478 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:28:51.105649 [ 12478 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:28:51.107895 [ 12478 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:28:51.113613 [ 12478 ] {} Application: Initializing interserver credentials. 2025.04.02 03:28:51.122572 [ 12478 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:28:51.222724 [ 12478 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:28:51.225247 [ 12478 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:28:51.230996 [ 12478 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:28:51.231642 [ 12478 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:28:51.234725 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:28:51.236205 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:28:51.237611 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:28:51.238888 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:28:51.240594 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:28:51.243700 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:28:51.245243 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:28:51.246555 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:28:51.247825 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:28:51.249023 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:28:51.250441 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:28:51.251687 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:28:51.252956 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:28:51.254359 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:28:51.255644 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:28:51.256928 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:28:51.258445 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:28:51.259714 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:28:51.260953 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:28:51.262415 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:28:51.263804 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:28:51.265162 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:28:51.266763 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:28:51.268278 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:28:51.269728 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:28:51.270825 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:28:51.272449 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:28:51.273707 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:28:51.274818 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:28:51.276218 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:28:51.277557 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:28:51.279067 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:28:51.280483 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:28:51.281881 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:28:51.283199 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:28:51.284540 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:28:51.285901 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:28:51.287732 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:28:51.289360 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:28:51.291232 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:28:51.292710 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:28:51.294114 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:28:51.295569 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:28:51.297025 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:28:51.298574 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:28:51.300000 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:28:51.301464 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:28:51.302931 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:28:51.305343 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:28:51.307233 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:28:51.308953 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:28:51.310554 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:28:51.312222 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:28:51.332251 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:28:51.334030 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:28:51.335729 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:28:51.336851 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:28:51.338384 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:28:51.340059 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:28:51.341488 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:28:51.342975 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:28:51.344443 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:28:51.345809 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:28:51.347503 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:28:51.348995 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:28:51.351203 [ 12478 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:28:51.449064 [ 12478 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:28:51.455657 [ 12478 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:28:52.650897 [ 12478 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:28:52.651630 [ 12478 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:28:52.652149 [ 12478 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:28:52.949104 [ 12478 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:28:52.949773 [ 12478 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:28:52.951436 [ 12478 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:28:52.953705 [ 12478 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:52.960479 [ 12478 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:52.966864 [ 12478 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:28:53.045068 [ 12478 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:28:53.046145 [ 12478 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:53.051527 [ 12478 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:28:53.056306 [ 12478 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:53.058663 [ 12478 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:28:53.060900 [ 12478 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:28:53.062070 [ 12478 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:28:53.071503 [ 12478 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:28:53.071940 [ 12478 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:28:53.072489 [ 12478 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:28:53.073101 [ 12478 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:28:53.073799 [ 12478 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:28:53.074972 [ 12478 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:53.075947 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.301235 [ 12478 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:53.319390 [ 12478 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:53.320360 [ 12478 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:53.474369 [ 12478 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/cdf/pptkcdqautqonllybmskagwuzqzct 2025.04.02 03:28:53.476509 [ 12478 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/cdf/pptkcdqautqonllybmskagwuzqzct. 2025.04.02 03:28:53.545789 [ 13068 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/cdf/pptkcdqautqonllybmskagwuzqzct, size 4 2025.04.02 03:28:53.547472 [ 12478 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/cdf/pptkcdqautqonllybmskagwuzqzct. 2025.04.02 03:28:53.578933 [ 12478 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/cdf/pptkcdqautqonllybmskagwuzqzct 2025.04.02 03:28:53.579753 [ 12478 ] {} deleteFileFromS3: Object with path s3/cdf/pptkcdqautqonllybmskagwuzqzct was removed from S3 2025.04.02 03:28:53.580337 [ 12478 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:28:53.581093 [ 12478 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:28:53.610390 [ 12478 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:53.614766 [ 12478 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:53.615406 [ 12478 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:53.663585 [ 12478 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:28:53.664515 [ 12478 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:28:53 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C283E7FC4C0 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:28:53.666729 [ 12478 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:28:53.678315 [ 12478 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:28:53.679030 [ 12478 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:28:53.679865 [ 12478 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:28:53.680728 [ 12478 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:28:53.681854 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.691425 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.692483 [ 12478 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:53.693670 [ 12478 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:53.695284 [ 12478 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:28:53.696567 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.697721 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.698702 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.699787 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.700912 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.724236 [ 12478 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:53.728767 [ 12478 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:53.729524 [ 12478 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:53.778825 [ 12478 ] {} deleteFileFromS3: No blob storage log, not writing blob special/wco/lruhkdjvasliwrdynsvroshbhclqu 2025.04.02 03:28:53.779545 [ 12478 ] {} deleteFileFromS3: Object with path special/wco/lruhkdjvasliwrdynsvroshbhclqu was removed from S3 2025.04.02 03:28:53.780274 [ 12478 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:28:53.781081 [ 12478 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:28:53.802683 [ 12478 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:28:53.806816 [ 12478 ] {} S3Client: Provider type: Unknown 2025.04.02 03:28:53.807551 [ 12478 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:28:53.848090 [ 12478 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/iui/rmxlwacocgrouxjalgtkzaipsdibj 2025.04.02 03:28:53.848799 [ 12478 ] {} deleteFileFromS3: Object with path test_02944/iui/rmxlwacocgrouxjalgtkzaipsdibj was removed from S3 2025.04.02 03:28:53.849588 [ 12478 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:28:53.850404 [ 12478 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:28:53.851586 [ 12478 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:28:53.876881 [ 12478 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:28:53.897065 [ 12478 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:28:53.897866 [ 12478 ] {} KeeperSnapshotManager: Found snapshot_16.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:53.898589 [ 12478 ] {} KeeperSnapshotManager: Found snapshot_14.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:53.899323 [ 12478 ] {} KeeperSnapshotManager: Found snapshot_15.bin.zstd on LocalSnapshotDisk 2025.04.02 03:28:53.910368 [ 12478 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:28:53.911026 [ 12478 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:28:53.912531 [ 12478 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:28:53.913258 [ 12478 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:28:53.914024 [ 12478 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:28:53.914600 [ 12478 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 16 2025.04.02 03:28:53.921370 [ 12478 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:28:53.922579 [ 12478 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 16 2025.04.02 03:28:53.925395 [ 12478 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 16 entries 2025.04.02 03:28:53.926286 [ 12478 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:28:53.927206 [ 12478 ] {} KeeperServer: Last local log idx 16 2025.04.02 03:28:53.928333 [ 12478 ] {} KeeperServer: Will use config from log store with log index 16 2025.04.02 03:28:53.937458 [ 12478 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:28:53.948550 [ 12478 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:28:53.959338 [ 12478 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:28:53.962236 [ 12478 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:28:53.963181 [ 12478 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:28:53.964276 [ 12478 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:28:53.965767 [ 12478 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:28:53.967590 [ 12478 ] {} RaftInstance: === INIT RAFT SERVER === commit index 16 term 16 election timer allowed log store start 1, end 16 config log idx 16, prev log idx 15 -- ASYNC REPLICATION -- 2025.04.02 03:28:53.968648 [ 12478 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:28:53.970371 [ 12478 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:28:53.971719 [ 12478 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:28:54.018248 [ 13090 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:28:54.025257 [ 13081 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:28:54.026292 [ 13081 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:28:54.027738 [ 13081 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 16, state term 16, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:28:54.028439 [ 13081 ] {} RaftInstance: pre-vote term (0) is different, reset it to 16 2025.04.02 03:28:54.038340 [ 13081 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:28:54.042896 [ 12478 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:28:54.074090 [ 13081 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 17, log idx 16, log term 16, priority (target 1 / mine 1) 2025.04.02 03:28:54.094083 [ 13081 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:28:54.096465 [ 13081 ] {} RaftInstance: state machine commit index 16, precommit index 16, last log index 16 2025.04.02 03:28:54.169743 [ 13081 ] {} RaftInstance: [BECOME LEADER] appended new config at 17 2025.04.02 03:28:54.188380 [ 13096 ] {} RaftInstance: config at index 17 is committed, prev config log idx 16 2025.04.02 03:28:54.189714 [ 13096 ] {} RaftInstance: new config log idx 17, prev log idx 16, cur config log idx 16, prev log idx 15 2025.04.02 03:28:54.190635 [ 13096 ] {} RaftInstance: new configuration: log idx 17, prev log idx 16 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 17 2025.04.02 03:28:54.194387 [ 12478 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:28:54.209792 [ 12478 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:28:54.293859 [ 12478 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:28:54.294766 [ 12478 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:28:54.469450 [ 12478 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:28:54.470304 [ 12478 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:28:54.472359 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:28:54.473952 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:28:54.474973 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:28:54.476774 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:28:54.478359 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:28:54.479934 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:28:54.481392 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:28:54.482764 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:28:54.484845 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:28:54.486506 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:28:54.488169 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:28:54.490448 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:28:54.491874 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:28:54.493325 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:28:54.494820 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:28:54.496197 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:28:54.497578 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:28:54.499189 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:28:54.500556 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:28:54.502124 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:28:54.503799 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:28:54.505167 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:28:54.506893 [ 12478 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:28:54.513707 [ 12478 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:28:54.514515 [ 12478 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:28:55.306055 [ 12478 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:28:55.306884 [ 12478 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:28:55.308624 [ 12478 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:28:55.311076 [ 12478 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:28:55.385912 [ 12478 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:28:55.386644 [ 13109 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:28:55.530258 [ 12478 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:28:55.544959 [ 12478 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:28:55.556107 [ 12478 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:28:55.572615 [ 12478 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:28:55.581013 [ 12478 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:28:55.587304 [ 12478 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:28:55.597166 [ 12478 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:28:55.598483 [ 12478 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:28:55.598680 [ 12489 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:28:55.607016 [ 12489 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:29:00.301446 [ 12478 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:29:00.302765 [ 12478 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:29:00.307586 [ 12478 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:29:00.308348 [ 12478 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:29:00.309389 [ 12488 ] {} CancellationChecker: Execution took 9222 ms. 2025.04.02 03:29:00.311005 [ 12478 ] {} Application: Shutting down storages. 2025.04.02 03:29:00.311631 [ 12478 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:29:00.318909 [ 12478 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:29:00.319543 [ 12478 ] {} Context: Shutting down workload entity storage 2025.04.02 03:29:00.320232 [ 12478 ] {} Context: Shutting down named sessions 2025.04.02 03:29:00.321827 [ 12478 ] {} Context: Shutting down database catalog 2025.04.02 03:29:00.322740 [ 12478 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:29:00.324000 [ 12478 ] {} Context: Shutting down merges executor 2025.04.02 03:29:00.326380 [ 12478 ] {} Context: Shutting down fetches executor 2025.04.02 03:29:00.331809 [ 12478 ] {} Context: Shutting down moves executor 2025.04.02 03:29:00.333706 [ 12478 ] {} Context: Shutting down common executor 2025.04.02 03:29:00.336087 [ 12478 ] {} Context: Shutting down DDLWorker 2025.04.02 03:29:00.336846 [ 12478 ] {} Context: Shutting down caches 2025.04.02 03:29:00.338292 [ 12478 ] {} Context: Shutting down AccessControl 2025.04.02 03:29:00.342946 [ 12478 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:29:00.350164 [ 12478 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:29:00.577392 [ 12478 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:29:00.583311 [ 12478 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:29:00.599506 [ 12478 ] {} Application: Shut down storages. 2025.04.02 03:29:00.600226 [ 12478 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:29:01.054952 [ 12478 ] {} Application: Closed all listening sockets. 2025.04.02 03:29:01.056034 [ 12478 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:29:01.057804 [ 12478 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:29:01.218251 [ 12478 ] {} RaftInstance: shutting down raft core 2025.04.02 03:29:01.220250 [ 12478 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:29:01.221408 [ 12478 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:29:01.222446 [ 12478 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:29:01.223977 [ 12478 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:29:01.225259 [ 12478 ] {} RaftInstance: reset all pointers. 2025.04.02 03:29:01.226465 [ 12478 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:29:01.227783 [ 13090 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:29:01.228137 [ 12478 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:29:01.229490 [ 12478 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:29:01.230357 [ 12478 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:29:01.231481 [ 12478 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:29:01.232349 [ 12478 ] {} RaftInstance: manually create a snapshot on 17 2025.04.02 03:29:01.234416 [ 12478 ] {} RaftInstance: creating a snapshot for index 17 2025.04.02 03:29:01.235403 [ 12478 ] {} RaftInstance: create snapshot idx 17 log_term 17 2025.04.02 03:29:01.236406 [ 12478 ] {} KeeperStateMachine: Creating snapshot 17 2025.04.02 03:29:01.274130 [ 12478 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:29:01.277573 [ 12478 ] {} KeeperStateMachine: Created persistent snapshot 17 with path snapshot_17.bin.zstd 2025.04.02 03:29:01.278485 [ 12478 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:29:01.279307 [ 12478 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:29:01.280188 [ 12478 ] {} RaftInstance: snapshot idx 17 log_term 17 created, compact the log store if needed 2025.04.02 03:29:01.282356 [ 12478 ] {} RaftInstance: create snapshot idx 17 log_term 17 done: 45970 us elapsed 2025.04.02 03:29:01.283710 [ 13082 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:29:01.285865 [ 13080 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 03:29:01.286194 [ 13085 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:29:01.286416 [ 13087 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:29:01.286449 [ 13091 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:29:01.286630 [ 13088 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:29:01.286820 [ 13092 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:29:01.287109 [ 13094 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:29:01.287176 [ 13089 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:29:01.286543 [ 13093 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:29:01.287504 [ 13095 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:29:01.287314 [ 13081 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:29:01.287606 [ 13079 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:29:01.287712 [ 13083 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:29:01.287804 [ 13086 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:29:01.287879 [ 13084 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:29:01.288061 [ 13082 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:29:01.300001 [ 12478 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:29:01.301105 [ 13078 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:29:01.304774 [ 12478 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:29:01.306062 [ 12478 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:29:01.306798 [ 12478 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:29:01.308648 [ 12478 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:29:01.309794 [ 12478 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:29:01.311819 [ 12478 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:29:01.312585 [ 12478 ] {} Context: Destructing threadpool writer 2025.04.02 03:29:01.365352 [ 12478 ] {} Application: Destroyed global context. 2025.04.02 03:29:01.367410 [ 12478 ] {} Application: Waiting for background threads 2025.04.02 03:29:01.492550 [ 12478 ] {} Application: Background threads finished in 125 ms 2025.04.02 03:29:01.496376 [ 12478 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:29:01.496998 [ 12478 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:29:01.521063 [ 12478 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:29:01.558446 [ 12478 ] {} Application: shutting down 2025.04.02 03:29:01.559303 [ 12478 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:29:01.561291 [ 12479 ] {} BaseDaemon: Received signal -2 2025.04.02 03:29:01.562175 [ 12479 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:29:01.661678 [ 12477 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:34:21.220989 [ 13682 ] {} Application: Will watch for the process with pid 13683 2025.04.02 03:34:21.221293 [ 13683 ] {} Application: Forked a child process to watch 2025.04.02 03:34:21.222229 [ 13683 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:34:21.331348 [ 13683 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 13683 2025.04.02 03:34:21.331837 [ 13683 ] {} Application: starting up 2025.04.02 03:34:21.331858 [ 13683 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:34:21.341225 [ 13683 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:34:21.342626 [ 13683 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:34:21.344153 [ 13683 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:34:21.344920 [ 13683 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:34:21.345774 [ 13683 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:34:21.346870 [ 13683 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:34:21.357219 [ 13683 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:34:21.358606 [ 13683 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:34:21.359238 [ 13683 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:34:21.360067 [ 13683 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:34:21.360712 [ 13683 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:34:22.761229 [ 13683 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:34:22.794563 [ 13683 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:34:22.857352 [ 13683 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:34:22.858718 [ 13683 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:34:22.875071 [ 13683 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:34:23.171040 [ 13695 ] {} CancellationChecker: Started worker function 2025.04.02 03:34:23.172048 [ 13683 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:34:23.172712 [ 13683 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:34:23.174312 [ 13683 ] {} Application: Initializing DateLUT. 2025.04.02 03:34:23.174878 [ 13683 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:34:23.176419 [ 13683 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:34:23.179359 [ 13683 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:34:23.195182 [ 13683 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:34:23.196182 [ 13683 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:34:23.197274 [ 13683 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:34:23.199940 [ 13683 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:34:23.201089 [ 13683 ] {} Application: Initializing interserver credentials. 2025.04.02 03:34:23.209403 [ 13683 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:34:23.270686 [ 13683 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:34:23.271188 [ 13683 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:34:23.272481 [ 13683 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:34:23.274729 [ 13683 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:34:23.281677 [ 13683 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:34:23.282442 [ 13683 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:34:23.286542 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:34:23.288190 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:34:23.289589 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:34:23.291324 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:34:23.292595 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:34:23.294087 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:34:23.296401 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:34:23.306720 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:34:23.308289 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:34:23.309936 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:34:23.311270 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:34:23.312648 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:34:23.314104 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:34:23.315489 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:34:23.316815 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:34:23.318386 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:34:23.319789 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:34:23.321268 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:34:23.322742 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:34:23.324216 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:34:23.325800 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:34:23.327251 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:34:23.328378 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:34:23.329989 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:34:23.331846 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:34:23.333068 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:34:23.373382 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:34:23.375113 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:34:23.376608 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:34:23.378046 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:34:23.379648 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:34:23.380866 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:34:23.382082 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:34:23.383577 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:34:23.384784 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:34:23.386168 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:34:23.387657 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:34:23.388895 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:34:23.390435 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:34:23.391808 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:34:23.393567 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:34:23.395242 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:34:23.396773 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:34:23.398089 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:34:23.399639 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:34:23.400910 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:34:23.402373 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:34:23.403638 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:34:23.405031 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:34:23.406436 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:34:23.408590 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:34:23.410484 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:34:23.412305 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:34:23.413876 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:34:23.415302 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:34:23.416593 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:34:23.418095 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:34:23.419500 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:34:23.420322 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:34:23.421566 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:34:23.422922 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:34:23.424617 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:34:23.426105 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:34:23.427473 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:34:23.428848 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:34:23.430260 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:34:23.431637 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:34:23.433727 [ 13683 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:34:23.461657 [ 13683 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:34:23.539627 [ 13683 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:34:24.445426 [ 13683 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:34:24.461250 [ 13683 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:34:24.481346 [ 13683 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:34:25.055983 [ 13683 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:34:25.056739 [ 13683 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:34:25.058751 [ 13683 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:34:25.060898 [ 13683 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:25.073022 [ 13683 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:25.079599 [ 13683 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:25.338674 [ 13683 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:34:25.401671 [ 13683 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:34:25.402941 [ 13683 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:34:25.440894 [ 13683 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:34:25.521410 [ 13683 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:34:25.538069 [ 13683 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:34:25.553237 [ 13683 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:34:25.565342 [ 13683 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:34:25.604363 [ 13683 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:34:25.605085 [ 13683 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:34:25.605879 [ 13683 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:34:25.606419 [ 13683 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:34:25.607175 [ 13683 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:34:25.608319 [ 13683 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:25.609377 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.670903 [ 13683 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:25.675425 [ 13683 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:25.676074 [ 13683 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:25.684450 [ 13683 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:25.687235 [ 13683 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri 2025.04.02 03:34:25.688057 [ 13683 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri 2025.04.02 03:34:25.688486 [ 13683 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri, size 4 2025.04.02 03:34:25.689940 [ 13683 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri. 2025.04.02 03:34:25.690149 [ 14274 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri 2025.04.02 03:34:25.719798 [ 14274 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri, size 4 2025.04.02 03:34:25.721527 [ 13683 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/umr/utueawzjnsbyybydertexjgfwoqri. 2025.04.02 03:34:25.724918 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/umr/utueawzjnsbyybydertexjgfwoqri (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:25.734024 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/umr/utueawzjnsbyybydertexjgfwoqri (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:25.734978 [ 13683 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/umr/utueawzjnsbyybydertexjgfwoqri, Version: Latest, Offset: 2 2025.04.02 03:34:25.749777 [ 13683 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/umr/utueawzjnsbyybydertexjgfwoqri 2025.04.02 03:34:25.750431 [ 13683 ] {} deleteFileFromS3: Object with path s3/umr/utueawzjnsbyybydertexjgfwoqri was removed from S3 2025.04.02 03:34:25.751060 [ 13683 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:34:25.751829 [ 13683 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:34:25.772958 [ 13683 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:25.777085 [ 13683 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:25.777870 [ 13683 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:25.798379 [ 13683 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:25.816115 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:25.828261 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:25.829521 [ 13683 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:34:25.843210 [ 13683 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:34:25.844167 [ 13683 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:34:25 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C7595F14A97 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:34:25.846138 [ 13683 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:34:25.857117 [ 13683 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:25.857672 [ 13683 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:34:25.858371 [ 13683 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:34:25.859224 [ 13683 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:34:25.860302 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.861469 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.862493 [ 13683 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:25.863673 [ 13683 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:25.864644 [ 13683 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:34:25.865814 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.866830 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.867956 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.869116 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.870248 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:25.969425 [ 13683 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:25.972772 [ 13683 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:25.973643 [ 13683 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:25.980340 [ 13683 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:25.999989 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/yha/fhojrbcxpybdbgsczdcbicbxugqab (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:26.008710 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/yha/fhojrbcxpybdbgsczdcbicbxugqab (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:26.009869 [ 13683 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/yha/fhojrbcxpybdbgsczdcbicbxugqab, Version: Latest, Offset: 2 2025.04.02 03:34:26.033254 [ 13683 ] {} deleteFileFromS3: No blob storage log, not writing blob special/yha/fhojrbcxpybdbgsczdcbicbxugqab 2025.04.02 03:34:26.034031 [ 13683 ] {} deleteFileFromS3: Object with path special/yha/fhojrbcxpybdbgsczdcbicbxugqab was removed from S3 2025.04.02 03:34:26.034720 [ 13683 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:34:26.035489 [ 13683 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:34:26.155776 [ 13683 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:26.160375 [ 13683 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:26.169638 [ 13683 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:26.335493 [ 13683 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:26.456581 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ppz/catdjlvhwkauonchbyrsztsgesgmo (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:26.494982 [ 13683 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ppz/catdjlvhwkauonchbyrsztsgesgmo (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:26.496114 [ 13683 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/ppz/catdjlvhwkauonchbyrsztsgesgmo, Version: Latest, Offset: 2 2025.04.02 03:34:26.521516 [ 13683 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ppz/catdjlvhwkauonchbyrsztsgesgmo 2025.04.02 03:34:26.522112 [ 13683 ] {} deleteFileFromS3: Object with path test_02944/ppz/catdjlvhwkauonchbyrsztsgesgmo was removed from S3 2025.04.02 03:34:26.522839 [ 13683 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:34:26.523638 [ 13683 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:34:26.524886 [ 13683 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:26.551847 [ 13683 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:26.581479 [ 13683 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:34:26.582205 [ 13683 ] {} KeeperSnapshotManager: Found snapshot_16.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:26.582841 [ 13683 ] {} KeeperSnapshotManager: Found snapshot_17.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:26.583379 [ 13683 ] {} KeeperSnapshotManager: Found snapshot_15.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:26.596278 [ 13683 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:34:26.596928 [ 13683 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:34:26.598525 [ 13683 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:34:26.599459 [ 13683 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:34:26.600036 [ 13683 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:34:26.600710 [ 13683 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 17 2025.04.02 03:34:26.607909 [ 13683 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:34:26.609163 [ 13683 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 17 2025.04.02 03:34:26.612256 [ 13683 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 17 entries 2025.04.02 03:34:26.613243 [ 13683 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:34:26.614322 [ 13683 ] {} KeeperServer: Last local log idx 17 2025.04.02 03:34:26.615626 [ 13683 ] {} KeeperServer: Will use config from log store with log index 17 2025.04.02 03:34:26.625624 [ 13683 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:34:26.636622 [ 13683 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:34:26.639686 [ 13683 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:34:26.641768 [ 13683 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:34:26.642476 [ 13683 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:34:26.643538 [ 13683 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:34:26.645089 [ 13683 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:34:26.646700 [ 13683 ] {} RaftInstance: === INIT RAFT SERVER === commit index 17 term 17 election timer allowed log store start 1, end 17 config log idx 17, prev log idx 16 -- ASYNC REPLICATION -- 2025.04.02 03:34:26.647615 [ 13683 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:34:26.649088 [ 13683 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:34:26.650366 [ 13683 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:34:26.650715 [ 14305 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:34:26.703166 [ 14288 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:34:26.704152 [ 14288 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:34:26.704204 [ 13683 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:34:26.705713 [ 14288 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 17, state term 17, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:34:26.706353 [ 14288 ] {} RaftInstance: pre-vote term (0) is different, reset it to 17 2025.04.02 03:34:26.707488 [ 14288 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:34:26.711945 [ 14288 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 18, log idx 17, log term 17, priority (target 1 / mine 1) 2025.04.02 03:34:26.713067 [ 14288 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:34:26.714819 [ 14288 ] {} RaftInstance: state machine commit index 17, precommit index 17, last log index 17 2025.04.02 03:34:26.717311 [ 14286 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:34:26.718644 [ 14288 ] {} RaftInstance: [BECOME LEADER] appended new config at 18 2025.04.02 03:34:26.729017 [ 14304 ] {} RaftInstance: config at index 18 is committed, prev config log idx 17 2025.04.02 03:34:26.730214 [ 14304 ] {} RaftInstance: new config log idx 18, prev log idx 17, cur config log idx 17, prev log idx 16 2025.04.02 03:34:26.731082 [ 14304 ] {} RaftInstance: new configuration: log idx 18, prev log idx 17 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 18 2025.04.02 03:34:26.734126 [ 13683 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:34:26.735404 [ 13683 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:34:26.742621 [ 13683 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:34:26.743382 [ 13683 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:34:26.755061 [ 13683 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:34:26.755851 [ 13683 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:34:26.757383 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:34:26.758753 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:34:26.759632 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:34:26.760652 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:34:26.761773 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:34:26.763000 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:34:26.764163 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:34:26.765378 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:34:26.767345 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:34:26.768619 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:34:26.769832 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:34:26.771192 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:34:26.772390 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:34:26.773791 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:34:26.783415 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:34:26.784789 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:34:26.786130 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:34:26.787460 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:34:26.788704 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:34:26.789888 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:34:26.791289 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:34:26.792410 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:34:26.793838 [ 13683 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:34:26.798573 [ 13683 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:34:26.799330 [ 13683 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:34:27.769219 [ 13683 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:34:27.770364 [ 13683 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:34:27.772340 [ 13683 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:34:27.775305 [ 13683 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:34:27.784812 [ 13683 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:34:27.785427 [ 14314 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:34:27.845420 [ 13683 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:34:27.853594 [ 13683 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:34:27.873556 [ 13683 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:34:27.888910 [ 13683 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:34:27.897958 [ 13683 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:34:27.899566 [ 13683 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:34:27.906049 [ 13683 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:34:27.983502 [ 13683 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:34:27.984609 [ 13683 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:34:27.994678 [ 13696 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:34:28.002665 [ 13696 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:34:32.791914 [ 13683 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:34:32.792893 [ 13683 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:34:32.796158 [ 13683 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:34:32.796793 [ 13683 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:34:32.797821 [ 13695 ] {} CancellationChecker: Execution took 9627 ms. 2025.04.02 03:34:32.799244 [ 13683 ] {} Application: Shutting down storages. 2025.04.02 03:34:32.799680 [ 13683 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:34:32.805022 [ 13683 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:34:32.805555 [ 13683 ] {} Context: Shutting down workload entity storage 2025.04.02 03:34:32.806115 [ 13683 ] {} Context: Shutting down named sessions 2025.04.02 03:34:32.806978 [ 13683 ] {} Context: Shutting down database catalog 2025.04.02 03:34:32.807512 [ 13683 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:34:32.808459 [ 13683 ] {} Context: Shutting down merges executor 2025.04.02 03:34:32.826094 [ 13683 ] {} Context: Shutting down fetches executor 2025.04.02 03:34:32.828314 [ 13683 ] {} Context: Shutting down moves executor 2025.04.02 03:34:32.829728 [ 13683 ] {} Context: Shutting down common executor 2025.04.02 03:34:32.831159 [ 13683 ] {} Context: Shutting down DDLWorker 2025.04.02 03:34:32.831647 [ 13683 ] {} Context: Shutting down caches 2025.04.02 03:34:32.832494 [ 13683 ] {} Context: Shutting down AccessControl 2025.04.02 03:34:32.835670 [ 13683 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:34:32.878081 [ 13683 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:34:33.316020 [ 13683 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:34:33.321098 [ 13683 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:34:33.335666 [ 13683 ] {} Application: Shut down storages. 2025.04.02 03:34:33.336388 [ 13683 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:34:33.781375 [ 13683 ] {} Application: Closed all listening sockets. 2025.04.02 03:34:33.789226 [ 13683 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:34:33.797800 [ 13683 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:34:34.241035 [ 13683 ] {} RaftInstance: shutting down raft core 2025.04.02 03:34:34.242440 [ 13683 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:34:34.243078 [ 13683 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:34:34.243769 [ 13683 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:34:34.244711 [ 13683 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:34:34.245577 [ 13683 ] {} RaftInstance: reset all pointers. 2025.04.02 03:34:34.246504 [ 13683 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:34:34.247525 [ 14305 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:34:34.247648 [ 13683 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:34:34.248759 [ 13683 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:34:34.249620 [ 13683 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:34:34.250575 [ 13683 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:34:34.251199 [ 13683 ] {} RaftInstance: manually create a snapshot on 18 2025.04.02 03:34:34.253040 [ 13683 ] {} RaftInstance: creating a snapshot for index 18 2025.04.02 03:34:34.254097 [ 13683 ] {} RaftInstance: create snapshot idx 18 log_term 18 2025.04.02 03:34:34.255105 [ 13683 ] {} KeeperStateMachine: Creating snapshot 18 2025.04.02 03:34:34.255886 [ 13683 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:34:34.258903 [ 13683 ] {} KeeperStateMachine: Created persistent snapshot 18 with path snapshot_18.bin.zstd 2025.04.02 03:34:34.259650 [ 13683 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:34:34.260450 [ 13683 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:34:34.261539 [ 13683 ] {} RaftInstance: snapshot idx 18 log_term 18 created, compact the log store if needed 2025.04.02 03:34:34.263397 [ 13683 ] {} RaftInstance: create snapshot idx 18 log_term 18 done: 8283 us elapsed 2025.04.02 03:34:34.265132 [ 14292 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:34:34.269424 [ 14291 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 03:34:34.269918 [ 14295 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:34:34.270064 [ 14297 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:34:34.270137 [ 14296 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:34:34.270329 [ 14300 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:34:34.270587 [ 14303 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:34:34.270598 [ 14298 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:34:34.270425 [ 14302 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:34:34.279857 [ 14292 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280010 [ 14301 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280184 [ 14288 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280529 [ 14299 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280481 [ 14289 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280620 [ 14294 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280675 [ 14290 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.280843 [ 14293 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:34.285280 [ 14286 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:34:34.285506 [ 13683 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:34:34.286678 [ 14287 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:34:34.289987 [ 13683 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:34:34.291189 [ 13683 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:34:34.291964 [ 13683 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:34:34.294001 [ 13683 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:34:34.295222 [ 13683 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:34:34.297158 [ 13683 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:34:34.297842 [ 13683 ] {} Context: Destructing threadpool writer 2025.04.02 03:34:34.346633 [ 13683 ] {} Application: Destroyed global context. 2025.04.02 03:34:34.348482 [ 13683 ] {} Application: Waiting for background threads 2025.04.02 03:34:34.477322 [ 13683 ] {} Application: Background threads finished in 128 ms 2025.04.02 03:34:34.481293 [ 13683 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:34:34.481880 [ 13683 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:34:34.503130 [ 13683 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:34:34.504021 [ 13683 ] {} Application: shutting down 2025.04.02 03:34:34.504609 [ 13683 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:34:34.506319 [ 13684 ] {} BaseDaemon: Received signal -2 2025.04.02 03:34:34.506863 [ 13684 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:34:34.723205 [ 13682 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:34:35.068639 [ 14420 ] {} Application: Will watch for the process with pid 14421 2025.04.02 03:34:35.068815 [ 14421 ] {} Application: Forked a child process to watch 2025.04.02 03:34:35.069562 [ 14421 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:34:35.154406 [ 14421 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 14421 2025.04.02 03:34:35.154820 [ 14421 ] {} Application: starting up 2025.04.02 03:34:35.154838 [ 14421 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:34:35.164038 [ 14421 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:34:35.165144 [ 14421 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:34:35.166528 [ 14421 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:34:35.167161 [ 14421 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:34:35.167953 [ 14421 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:34:35.168862 [ 14421 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:34:35.178022 [ 14421 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:34:35.179305 [ 14421 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:34:35.179822 [ 14421 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:34:35.180425 [ 14421 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:34:35.180874 [ 14421 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:34:36.524347 [ 14421 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:34:36.526451 [ 14421 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:34:36.567086 [ 14421 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:34:36.617456 [ 14421 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:34:36.629513 [ 14421 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:34:37.074635 [ 14430 ] {} CancellationChecker: Started worker function 2025.04.02 03:34:37.079533 [ 14421 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:34:37.080203 [ 14421 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:34:37.081659 [ 14421 ] {} Application: Initializing DateLUT. 2025.04.02 03:34:37.082238 [ 14421 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:34:37.083596 [ 14421 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:34:37.086204 [ 14421 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:34:37.112319 [ 14421 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:34:37.113485 [ 14421 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:34:37.114637 [ 14421 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:34:37.117345 [ 14421 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:34:37.118521 [ 14421 ] {} Application: Initializing interserver credentials. 2025.04.02 03:34:37.206025 [ 14421 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:34:37.326305 [ 14421 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:34:37.326876 [ 14421 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:34:37.328255 [ 14421 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:34:37.330555 [ 14421 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:34:37.337768 [ 14421 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:34:37.338485 [ 14421 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:34:37.342834 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:34:37.344675 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:34:37.346174 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:34:37.347692 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:34:37.349092 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:34:37.350439 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:34:37.352654 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:34:37.354210 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:34:37.355669 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:34:37.356910 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:34:37.357958 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:34:37.359394 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:34:37.360570 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:34:37.361749 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:34:37.362871 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:34:37.363963 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:34:37.365102 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:34:37.366360 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:34:37.367663 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:34:37.368847 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:34:37.370088 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:34:37.371537 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:34:37.372718 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:34:37.383948 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:34:37.385689 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:34:37.387137 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:34:37.388373 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:34:37.390054 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:34:37.391361 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:34:37.392811 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:34:37.394182 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:34:37.395549 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:34:37.396872 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:34:37.398078 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:34:37.399194 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:34:37.400580 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:34:37.401945 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:34:37.403458 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:34:37.405044 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:34:37.406502 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:34:37.408240 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:34:37.437093 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:34:37.438978 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:34:37.440684 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:34:37.442269 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:34:37.443695 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:34:37.445232 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:34:37.446531 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:34:37.448158 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:34:37.449888 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:34:37.454682 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:34:37.456492 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:34:37.458618 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:34:37.474327 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:34:37.490605 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:34:37.506786 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:34:37.514404 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:34:37.530409 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:34:37.531570 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:34:37.557375 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:34:37.559305 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:34:37.574781 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:34:37.590774 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:34:37.592482 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:34:37.594022 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:34:37.646401 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:34:37.648252 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:34:37.720998 [ 14421 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:34:37.762953 [ 14421 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:34:37.829451 [ 14421 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:34:38.618336 [ 14421 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:34:38.633655 [ 14421 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:34:38.634798 [ 14421 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:34:39.033577 [ 14421 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:34:39.034280 [ 14421 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:34:39.036012 [ 14421 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:34:39.038311 [ 14421 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:39.044883 [ 14421 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:39.051442 [ 14421 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:39.159594 [ 14421 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:34:39.162202 [ 14421 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:34:39.163168 [ 14421 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:34:39.168141 [ 14421 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:34:39.171726 [ 14421 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:34:39.172997 [ 14421 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:34:39.175465 [ 14421 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:34:39.176623 [ 14421 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:34:39.185454 [ 14421 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:34:39.185911 [ 14421 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:34:39.186481 [ 14421 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:34:39.187111 [ 14421 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:34:39.187582 [ 14421 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:34:39.188560 [ 14421 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:39.189509 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.578387 [ 14421 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:39.605383 [ 14421 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:39.606229 [ 14421 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:39.616556 [ 14421 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:39.619418 [ 14421 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij 2025.04.02 03:34:39.620220 [ 14421 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij 2025.04.02 03:34:39.620624 [ 14421 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij, size 4 2025.04.02 03:34:39.622075 [ 14421 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij. 2025.04.02 03:34:39.622445 [ 15012 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij 2025.04.02 03:34:39.638974 [ 15012 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij, size 4 2025.04.02 03:34:39.640585 [ 14421 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/twc/cdmbazoaeapirgfsvzmohcknhpxij. 2025.04.02 03:34:39.643482 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/twc/cdmbazoaeapirgfsvzmohcknhpxij (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:39.692094 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/twc/cdmbazoaeapirgfsvzmohcknhpxij (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:39.693452 [ 14421 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/twc/cdmbazoaeapirgfsvzmohcknhpxij, Version: Latest, Offset: 2 2025.04.02 03:34:39.708735 [ 14421 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/twc/cdmbazoaeapirgfsvzmohcknhpxij 2025.04.02 03:34:39.709298 [ 14421 ] {} deleteFileFromS3: Object with path s3/twc/cdmbazoaeapirgfsvzmohcknhpxij was removed from S3 2025.04.02 03:34:39.709976 [ 14421 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:34:39.710929 [ 14421 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:34:39.731883 [ 14421 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:39.736030 [ 14421 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:39.736697 [ 14421 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:39.742241 [ 14421 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:39.759598 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:39.777876 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:39.778945 [ 14421 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:34:39.791137 [ 14421 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:34:39.791906 [ 14421 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:34:39 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C78D54E85E2 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:34:39.794223 [ 14421 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:34:39.804992 [ 14421 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:39.805571 [ 14421 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:34:39.806173 [ 14421 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:34:39.806879 [ 14421 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:34:39.807861 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.808882 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.810039 [ 14421 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:39.810916 [ 14421 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:39.848264 [ 14421 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:34:39.849447 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.850530 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.851610 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.852668 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.853711 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:39.947328 [ 14421 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:39.952336 [ 14421 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:39.953036 [ 14421 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:39.959992 [ 14421 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:39.973251 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/cae/wlskthcmjsfxahckmyyeanqmculgs (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:39.982516 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/cae/wlskthcmjsfxahckmyyeanqmculgs (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:39.983751 [ 14421 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/cae/wlskthcmjsfxahckmyyeanqmculgs, Version: Latest, Offset: 2 2025.04.02 03:34:40.052864 [ 14421 ] {} deleteFileFromS3: No blob storage log, not writing blob special/cae/wlskthcmjsfxahckmyyeanqmculgs 2025.04.02 03:34:40.053572 [ 14421 ] {} deleteFileFromS3: Object with path special/cae/wlskthcmjsfxahckmyyeanqmculgs was removed from S3 2025.04.02 03:34:40.054262 [ 14421 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:34:40.055243 [ 14421 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:34:40.185790 [ 14421 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:40.190745 [ 14421 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:40.201842 [ 14421 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:40.277402 [ 14421 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:40.385969 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ivf/cgpckcdodxtkbukcgqyfyxxjftzmy (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:40.402802 [ 14421 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/ivf/cgpckcdodxtkbukcgqyfyxxjftzmy (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:40.403806 [ 14421 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/ivf/cgpckcdodxtkbukcgqyfyxxjftzmy, Version: Latest, Offset: 2 2025.04.02 03:34:40.426179 [ 14421 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ivf/cgpckcdodxtkbukcgqyfyxxjftzmy 2025.04.02 03:34:40.426923 [ 14421 ] {} deleteFileFromS3: Object with path test_02944/ivf/cgpckcdodxtkbukcgqyfyxxjftzmy was removed from S3 2025.04.02 03:34:40.427739 [ 14421 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:34:40.428761 [ 14421 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:34:40.430138 [ 14421 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:40.456974 [ 14421 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:40.484195 [ 14421 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:34:40.484871 [ 14421 ] {} KeeperSnapshotManager: Found snapshot_16.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:40.485485 [ 14421 ] {} KeeperSnapshotManager: Found snapshot_17.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:40.486076 [ 14421 ] {} KeeperSnapshotManager: Found snapshot_18.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:40.496979 [ 14421 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:34:40.497756 [ 14421 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:34:40.499236 [ 14421 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:34:40.499989 [ 14421 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:34:40.500640 [ 14421 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:34:40.501160 [ 14421 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 18 2025.04.02 03:34:40.509014 [ 14421 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:34:40.510218 [ 14421 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 18 2025.04.02 03:34:40.513844 [ 14421 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 18 entries 2025.04.02 03:34:40.514752 [ 14421 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:34:40.515864 [ 14421 ] {} KeeperServer: Last local log idx 18 2025.04.02 03:34:40.517039 [ 14421 ] {} KeeperServer: Will use config from log store with log index 18 2025.04.02 03:34:40.526948 [ 14421 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:34:40.537210 [ 14421 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:34:40.540549 [ 14421 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:34:40.542694 [ 14421 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:34:40.543587 [ 14421 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:34:40.544618 [ 14421 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:34:40.545930 [ 14421 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:34:40.547713 [ 14421 ] {} RaftInstance: === INIT RAFT SERVER === commit index 18 term 18 election timer allowed log store start 1, end 18 config log idx 18, prev log idx 17 -- ASYNC REPLICATION -- 2025.04.02 03:34:40.548787 [ 14421 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:34:40.550185 [ 14421 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:34:40.551409 [ 14421 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:34:40.551712 [ 15043 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:34:40.604335 [ 15026 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:34:40.643210 [ 14421 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:34:40.643407 [ 15026 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:34:40.644944 [ 15026 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 18, state term 18, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:34:40.645660 [ 15026 ] {} RaftInstance: pre-vote term (0) is different, reset it to 18 2025.04.02 03:34:40.646913 [ 15026 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:34:40.651663 [ 15026 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 19, log idx 18, log term 18, priority (target 1 / mine 1) 2025.04.02 03:34:40.653077 [ 15026 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:34:40.655026 [ 15026 ] {} RaftInstance: state machine commit index 18, precommit index 18, last log index 18 2025.04.02 03:34:40.657662 [ 15024 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:34:40.658950 [ 15026 ] {} RaftInstance: [BECOME LEADER] appended new config at 19 2025.04.02 03:34:40.662816 [ 15042 ] {} RaftInstance: config at index 19 is committed, prev config log idx 18 2025.04.02 03:34:40.663781 [ 15042 ] {} RaftInstance: new config log idx 19, prev log idx 18, cur config log idx 18, prev log idx 17 2025.04.02 03:34:40.664653 [ 15042 ] {} RaftInstance: new configuration: log idx 19, prev log idx 18 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 19 2025.04.02 03:34:40.667582 [ 14421 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:34:40.669056 [ 14421 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:34:40.676211 [ 14421 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:34:40.676882 [ 14421 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:34:40.687778 [ 14421 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:34:40.688368 [ 14421 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:34:40.753481 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:34:40.755125 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:34:40.756169 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:34:40.757553 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:34:40.758734 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:34:40.760070 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:34:40.761228 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:34:40.768393 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:34:40.770354 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:34:40.771824 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:34:40.772835 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:34:40.774165 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:34:40.775580 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:34:40.776821 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:34:40.778577 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:34:40.780209 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:34:40.781583 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:34:40.782948 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:34:40.784177 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:34:40.785727 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:34:40.787052 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:34:40.788393 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:34:40.789933 [ 14421 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:34:40.796871 [ 14421 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:34:40.797786 [ 14421 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:34:41.614126 [ 14421 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:34:41.615027 [ 14421 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:34:41.616992 [ 14421 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:34:41.620183 [ 14421 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:34:41.626203 [ 14421 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:34:41.626757 [ 15052 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:34:41.759837 [ 14421 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:34:41.765853 [ 14421 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:34:41.776585 [ 14421 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:34:41.782076 [ 14421 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:34:41.790124 [ 14421 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:34:41.791648 [ 14421 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:34:41.911105 [ 14421 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:34:41.980356 [ 14421 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:34:41.991566 [ 14421 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:34:41.992578 [ 14431 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:34:42.000465 [ 14431 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:34:47.032698 [ 14421 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:34:47.036137 [ 14421 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:34:47.053007 [ 14421 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:34:47.053823 [ 14421 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:34:47.054904 [ 14430 ] {} CancellationChecker: Execution took 9981 ms. 2025.04.02 03:34:47.056416 [ 14421 ] {} Application: Shutting down storages. 2025.04.02 03:34:47.057139 [ 14421 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:34:47.064129 [ 14421 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:34:47.064822 [ 14421 ] {} Context: Shutting down workload entity storage 2025.04.02 03:34:47.065615 [ 14421 ] {} Context: Shutting down named sessions 2025.04.02 03:34:47.067074 [ 14421 ] {} Context: Shutting down database catalog 2025.04.02 03:34:47.067958 [ 14421 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:34:47.069260 [ 14421 ] {} Context: Shutting down merges executor 2025.04.02 03:34:47.071825 [ 14421 ] {} Context: Shutting down fetches executor 2025.04.02 03:34:47.074336 [ 14421 ] {} Context: Shutting down moves executor 2025.04.02 03:34:47.076212 [ 14421 ] {} Context: Shutting down common executor 2025.04.02 03:34:47.078040 [ 14421 ] {} Context: Shutting down DDLWorker 2025.04.02 03:34:47.078704 [ 14421 ] {} Context: Shutting down caches 2025.04.02 03:34:47.079773 [ 14421 ] {} Context: Shutting down AccessControl 2025.04.02 03:34:47.083583 [ 14421 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:34:47.091042 [ 14421 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:34:47.241421 [ 14421 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:34:47.246427 [ 14421 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:34:47.259187 [ 14421 ] {} Application: Shut down storages. 2025.04.02 03:34:47.259814 [ 14421 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:34:47.689896 [ 14421 ] {} Application: Closed all listening sockets. 2025.04.02 03:34:47.693742 [ 14421 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:34:47.695030 [ 14421 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:34:48.175483 [ 14421 ] {} RaftInstance: shutting down raft core 2025.04.02 03:34:48.177038 [ 14421 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:34:48.177747 [ 14421 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:34:48.178783 [ 14421 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:34:48.180035 [ 14421 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:34:48.181214 [ 14421 ] {} RaftInstance: reset all pointers. 2025.04.02 03:34:48.182160 [ 14421 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:34:48.183178 [ 15043 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:34:48.183318 [ 14421 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:34:48.184629 [ 14421 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:34:48.185572 [ 14421 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:34:48.186601 [ 14421 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:34:48.187447 [ 14421 ] {} RaftInstance: manually create a snapshot on 19 2025.04.02 03:34:48.189307 [ 14421 ] {} RaftInstance: creating a snapshot for index 19 2025.04.02 03:34:48.190452 [ 14421 ] {} RaftInstance: create snapshot idx 19 log_term 19 2025.04.02 03:34:48.191263 [ 14421 ] {} KeeperStateMachine: Creating snapshot 19 2025.04.02 03:34:48.192443 [ 14421 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:34:48.196196 [ 14421 ] {} KeeperStateMachine: Created persistent snapshot 19 with path snapshot_19.bin.zstd 2025.04.02 03:34:48.197276 [ 14421 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:34:48.198022 [ 14421 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:34:48.198899 [ 14421 ] {} RaftInstance: snapshot idx 19 log_term 19 created, compact the log store if needed 2025.04.02 03:34:48.201106 [ 14421 ] {} RaftInstance: create snapshot idx 19 log_term 19 done: 9658 us elapsed 2025.04.02 03:34:48.202634 [ 15030 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:34:48.204666 [ 15033 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:34:48.204786 [ 15034 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:34:48.205100 [ 15035 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:34:48.205142 [ 15041 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:34:48.205213 [ 15037 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:34:48.205300 [ 15038 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:34:48.205781 [ 15031 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:34:48.205581 [ 15040 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:34:48.205477 [ 15039 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:34:48.205870 [ 15026 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:34:48.205980 [ 15029 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:48.206064 [ 15036 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:48.206183 [ 15032 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:48.206458 [ 15030 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:48.206381 [ 15027 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:34:48.206269 [ 15028 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:34:48.210526 [ 15024 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:34:48.210635 [ 14421 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:34:48.211877 [ 15025 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:34:48.214683 [ 14421 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:34:48.215750 [ 14421 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:34:48.216283 [ 14421 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:34:48.217714 [ 14421 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:34:48.218623 [ 14421 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:34:48.220130 [ 14421 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:34:48.220659 [ 14421 ] {} Context: Destructing threadpool writer 2025.04.02 03:34:48.513721 [ 14421 ] {} Application: Destroyed global context. 2025.04.02 03:34:48.533554 [ 14421 ] {} Application: Waiting for background threads 2025.04.02 03:34:48.605928 [ 14421 ] {} Application: Background threads finished in 72 ms 2025.04.02 03:34:48.650178 [ 14421 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:34:48.665454 [ 14421 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:34:48.756122 [ 14421 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:34:48.757133 [ 14421 ] {} Application: shutting down 2025.04.02 03:34:48.757735 [ 14421 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:34:48.759461 [ 14422 ] {} BaseDaemon: Received signal -2 2025.04.02 03:34:48.760216 [ 14422 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:34:48.868128 [ 14420 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:34:49.725646 [ 15162 ] {} Application: Will watch for the process with pid 15163 2025.04.02 03:34:49.725855 [ 15163 ] {} Application: Forked a child process to watch 2025.04.02 03:34:49.726727 [ 15163 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:34:49.836601 [ 15163 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 15163 2025.04.02 03:34:49.837014 [ 15163 ] {} Application: starting up 2025.04.02 03:34:49.837031 [ 15163 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:34:49.846661 [ 15163 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:34:49.848190 [ 15163 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:34:49.849948 [ 15163 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:34:49.850817 [ 15163 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:34:49.852015 [ 15163 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:34:49.853059 [ 15163 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:34:49.866768 [ 15163 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:34:49.868015 [ 15163 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:34:49.876387 [ 15163 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:34:49.877294 [ 15163 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:34:49.878178 [ 15163 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:34:51.477336 [ 15163 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:34:51.486264 [ 15163 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:34:51.546539 [ 15163 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:34:51.548177 [ 15163 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:34:51.554084 [ 15163 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:34:51.760729 [ 15175 ] {} CancellationChecker: Started worker function 2025.04.02 03:34:51.762091 [ 15163 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:34:51.762729 [ 15163 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:34:51.764291 [ 15163 ] {} Application: Initializing DateLUT. 2025.04.02 03:34:51.764977 [ 15163 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:34:51.815006 [ 15163 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:34:51.817986 [ 15163 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:34:51.823599 [ 15163 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:34:51.824584 [ 15163 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:34:51.825406 [ 15163 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:34:51.827789 [ 15163 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:34:51.828954 [ 15163 ] {} Application: Initializing interserver credentials. 2025.04.02 03:34:51.836710 [ 15163 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:34:51.905564 [ 15163 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:34:51.906188 [ 15163 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:34:51.907814 [ 15163 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:34:51.910403 [ 15163 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:34:51.917686 [ 15163 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:34:51.918444 [ 15163 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:34:51.922638 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:34:51.924410 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:34:51.925953 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:34:51.927418 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:34:51.930162 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:34:51.931518 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:34:51.934733 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:34:51.936029 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:34:51.937473 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:34:51.938870 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:34:51.940117 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:34:52.026654 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:34:52.046254 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:34:52.053370 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:34:52.062685 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:34:52.064291 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:34:52.093216 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:34:52.109310 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:34:52.115071 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:34:52.122676 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:34:52.124117 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:34:52.139921 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:34:52.154001 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:34:52.157251 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:34:52.170414 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:34:52.186954 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:34:52.202447 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:34:52.205659 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:34:52.237395 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:34:52.239215 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:34:52.253374 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:34:52.270260 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:34:52.306907 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:34:52.326736 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:34:52.328719 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:34:52.330665 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:34:52.332251 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:34:52.333781 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:34:52.335343 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:34:52.336688 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:34:52.338505 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:34:52.340135 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:34:52.341588 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:34:52.343133 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:34:52.344610 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:34:52.346073 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:34:52.347513 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:34:52.348712 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:34:52.350042 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:34:52.351523 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:34:52.353967 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:34:52.355786 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:34:52.357089 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:34:52.358505 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:34:52.359876 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:34:52.361158 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:34:52.362631 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:34:52.364189 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:34:52.365127 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:34:52.366541 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:34:52.367887 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:34:52.369087 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:34:52.370514 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:34:52.371633 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:34:52.373108 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:34:52.374768 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:34:52.376143 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:34:52.389491 [ 15163 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:34:52.460879 [ 15163 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:34:52.467616 [ 15163 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:34:53.494202 [ 15163 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:34:53.494902 [ 15163 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:34:53.495640 [ 15163 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:34:54.153160 [ 15163 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:34:54.153819 [ 15163 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:34:54.155472 [ 15163 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:34:54.157627 [ 15163 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:54.164375 [ 15163 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:54.170928 [ 15163 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:34:54.245838 [ 15163 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:34:54.248715 [ 15163 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:34:54.249670 [ 15163 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:34:54.255170 [ 15163 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:34:54.288474 [ 15163 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:34:54.289834 [ 15163 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:34:54.292379 [ 15163 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:34:54.294025 [ 15163 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:34:54.304178 [ 15163 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:34:54.304820 [ 15163 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:34:54.305458 [ 15163 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:34:54.306126 [ 15163 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:34:54.306810 [ 15163 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:34:54.308044 [ 15163 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:54.309054 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.447908 [ 15163 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:54.452405 [ 15163 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:54.452973 [ 15163 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:54.460278 [ 15163 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:54.469630 [ 15163 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr 2025.04.02 03:34:54.470242 [ 15163 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr 2025.04.02 03:34:54.470686 [ 15163 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr, size 4 2025.04.02 03:34:54.471972 [ 15163 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr. 2025.04.02 03:34:54.472304 [ 15754 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr 2025.04.02 03:34:54.487945 [ 15754 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr, size 4 2025.04.02 03:34:54.489354 [ 15163 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr. 2025.04.02 03:34:54.491986 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:54.498752 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:54.499565 [ 15163 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr, Version: Latest, Offset: 2 2025.04.02 03:34:54.565896 [ 15163 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr 2025.04.02 03:34:54.566710 [ 15163 ] {} deleteFileFromS3: Object with path s3/rvn/ktkxzborjcmkrhlflbqexwlerznxr was removed from S3 2025.04.02 03:34:54.567492 [ 15163 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:34:54.568397 [ 15163 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:34:54.778878 [ 15163 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:54.785227 [ 15163 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:54.786032 [ 15163 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:54.838356 [ 15163 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:54.856468 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:54.872266 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:54.873341 [ 15163 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:34:54.885054 [ 15163 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:34:54.885968 [ 15163 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:34:54 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C7C58FB32F1 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:34:54.887959 [ 15163 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:34:54.899327 [ 15163 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:54.899942 [ 15163 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:34:54.900543 [ 15163 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:34:54.901307 [ 15163 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:34:54.902543 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.903652 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.904624 [ 15163 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:54.905858 [ 15163 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:54.906947 [ 15163 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:34:54.908084 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.909306 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.910447 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.911330 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.912210 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:54.938218 [ 15163 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:54.941408 [ 15163 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:54.942089 [ 15163 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:54.949092 [ 15163 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:54.963021 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/wow/zhqtqqvldqesdtjaqgpaarxptdqps (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:54.970918 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/wow/zhqtqqvldqesdtjaqgpaarxptdqps (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:54.971914 [ 15163 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/wow/zhqtqqvldqesdtjaqgpaarxptdqps, Version: Latest, Offset: 2 2025.04.02 03:34:55.075832 [ 15163 ] {} deleteFileFromS3: No blob storage log, not writing blob special/wow/zhqtqqvldqesdtjaqgpaarxptdqps 2025.04.02 03:34:55.076511 [ 15163 ] {} deleteFileFromS3: Object with path special/wow/zhqtqqvldqesdtjaqgpaarxptdqps was removed from S3 2025.04.02 03:34:55.077129 [ 15163 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:34:55.078016 [ 15163 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:34:55.098875 [ 15163 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:34:55.103286 [ 15163 ] {} S3Client: Provider type: Unknown 2025.04.02 03:34:55.103958 [ 15163 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:34:55.110101 [ 15163 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:34:55.123004 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/tah/cgoaawbbkhokapcnxjqkkvxmaxkwa (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:55.130761 [ 15163 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/tah/cgoaawbbkhokapcnxjqkkvxmaxkwa (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:34:55.131730 [ 15163 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/tah/cgoaawbbkhokapcnxjqkkvxmaxkwa, Version: Latest, Offset: 2 2025.04.02 03:34:55.145091 [ 15163 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/tah/cgoaawbbkhokapcnxjqkkvxmaxkwa 2025.04.02 03:34:55.145746 [ 15163 ] {} deleteFileFromS3: Object with path test_02944/tah/cgoaawbbkhokapcnxjqkkvxmaxkwa was removed from S3 2025.04.02 03:34:55.146453 [ 15163 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:34:55.147177 [ 15163 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:34:55.148169 [ 15163 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:34:55.173574 [ 15163 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:34:55.192614 [ 15163 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:34:55.193297 [ 15163 ] {} KeeperSnapshotManager: Found snapshot_19.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:55.193901 [ 15163 ] {} KeeperSnapshotManager: Found snapshot_17.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:55.194443 [ 15163 ] {} KeeperSnapshotManager: Found snapshot_18.bin.zstd on LocalSnapshotDisk 2025.04.02 03:34:55.204305 [ 15163 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:34:55.204994 [ 15163 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:34:55.206419 [ 15163 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:34:55.207131 [ 15163 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:34:55.207631 [ 15163 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:34:55.208153 [ 15163 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 19 2025.04.02 03:34:55.214510 [ 15163 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:34:55.215890 [ 15163 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 19 2025.04.02 03:34:55.218954 [ 15163 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 19 entries 2025.04.02 03:34:55.219839 [ 15163 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:34:55.220801 [ 15163 ] {} KeeperServer: Last local log idx 19 2025.04.02 03:34:55.221968 [ 15163 ] {} KeeperServer: Will use config from log store with log index 19 2025.04.02 03:34:55.230404 [ 15163 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:34:55.241663 [ 15163 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:34:55.250874 [ 15163 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:34:55.252973 [ 15163 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:34:55.253739 [ 15163 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:34:55.254598 [ 15163 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:34:55.255872 [ 15163 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:34:55.257311 [ 15163 ] {} RaftInstance: === INIT RAFT SERVER === commit index 19 term 19 election timer allowed log store start 1, end 19 config log idx 19, prev log idx 18 -- ASYNC REPLICATION -- 2025.04.02 03:34:55.258301 [ 15163 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:34:55.259646 [ 15163 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:34:55.260748 [ 15163 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:34:55.261064 [ 15785 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:34:55.313362 [ 15770 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:34:55.314315 [ 15770 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:34:55.314559 [ 15163 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:34:55.315715 [ 15770 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 19, state term 19, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:34:55.316307 [ 15770 ] {} RaftInstance: pre-vote term (0) is different, reset it to 19 2025.04.02 03:34:55.317386 [ 15770 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:34:55.321665 [ 15770 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 20, log idx 19, log term 19, priority (target 1 / mine 1) 2025.04.02 03:34:55.322829 [ 15770 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:34:55.324682 [ 15770 ] {} RaftInstance: state machine commit index 19, precommit index 19, last log index 19 2025.04.02 03:34:55.326894 [ 15766 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:34:55.328117 [ 15770 ] {} RaftInstance: [BECOME LEADER] appended new config at 20 2025.04.02 03:34:55.331663 [ 15784 ] {} RaftInstance: config at index 20 is committed, prev config log idx 19 2025.04.02 03:34:55.332535 [ 15784 ] {} RaftInstance: new config log idx 20, prev log idx 19, cur config log idx 19, prev log idx 18 2025.04.02 03:34:55.333326 [ 15784 ] {} RaftInstance: new configuration: log idx 20, prev log idx 19 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 20 2025.04.02 03:34:55.336066 [ 15163 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:34:55.337247 [ 15163 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:34:55.359045 [ 15163 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:34:55.359724 [ 15163 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:34:55.493222 [ 15163 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:34:55.493918 [ 15163 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:34:55.502956 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:34:55.537603 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:34:55.538629 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:34:55.540067 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:34:55.550158 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:34:55.569838 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:34:55.571415 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:34:55.588693 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:34:55.605255 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:34:55.606861 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:34:55.608177 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:34:55.622667 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:34:55.644412 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:34:55.654320 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:34:55.666301 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:34:55.678699 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:34:55.691960 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:34:55.693653 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:34:55.722170 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:34:55.738262 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:34:55.754501 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:34:55.778301 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:34:55.782242 [ 15163 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:34:55.788431 [ 15163 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:34:55.789152 [ 15163 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:34:56.165070 [ 15163 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:34:56.166075 [ 15163 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:34:56.168094 [ 15163 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:34:56.170543 [ 15163 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:34:56.176119 [ 15163 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:34:56.176497 [ 15794 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:34:56.230997 [ 15163 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:34:56.244467 [ 15163 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:34:56.253906 [ 15163 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:34:56.259125 [ 15163 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:34:56.268127 [ 15163 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:34:56.269827 [ 15163 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:34:56.280475 [ 15163 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:34:56.302440 [ 15163 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:34:56.303585 [ 15176 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:34:56.303715 [ 15163 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:34:56.312628 [ 15176 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:35:00.574323 [ 15163 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:00.575563 [ 15163 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:35:00.598804 [ 15163 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:35:00.602529 [ 15163 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:35:00.603573 [ 15175 ] {} CancellationChecker: Execution took 8843 ms. 2025.04.02 03:35:00.607228 [ 15163 ] {} Application: Shutting down storages. 2025.04.02 03:35:00.617486 [ 15163 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:35:00.653223 [ 15163 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:35:00.661700 [ 15163 ] {} Context: Shutting down workload entity storage 2025.04.02 03:35:00.673965 [ 15163 ] {} Context: Shutting down named sessions 2025.04.02 03:35:00.675610 [ 15163 ] {} Context: Shutting down database catalog 2025.04.02 03:35:00.676377 [ 15163 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:35:00.677770 [ 15163 ] {} Context: Shutting down merges executor 2025.04.02 03:35:00.679907 [ 15163 ] {} Context: Shutting down fetches executor 2025.04.02 03:35:00.682200 [ 15163 ] {} Context: Shutting down moves executor 2025.04.02 03:35:00.684347 [ 15163 ] {} Context: Shutting down common executor 2025.04.02 03:35:00.686396 [ 15163 ] {} Context: Shutting down DDLWorker 2025.04.02 03:35:00.687002 [ 15163 ] {} Context: Shutting down caches 2025.04.02 03:35:00.688151 [ 15163 ] {} Context: Shutting down AccessControl 2025.04.02 03:35:00.692276 [ 15163 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:35:00.748550 [ 15163 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:35:00.940018 [ 15163 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:35:00.945840 [ 15163 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:35:00.960760 [ 15163 ] {} Application: Shut down storages. 2025.04.02 03:35:00.961477 [ 15163 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:35:01.368207 [ 15163 ] {} Application: Closed all listening sockets. 2025.04.02 03:35:01.369449 [ 15163 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:35:01.401270 [ 15163 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:35:01.844308 [ 15163 ] {} RaftInstance: shutting down raft core 2025.04.02 03:35:01.846892 [ 15163 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:35:01.847970 [ 15163 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:35:01.848783 [ 15163 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:35:01.850523 [ 15163 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:35:01.851992 [ 15163 ] {} RaftInstance: reset all pointers. 2025.04.02 03:35:01.853250 [ 15163 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:35:01.854669 [ 15785 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:35:01.854786 [ 15163 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:35:01.856216 [ 15163 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:35:01.857487 [ 15163 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:35:01.858746 [ 15163 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:35:01.859642 [ 15163 ] {} RaftInstance: manually create a snapshot on 20 2025.04.02 03:35:01.862008 [ 15163 ] {} RaftInstance: creating a snapshot for index 20 2025.04.02 03:35:01.863315 [ 15163 ] {} RaftInstance: create snapshot idx 20 log_term 20 2025.04.02 03:35:01.864438 [ 15163 ] {} KeeperStateMachine: Creating snapshot 20 2025.04.02 03:35:01.865826 [ 15163 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:35:01.869756 [ 15163 ] {} KeeperStateMachine: Created persistent snapshot 20 with path snapshot_20.bin.zstd 2025.04.02 03:35:01.870714 [ 15163 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:35:01.871624 [ 15163 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:35:01.872484 [ 15163 ] {} RaftInstance: snapshot idx 20 log_term 20 created, compact the log store if needed 2025.04.02 03:35:01.882173 [ 15163 ] {} RaftInstance: create snapshot idx 20 log_term 20 done: 17832 us elapsed 2025.04.02 03:35:01.883738 [ 15769 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:35:01.886088 [ 15776 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:35:01.886141 [ 15780 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:35:01.886448 [ 15770 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:35:01.886685 [ 15777 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:35:01.886778 [ 15778 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:35:01.886540 [ 15773 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:35:01.887089 [ 15769 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:01.886953 [ 15775 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:35:01.886881 [ 15783 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:35:01.887247 [ 15781 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:01.887959 [ 15774 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:01.887571 [ 15768 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:01.887678 [ 15779 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:01.887875 [ 15782 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:01.887461 [ 15771 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:01.888184 [ 15772 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:01.892327 [ 15766 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:35:01.892422 [ 15163 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:01.893581 [ 15767 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:35:01.897056 [ 15163 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:35:01.898324 [ 15163 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:35:01.898991 [ 15163 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:35:01.900865 [ 15163 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:35:01.901919 [ 15163 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:01.903607 [ 15163 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:01.904195 [ 15163 ] {} Context: Destructing threadpool writer 2025.04.02 03:35:01.945169 [ 15163 ] {} Application: Destroyed global context. 2025.04.02 03:35:01.947197 [ 15163 ] {} Application: Waiting for background threads 2025.04.02 03:35:02.015354 [ 15163 ] {} Application: Background threads finished in 68 ms 2025.04.02 03:35:02.061425 [ 15163 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:35:02.062199 [ 15163 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:02.329681 [ 15163 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:02.346923 [ 15163 ] {} Application: shutting down 2025.04.02 03:35:02.355790 [ 15163 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:35:02.357573 [ 15164 ] {} BaseDaemon: Received signal -2 2025.04.02 03:35:02.358487 [ 15164 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:35:02.476679 [ 15162 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:35:03.369782 [ 15900 ] {} Application: Will watch for the process with pid 15901 2025.04.02 03:35:03.369939 [ 15901 ] {} Application: Forked a child process to watch 2025.04.02 03:35:03.370672 [ 15901 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:35:03.479538 [ 15901 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 15901 2025.04.02 03:35:03.479923 [ 15901 ] {} Application: starting up 2025.04.02 03:35:03.479942 [ 15901 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:35:03.489453 [ 15901 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:35:03.490734 [ 15901 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:35:03.492352 [ 15901 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:35:03.493208 [ 15901 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:35:03.494139 [ 15901 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:35:03.495215 [ 15901 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:35:03.499949 [ 15901 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:35:03.501431 [ 15901 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:35:03.502384 [ 15901 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:35:03.503200 [ 15901 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:35:03.504038 [ 15901 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:35:04.827075 [ 15901 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:35:04.829499 [ 15901 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:35:04.890908 [ 15901 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:35:04.893561 [ 15901 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:35:04.895472 [ 15901 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:35:05.458564 [ 15910 ] {} CancellationChecker: Started worker function 2025.04.02 03:35:05.459701 [ 15901 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:35:05.460471 [ 15901 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:35:05.462054 [ 15901 ] {} Application: Initializing DateLUT. 2025.04.02 03:35:05.462619 [ 15901 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:35:05.464184 [ 15901 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:35:05.467136 [ 15901 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:35:05.473312 [ 15901 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:35:05.474320 [ 15901 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:35:05.475227 [ 15901 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:35:05.477940 [ 15901 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:35:05.479053 [ 15901 ] {} Application: Initializing interserver credentials. 2025.04.02 03:35:05.487756 [ 15901 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:35:05.539812 [ 15901 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:05.540349 [ 15901 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:35:05.541669 [ 15901 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:35:05.543989 [ 15901 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:35:05.550801 [ 15901 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:35:05.551560 [ 15901 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:35:05.554627 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:35:05.556202 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:35:05.561620 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:35:05.562909 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:35:05.564165 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:35:05.565513 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:35:05.568369 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:35:05.569716 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:35:05.570969 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:35:05.572236 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:35:05.573437 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:35:05.574737 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:35:05.575850 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:35:05.577113 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:35:05.578268 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:35:05.579476 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:35:05.580765 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:35:05.582201 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:35:05.583546 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:35:05.584698 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:35:05.586007 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:35:05.587243 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:35:05.588433 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:35:05.589870 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:35:05.591294 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:35:05.592527 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:35:05.593709 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:35:05.595309 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:35:05.596787 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:35:05.597920 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:35:05.599408 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:35:05.600742 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:35:05.602176 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:35:05.603524 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:35:05.604771 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:35:05.606084 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:35:05.607358 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:35:05.608608 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:35:05.609958 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:35:05.611165 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:35:05.613002 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:35:05.701692 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:35:05.706243 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:35:05.707976 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:35:05.709757 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:35:05.711187 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:35:05.712609 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:35:05.714007 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:35:05.715354 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:35:05.716840 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:35:05.719069 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:35:05.720529 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:35:05.722015 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:35:05.723651 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:35:05.724946 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:35:05.726102 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:35:05.727548 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:35:05.728930 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:35:05.730037 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:35:05.731403 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:35:05.732721 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:35:05.733974 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:35:05.735311 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:35:05.736679 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:35:05.738083 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:35:05.739314 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:35:05.740635 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:35:05.742883 [ 15901 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:35:05.906168 [ 15901 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:35:05.962099 [ 15901 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:35:06.975754 [ 15901 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:35:06.976488 [ 15901 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:35:06.977161 [ 15901 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:35:07.330614 [ 15901 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:35:07.331309 [ 15901 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:35:07.333100 [ 15901 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:35:07.335050 [ 15901 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:07.341789 [ 15901 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:07.347820 [ 15901 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:07.847732 [ 15901 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:07.850478 [ 15901 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:35:07.851405 [ 15901 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:07.856795 [ 15901 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:35:07.860871 [ 15901 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:35:07.862067 [ 15901 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:35:07.864699 [ 15901 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:35:07.866078 [ 15901 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:35:07.875494 [ 15901 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:35:07.876073 [ 15901 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:35:07.876774 [ 15901 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:35:07.877572 [ 15901 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:35:07.878208 [ 15901 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:35:07.879593 [ 15901 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:07.880749 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.181309 [ 15901 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:08.186404 [ 15901 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:08.187129 [ 15901 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:08.205280 [ 15901 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:08.208268 [ 15901 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz 2025.04.02 03:35:08.209031 [ 15901 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz 2025.04.02 03:35:08.209557 [ 15901 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz, size 4 2025.04.02 03:35:08.210927 [ 15901 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz. 2025.04.02 03:35:08.211356 [ 16492 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz 2025.04.02 03:35:08.228822 [ 16492 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz, size 4 2025.04.02 03:35:08.230219 [ 15901 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz. 2025.04.02 03:35:08.233565 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:08.241480 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:08.242633 [ 15901 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz, Version: Latest, Offset: 2 2025.04.02 03:35:08.256294 [ 15901 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz 2025.04.02 03:35:08.256892 [ 15901 ] {} deleteFileFromS3: Object with path s3/zmt/zbpbiktzcbcebvodbpknmcwulqvtz was removed from S3 2025.04.02 03:35:08.257737 [ 15901 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:35:08.262308 [ 15901 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:35:08.341366 [ 15901 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:08.349624 [ 15901 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:08.350366 [ 15901 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:08.410205 [ 15901 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:08.643875 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:08.661921 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:08.663176 [ 15901 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:35:08.772219 [ 15901 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:35:08.773432 [ 15901 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:35:08 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C7F94B79D93 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:35:08.775680 [ 15901 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:35:08.787946 [ 15901 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:08.788624 [ 15901 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:35:08.789290 [ 15901 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:35:08.790203 [ 15901 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:35:08.791409 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.792432 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.793642 [ 15901 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:08.794635 [ 15901 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:08.795690 [ 15901 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:35:08.796788 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.798009 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.799468 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.800506 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.801909 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:08.923089 [ 15901 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:08.927579 [ 15901 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:08.928460 [ 15901 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:08.935936 [ 15901 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:08.952164 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/nsn/wrblwvlfwpqsqazqpqknwtvbzcovf (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:08.960844 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/nsn/wrblwvlfwpqsqazqpqknwtvbzcovf (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:08.962040 [ 15901 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/nsn/wrblwvlfwpqsqazqpqknwtvbzcovf, Version: Latest, Offset: 2 2025.04.02 03:35:08.977629 [ 15901 ] {} deleteFileFromS3: No blob storage log, not writing blob special/nsn/wrblwvlfwpqsqazqpqknwtvbzcovf 2025.04.02 03:35:08.978500 [ 15901 ] {} deleteFileFromS3: Object with path special/nsn/wrblwvlfwpqsqazqpqknwtvbzcovf was removed from S3 2025.04.02 03:35:08.979319 [ 15901 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:35:08.980314 [ 15901 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:35:09.002808 [ 15901 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:09.007141 [ 15901 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:09.007846 [ 15901 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:09.015265 [ 15901 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:09.029760 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mda/ujskdeeuchakdzsiolgnqrjmspcza (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:09.047135 [ 15901 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mda/ujskdeeuchakdzsiolgnqrjmspcza (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:09.048328 [ 15901 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/mda/ujskdeeuchakdzsiolgnqrjmspcza, Version: Latest, Offset: 2 2025.04.02 03:35:09.134695 [ 15901 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/mda/ujskdeeuchakdzsiolgnqrjmspcza 2025.04.02 03:35:09.135457 [ 15901 ] {} deleteFileFromS3: Object with path test_02944/mda/ujskdeeuchakdzsiolgnqrjmspcza was removed from S3 2025.04.02 03:35:09.136203 [ 15901 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:35:09.137112 [ 15901 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:35:09.143518 [ 15901 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:09.407404 [ 15901 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:09.565286 [ 15901 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:35:09.566077 [ 15901 ] {} KeeperSnapshotManager: Found snapshot_19.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:09.566902 [ 15901 ] {} KeeperSnapshotManager: Found snapshot_20.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:09.567510 [ 15901 ] {} KeeperSnapshotManager: Found snapshot_18.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:09.579132 [ 15901 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:35:09.579910 [ 15901 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:35:09.581953 [ 15901 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:35:09.582830 [ 15901 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:35:09.585644 [ 15901 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:35:09.586365 [ 15901 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 20 2025.04.02 03:35:09.602205 [ 15901 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:35:09.603549 [ 15901 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 20 2025.04.02 03:35:09.606976 [ 15901 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 20 entries 2025.04.02 03:35:09.608066 [ 15901 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:35:09.609230 [ 15901 ] {} KeeperServer: Last local log idx 20 2025.04.02 03:35:09.610458 [ 15901 ] {} KeeperServer: Will use config from log store with log index 20 2025.04.02 03:35:09.620495 [ 15901 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:35:09.632267 [ 15901 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:35:09.636082 [ 15901 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:35:09.639070 [ 15901 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:35:09.640135 [ 15901 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:35:09.641251 [ 15901 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:35:09.642634 [ 15901 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:35:09.644166 [ 15901 ] {} RaftInstance: === INIT RAFT SERVER === commit index 20 term 20 election timer allowed log store start 1, end 20 config log idx 20, prev log idx 19 -- ASYNC REPLICATION -- 2025.04.02 03:35:09.645144 [ 15901 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:35:09.646706 [ 15901 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:35:09.647986 [ 15901 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:35:09.648345 [ 16527 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:35:09.700594 [ 16512 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:35:09.701792 [ 15901 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:35:09.778238 [ 16512 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:35:09.780141 [ 16512 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 20, state term 20, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:35:09.780924 [ 16512 ] {} RaftInstance: pre-vote term (0) is different, reset it to 20 2025.04.02 03:35:09.781948 [ 16512 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:35:09.787432 [ 16512 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 21, log idx 20, log term 20, priority (target 1 / mine 1) 2025.04.02 03:35:09.788775 [ 16512 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:35:09.790935 [ 16512 ] {} RaftInstance: state machine commit index 20, precommit index 20, last log index 20 2025.04.02 03:35:09.793850 [ 16508 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:35:09.795381 [ 16512 ] {} RaftInstance: [BECOME LEADER] appended new config at 21 2025.04.02 03:35:09.799546 [ 16526 ] {} RaftInstance: config at index 21 is committed, prev config log idx 20 2025.04.02 03:35:09.800596 [ 16526 ] {} RaftInstance: new config log idx 21, prev log idx 20, cur config log idx 20, prev log idx 19 2025.04.02 03:35:09.801420 [ 16526 ] {} RaftInstance: new configuration: log idx 21, prev log idx 20 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 21 2025.04.02 03:35:09.804891 [ 15901 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:35:09.806336 [ 15901 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:35:09.815032 [ 15901 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:35:09.815838 [ 15901 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:35:09.828369 [ 15901 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:35:09.828996 [ 15901 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:35:09.830878 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:35:09.832269 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:35:09.833290 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:35:09.834337 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:35:09.835557 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:35:09.836644 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:35:09.837994 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:35:09.839153 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:35:09.841158 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:35:09.842536 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:35:09.843835 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:35:09.845085 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:35:09.846327 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:35:09.847685 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:35:09.848954 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:35:09.850329 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:35:09.851683 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:35:09.853015 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:35:09.901844 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:35:09.903522 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:35:09.904807 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:35:09.906296 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:35:09.908071 [ 15901 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:35:09.914842 [ 15901 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:35:09.915583 [ 15901 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:35:10.742975 [ 15901 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:35:10.744031 [ 15901 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:10.745815 [ 15901 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:35:10.748260 [ 15901 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:35:10.756624 [ 15901 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:35:10.757042 [ 16536 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:35:10.863029 [ 15901 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:35:10.868346 [ 15901 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:35:10.878302 [ 15901 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:35:10.883715 [ 15901 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:35:10.894180 [ 15901 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:35:10.895848 [ 15901 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:35:10.901630 [ 15901 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:35:10.911094 [ 15901 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:35:10.912507 [ 15911 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:35:10.912615 [ 15901 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:35:10.920162 [ 15911 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:35:15.387085 [ 15901 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:15.400609 [ 15901 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:35:15.413351 [ 15901 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:35:15.417906 [ 15901 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:35:15.418912 [ 15910 ] {} CancellationChecker: Execution took 9961 ms. 2025.04.02 03:35:15.420370 [ 15901 ] {} Application: Shutting down storages. 2025.04.02 03:35:15.429728 [ 15901 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:35:15.457945 [ 15901 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:35:15.459403 [ 15901 ] {} Context: Shutting down workload entity storage 2025.04.02 03:35:15.460051 [ 15901 ] {} Context: Shutting down named sessions 2025.04.02 03:35:15.461465 [ 15901 ] {} Context: Shutting down database catalog 2025.04.02 03:35:15.462153 [ 15901 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:35:15.463339 [ 15901 ] {} Context: Shutting down merges executor 2025.04.02 03:35:15.465734 [ 15901 ] {} Context: Shutting down fetches executor 2025.04.02 03:35:15.468057 [ 15901 ] {} Context: Shutting down moves executor 2025.04.02 03:35:15.469600 [ 15901 ] {} Context: Shutting down common executor 2025.04.02 03:35:15.471506 [ 15901 ] {} Context: Shutting down DDLWorker 2025.04.02 03:35:15.471969 [ 15901 ] {} Context: Shutting down caches 2025.04.02 03:35:15.472946 [ 15901 ] {} Context: Shutting down AccessControl 2025.04.02 03:35:15.476726 [ 15901 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:35:15.517767 [ 15901 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:35:15.716524 [ 15901 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:35:15.721313 [ 15901 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:35:15.738340 [ 15901 ] {} Application: Shut down storages. 2025.04.02 03:35:15.738985 [ 15901 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:35:16.077573 [ 15901 ] {} Application: Closed all listening sockets. 2025.04.02 03:35:16.078398 [ 15901 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:35:16.093577 [ 15901 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:35:16.312251 [ 15901 ] {} RaftInstance: shutting down raft core 2025.04.02 03:35:16.313708 [ 15901 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:35:16.314524 [ 15901 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:35:16.315236 [ 15901 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:35:16.316281 [ 15901 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:35:16.317229 [ 15901 ] {} RaftInstance: reset all pointers. 2025.04.02 03:35:16.318304 [ 15901 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:35:16.319399 [ 16527 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:35:16.319669 [ 15901 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:35:16.320842 [ 15901 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:35:16.321656 [ 15901 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:35:16.322601 [ 15901 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:35:16.323368 [ 15901 ] {} RaftInstance: manually create a snapshot on 21 2025.04.02 03:35:16.325250 [ 15901 ] {} RaftInstance: creating a snapshot for index 21 2025.04.02 03:35:16.326095 [ 15901 ] {} RaftInstance: create snapshot idx 21 log_term 21 2025.04.02 03:35:16.327022 [ 15901 ] {} KeeperStateMachine: Creating snapshot 21 2025.04.02 03:35:16.327993 [ 15901 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:35:16.331418 [ 15901 ] {} KeeperStateMachine: Created persistent snapshot 21 with path snapshot_21.bin.zstd 2025.04.02 03:35:16.332313 [ 15901 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:35:16.333074 [ 15901 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:35:16.334081 [ 15901 ] {} RaftInstance: snapshot idx 21 log_term 21 created, compact the log store if needed 2025.04.02 03:35:16.336020 [ 15901 ] {} RaftInstance: create snapshot idx 21 log_term 21 done: 9104 us elapsed 2025.04.02 03:35:16.337260 [ 16515 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:35:16.339291 [ 16513 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:35:16.339502 [ 16514 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:35:16.339665 [ 16517 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:35:16.339846 [ 16522 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:35:16.340085 [ 16520 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:35:16.340351 [ 16524 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:35:16.339980 [ 16521 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:35:16.340565 [ 16525 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:16.340183 [ 16523 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:35:16.340427 [ 16512 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:35:16.341070 [ 16516 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:16.340717 [ 16510 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:16.340811 [ 16518 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:16.340928 [ 16511 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:16.340675 [ 16519 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:16.341167 [ 16515 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:16.345878 [ 15901 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:16.346019 [ 16508 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:35:16.348020 [ 16509 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:35:16.352212 [ 15901 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:35:16.353512 [ 15901 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:35:16.354100 [ 15901 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:35:16.355871 [ 15901 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:35:16.356805 [ 15901 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:16.358383 [ 15901 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:16.359051 [ 15901 ] {} Context: Destructing threadpool writer 2025.04.02 03:35:16.459114 [ 15901 ] {} Application: Destroyed global context. 2025.04.02 03:35:16.462081 [ 15901 ] {} Application: Waiting for background threads 2025.04.02 03:35:16.527974 [ 15901 ] {} Application: Background threads finished in 65 ms 2025.04.02 03:35:16.531663 [ 15901 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:35:16.532169 [ 15901 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:16.552594 [ 15901 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:16.553415 [ 15901 ] {} Application: shutting down 2025.04.02 03:35:16.554053 [ 15901 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:35:16.555733 [ 15902 ] {} BaseDaemon: Received signal -2 2025.04.02 03:35:16.556591 [ 15902 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:35:16.658761 [ 15900 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:35:17.239176 [ 16638 ] {} Application: Will watch for the process with pid 16639 2025.04.02 03:35:17.239435 [ 16639 ] {} Application: Forked a child process to watch 2025.04.02 03:35:17.240253 [ 16639 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:35:17.342724 [ 16639 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 16639 2025.04.02 03:35:17.343170 [ 16639 ] {} Application: starting up 2025.04.02 03:35:17.343190 [ 16639 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:35:17.352442 [ 16639 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:35:17.353973 [ 16639 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:35:17.355770 [ 16639 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:35:17.356652 [ 16639 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:35:17.357425 [ 16639 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:35:17.358429 [ 16639 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:35:17.363508 [ 16639 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:35:17.364848 [ 16639 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:35:17.365697 [ 16639 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:35:17.366591 [ 16639 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:35:17.367383 [ 16639 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:35:18.506094 [ 16639 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:35:18.508973 [ 16639 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:35:18.569788 [ 16639 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:35:18.571615 [ 16639 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:35:18.573884 [ 16639 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:35:18.763696 [ 17159 ] {} CancellationChecker: Started worker function 2025.04.02 03:35:18.764016 [ 16639 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:35:18.764684 [ 16639 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:35:18.766161 [ 16639 ] {} Application: Initializing DateLUT. 2025.04.02 03:35:18.766974 [ 16639 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:35:18.768773 [ 16639 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:35:18.771838 [ 16639 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:35:18.778774 [ 16639 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:35:18.789911 [ 16639 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:35:18.806111 [ 16639 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:35:18.825322 [ 16639 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:35:18.826574 [ 16639 ] {} Application: Initializing interserver credentials. 2025.04.02 03:35:18.957353 [ 16639 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:35:19.139997 [ 16639 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:19.140540 [ 16639 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:35:19.141981 [ 16639 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:35:19.144570 [ 16639 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:35:19.292599 [ 16639 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:35:19.293593 [ 16639 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:35:19.297904 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:35:19.299780 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:35:19.301334 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:35:19.302884 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:35:19.304382 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:35:19.305772 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:35:19.308772 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:35:19.310042 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:35:19.311212 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:35:19.312891 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:35:19.314177 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:35:19.315583 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:35:19.317022 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:35:19.318325 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:35:19.319667 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:35:19.320734 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:35:19.322054 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:35:19.323389 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:35:19.324492 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:35:19.325742 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:35:19.326981 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:35:19.328217 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:35:19.329422 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:35:19.330970 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:35:19.332352 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:35:19.333688 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:35:19.334760 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:35:19.336192 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:35:19.337349 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:35:19.338658 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:35:19.339898 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:35:19.340951 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:35:19.342131 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:35:19.343693 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:35:19.345318 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:35:19.347000 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:35:19.348415 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:35:19.349950 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:35:19.351413 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:35:19.353165 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:35:19.355034 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:35:19.356543 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:35:19.358037 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:35:19.359535 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:35:19.360916 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:35:19.362344 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:35:19.363584 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:35:19.364897 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:35:19.366188 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:35:19.367497 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:35:19.369861 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:35:19.371278 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:35:19.372802 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:35:19.373988 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:35:19.375143 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:35:19.376401 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:35:19.377891 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:35:19.379173 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:35:19.380107 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:35:19.383025 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:35:19.384341 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:35:19.385783 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:35:19.387340 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:35:19.388832 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:35:19.390223 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:35:19.391767 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:35:19.393348 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:35:19.395667 [ 16639 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:35:19.430224 [ 16639 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:35:19.485045 [ 16639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:35:20.199387 [ 16639 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:35:20.199956 [ 16639 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:35:20.200558 [ 16639 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:35:20.926871 [ 16639 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:35:20.927569 [ 16639 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:35:20.929493 [ 16639 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:35:20.931829 [ 16639 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:20.938480 [ 16639 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:20.953010 [ 16639 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:21.251832 [ 16639 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:21.254797 [ 16639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:35:21.255777 [ 16639 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:21.261518 [ 16639 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:35:21.265422 [ 16639 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:35:21.266649 [ 16639 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:35:21.269359 [ 16639 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:35:21.270471 [ 16639 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:35:21.280099 [ 16639 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:35:21.280739 [ 16639 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:35:21.281422 [ 16639 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:35:21.282103 [ 16639 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:35:21.282583 [ 16639 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:35:21.283963 [ 16639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:21.284975 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:21.484115 [ 16639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:21.492634 [ 16639 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:21.493555 [ 16639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:21.626007 [ 16639 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:21.674166 [ 16639 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw 2025.04.02 03:35:21.675133 [ 16639 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw 2025.04.02 03:35:21.675652 [ 16639 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw, size 4 2025.04.02 03:35:21.685642 [ 16639 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw. 2025.04.02 03:35:21.695450 [ 17229 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw 2025.04.02 03:35:21.716832 [ 17229 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw, size 4 2025.04.02 03:35:21.718509 [ 16639 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw. 2025.04.02 03:35:21.721879 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:21.730833 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:21.731917 [ 16639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw, Version: Latest, Offset: 2 2025.04.02 03:35:21.820956 [ 16639 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw 2025.04.02 03:35:21.821794 [ 16639 ] {} deleteFileFromS3: Object with path s3/nyf/fybqvlkwlrfoaaszcxawntpsnclmw was removed from S3 2025.04.02 03:35:21.822792 [ 16639 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:35:21.823611 [ 16639 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:35:21.852082 [ 16639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:21.856816 [ 16639 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:21.857489 [ 16639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:21.872655 [ 16639 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:21.926562 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:22.016231 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:22.017586 [ 16639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:35:22.031781 [ 16639 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:35:22.032794 [ 16639 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:35:22 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C82AB087E46 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:35:22.035258 [ 16639 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:35:22.046919 [ 16639 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:22.047558 [ 16639 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:35:22.055981 [ 16639 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:35:22.056948 [ 16639 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:35:22.058441 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.059545 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.060709 [ 16639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:22.070344 [ 16639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:22.071446 [ 16639 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:35:22.072573 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.073840 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.074920 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.075820 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.082478 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.104813 [ 16639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:22.109114 [ 16639 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:22.109864 [ 16639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:22.116766 [ 16639 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:22.131656 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ayh/djnulypiijvmukrtcgmgigeangyqr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:22.290174 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ayh/djnulypiijvmukrtcgmgigeangyqr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:22.306194 [ 16639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ayh/djnulypiijvmukrtcgmgigeangyqr, Version: Latest, Offset: 2 2025.04.02 03:35:22.446910 [ 16639 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ayh/djnulypiijvmukrtcgmgigeangyqr 2025.04.02 03:35:22.447597 [ 16639 ] {} deleteFileFromS3: Object with path special/ayh/djnulypiijvmukrtcgmgigeangyqr was removed from S3 2025.04.02 03:35:22.448468 [ 16639 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:35:22.449799 [ 16639 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:35:22.588755 [ 16639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:22.593105 [ 16639 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:22.593772 [ 16639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:22.600601 [ 16639 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:22.615003 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/bve/dcxlreazciygjwhfckxkupcjsngrn (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:22.623676 [ 16639 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/bve/dcxlreazciygjwhfckxkupcjsngrn (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:22.624739 [ 16639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/bve/dcxlreazciygjwhfckxkupcjsngrn, Version: Latest, Offset: 2 2025.04.02 03:35:22.639221 [ 16639 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/bve/dcxlreazciygjwhfckxkupcjsngrn 2025.04.02 03:35:22.639851 [ 16639 ] {} deleteFileFromS3: Object with path test_02944/bve/dcxlreazciygjwhfckxkupcjsngrn was removed from S3 2025.04.02 03:35:22.640367 [ 16639 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:35:22.641029 [ 16639 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:35:22.642177 [ 16639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:22.667184 [ 16639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:22.688235 [ 16639 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:35:22.689098 [ 16639 ] {} KeeperSnapshotManager: Found snapshot_19.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:22.689982 [ 16639 ] {} KeeperSnapshotManager: Found snapshot_20.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:22.690532 [ 16639 ] {} KeeperSnapshotManager: Found snapshot_21.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:22.701257 [ 16639 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:35:22.701890 [ 16639 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:35:22.735565 [ 16639 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:35:22.736525 [ 16639 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:35:22.737361 [ 16639 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:35:22.738082 [ 16639 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 21 2025.04.02 03:35:22.753451 [ 16639 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:35:22.755080 [ 16639 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 21 2025.04.02 03:35:22.758483 [ 16639 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 21 entries 2025.04.02 03:35:22.759633 [ 16639 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:35:22.760886 [ 16639 ] {} KeeperServer: Last local log idx 21 2025.04.02 03:35:22.762265 [ 16639 ] {} KeeperServer: Will use config from log store with log index 21 2025.04.02 03:35:22.772880 [ 16639 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:35:22.784951 [ 16639 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:35:22.788489 [ 16639 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:35:22.790721 [ 16639 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:35:22.791487 [ 16639 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:35:22.792448 [ 16639 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:35:22.793850 [ 16639 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:35:22.795617 [ 16639 ] {} RaftInstance: === INIT RAFT SERVER === commit index 21 term 21 election timer allowed log store start 1, end 21 config log idx 21, prev log idx 20 -- ASYNC REPLICATION -- 2025.04.02 03:35:22.796510 [ 16639 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:35:22.798067 [ 16639 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:35:22.799481 [ 16639 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:35:22.799771 [ 17261 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:35:22.852092 [ 17244 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:35:22.852956 [ 17244 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:35:22.853425 [ 16639 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:35:22.854419 [ 17244 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 21, state term 21, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:35:22.854959 [ 17244 ] {} RaftInstance: pre-vote term (0) is different, reset it to 21 2025.04.02 03:35:22.856063 [ 17244 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:35:22.860649 [ 17244 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 22, log idx 21, log term 21, priority (target 1 / mine 1) 2025.04.02 03:35:22.861958 [ 17244 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:35:22.863712 [ 17244 ] {} RaftInstance: state machine commit index 21, precommit index 21, last log index 21 2025.04.02 03:35:22.888178 [ 17242 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:35:22.889655 [ 17244 ] {} RaftInstance: [BECOME LEADER] appended new config at 22 2025.04.02 03:35:22.894908 [ 17260 ] {} RaftInstance: config at index 22 is committed, prev config log idx 21 2025.04.02 03:35:22.897819 [ 17260 ] {} RaftInstance: new config log idx 22, prev log idx 21, cur config log idx 21, prev log idx 20 2025.04.02 03:35:22.899450 [ 17260 ] {} RaftInstance: new configuration: log idx 22, prev log idx 21 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 22 2025.04.02 03:35:22.902993 [ 16639 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:35:22.904654 [ 16639 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:35:22.912755 [ 16639 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:35:22.913509 [ 16639 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:35:22.924719 [ 16639 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:35:22.925377 [ 16639 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:35:22.926950 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:35:22.928140 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:35:22.928975 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:35:22.930175 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:35:22.931175 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:35:22.932202 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:35:22.936546 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:35:22.937665 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:35:22.939690 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:35:22.940982 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:35:22.942345 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:35:22.943591 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:35:22.944677 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:35:22.946072 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:35:22.947321 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:35:22.948520 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:35:22.949737 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:35:22.951002 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:35:22.952283 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:35:22.954167 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:35:22.955576 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:35:22.956933 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:35:22.958479 [ 16639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:35:22.964458 [ 16639 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:35:22.965280 [ 16639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:35:23.845357 [ 16639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:35:23.846395 [ 16639 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:23.848284 [ 16639 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:35:23.850977 [ 16639 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:35:23.856560 [ 16639 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:35:23.857047 [ 17270 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:35:23.924606 [ 16639 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:35:23.930642 [ 16639 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:35:23.940983 [ 16639 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:35:23.947047 [ 16639 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:35:23.956215 [ 16639 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:35:23.958010 [ 16639 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:35:23.973565 [ 16639 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:35:24.001392 [ 16639 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:35:24.002722 [ 16639 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:35:24.002760 [ 16648 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:35:24.010714 [ 16648 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:35:28.457884 [ 16639 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:28.459059 [ 16639 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:35:28.463893 [ 16639 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:35:28.464936 [ 16639 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:35:28.466100 [ 17159 ] {} CancellationChecker: Execution took 9703 ms. 2025.04.02 03:35:28.467979 [ 16639 ] {} Application: Shutting down storages. 2025.04.02 03:35:28.468621 [ 16639 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:35:28.480426 [ 16639 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:35:28.481047 [ 16639 ] {} Context: Shutting down workload entity storage 2025.04.02 03:35:28.481743 [ 16639 ] {} Context: Shutting down named sessions 2025.04.02 03:35:28.483091 [ 16639 ] {} Context: Shutting down database catalog 2025.04.02 03:35:28.483931 [ 16639 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:35:28.485215 [ 16639 ] {} Context: Shutting down merges executor 2025.04.02 03:35:28.487821 [ 16639 ] {} Context: Shutting down fetches executor 2025.04.02 03:35:28.490064 [ 16639 ] {} Context: Shutting down moves executor 2025.04.02 03:35:28.491837 [ 16639 ] {} Context: Shutting down common executor 2025.04.02 03:35:28.493609 [ 16639 ] {} Context: Shutting down DDLWorker 2025.04.02 03:35:28.494188 [ 16639 ] {} Context: Shutting down caches 2025.04.02 03:35:28.495276 [ 16639 ] {} Context: Shutting down AccessControl 2025.04.02 03:35:28.499192 [ 16639 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:35:28.506128 [ 16639 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:35:28.683258 [ 16639 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:35:28.690381 [ 16639 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:35:28.704132 [ 16639 ] {} Application: Shut down storages. 2025.04.02 03:35:28.704864 [ 16639 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:35:29.172718 [ 16639 ] {} Application: Closed all listening sockets. 2025.04.02 03:35:29.173632 [ 16639 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:35:29.175164 [ 16639 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:35:29.412105 [ 16639 ] {} RaftInstance: shutting down raft core 2025.04.02 03:35:29.413809 [ 16639 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:35:29.414982 [ 16639 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:35:29.415885 [ 16639 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:35:29.417179 [ 16639 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:35:29.418252 [ 16639 ] {} RaftInstance: reset all pointers. 2025.04.02 03:35:29.419302 [ 16639 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:35:29.420702 [ 17261 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:35:29.420843 [ 16639 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:35:29.422773 [ 16639 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:35:29.423622 [ 16639 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:35:29.424428 [ 16639 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:35:29.425054 [ 16639 ] {} RaftInstance: manually create a snapshot on 22 2025.04.02 03:35:29.426996 [ 16639 ] {} RaftInstance: creating a snapshot for index 22 2025.04.02 03:35:29.427952 [ 16639 ] {} RaftInstance: create snapshot idx 22 log_term 22 2025.04.02 03:35:29.428889 [ 16639 ] {} KeeperStateMachine: Creating snapshot 22 2025.04.02 03:35:29.429899 [ 16639 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:35:29.433079 [ 16639 ] {} KeeperStateMachine: Created persistent snapshot 22 with path snapshot_22.bin.zstd 2025.04.02 03:35:29.434028 [ 16639 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:35:29.434721 [ 16639 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:35:29.435431 [ 16639 ] {} RaftInstance: snapshot idx 22 log_term 22 created, compact the log store if needed 2025.04.02 03:35:29.437608 [ 16639 ] {} RaftInstance: create snapshot idx 22 log_term 22 done: 8633 us elapsed 2025.04.02 03:35:29.439027 [ 17245 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:35:29.441312 [ 17253 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:35:29.441657 [ 17250 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:35:29.441776 [ 17249 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:35:29.441901 [ 17251 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:35:29.442060 [ 17252 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:35:29.442115 [ 17257 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:35:29.442263 [ 17259 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:35:29.442369 [ 17254 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:35:29.442910 [ 17246 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:29.442623 [ 17258 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:35:29.442768 [ 17248 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:29.442526 [ 17256 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:35:29.443047 [ 17244 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:29.443264 [ 17247 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:35:29.443445 [ 17245 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:29.445265 [ 17255 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:29.448289 [ 17242 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:35:29.448412 [ 16639 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:29.449582 [ 17243 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:35:29.452665 [ 16639 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:35:29.454340 [ 16639 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:35:29.455013 [ 16639 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:35:29.456746 [ 16639 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:35:29.457874 [ 16639 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:29.459778 [ 16639 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:29.460459 [ 16639 ] {} Context: Destructing threadpool writer 2025.04.02 03:35:29.503482 [ 16639 ] {} Application: Destroyed global context. 2025.04.02 03:35:29.505597 [ 16639 ] {} Application: Waiting for background threads 2025.04.02 03:35:29.566824 [ 16639 ] {} Application: Background threads finished in 61 ms 2025.04.02 03:35:29.570507 [ 16639 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:35:29.571049 [ 16639 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:29.592604 [ 16639 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:29.593466 [ 16639 ] {} Application: shutting down 2025.04.02 03:35:29.593987 [ 16639 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:35:29.595469 [ 16640 ] {} BaseDaemon: Received signal -2 2025.04.02 03:35:29.596237 [ 16640 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:35:29.799569 [ 16638 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:35:30.139091 [ 17372 ] {} Application: Will watch for the process with pid 17373 2025.04.02 03:35:30.139404 [ 17373 ] {} Application: Forked a child process to watch 2025.04.02 03:35:30.140266 [ 17373 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:35:30.248713 [ 17373 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 17373 2025.04.02 03:35:30.249316 [ 17373 ] {} Application: starting up 2025.04.02 03:35:30.249341 [ 17373 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:35:30.258438 [ 17373 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:35:30.259706 [ 17373 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:35:30.261346 [ 17373 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:35:30.261984 [ 17373 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:35:30.262839 [ 17373 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:35:30.263820 [ 17373 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:35:30.268293 [ 17373 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:35:30.269741 [ 17373 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:35:30.270479 [ 17373 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:35:30.271218 [ 17373 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:35:30.271702 [ 17373 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:35:32.994529 [ 17373 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:35:33.000520 [ 17373 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:35:33.060260 [ 17373 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:35:33.061804 [ 17373 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:35:33.063628 [ 17373 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:35:33.621880 [ 17389 ] {} CancellationChecker: Started worker function 2025.04.02 03:35:33.622896 [ 17373 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:35:33.623454 [ 17373 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:35:33.625168 [ 17373 ] {} Application: Initializing DateLUT. 2025.04.02 03:35:33.625892 [ 17373 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:35:33.627773 [ 17373 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:35:33.630352 [ 17373 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:35:33.637136 [ 17373 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:35:33.638094 [ 17373 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:35:33.638985 [ 17373 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:35:33.641346 [ 17373 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:35:33.642641 [ 17373 ] {} Application: Initializing interserver credentials. 2025.04.02 03:35:33.650367 [ 17373 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:35:33.727406 [ 17373 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:33.727896 [ 17373 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:35:33.729229 [ 17373 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:35:33.731577 [ 17373 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:35:33.737072 [ 17373 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:35:33.737740 [ 17373 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:35:33.741716 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:35:33.743532 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:35:33.744885 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:35:33.746242 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:35:33.747762 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:35:33.749089 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:35:33.752115 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:35:33.753541 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:35:33.754869 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:35:33.756121 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:35:33.757288 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:35:33.758522 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:35:33.759925 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:35:33.761308 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:35:33.762468 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:35:33.763860 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:35:33.765030 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:35:33.766382 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:35:33.767655 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:35:33.768950 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:35:33.770212 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:35:33.771499 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:35:33.772702 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:35:33.774173 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:35:33.775575 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:35:33.776813 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:35:33.777773 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:35:33.779512 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:35:33.780894 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:35:33.782148 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:35:33.783438 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:35:33.784602 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:35:33.785987 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:35:33.787323 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:35:33.788546 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:35:33.789962 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:35:33.791254 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:35:33.792507 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:35:33.793882 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:35:33.795102 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:35:33.796623 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:35:33.797969 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:35:33.799373 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:35:33.800709 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:35:33.802065 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:35:33.813095 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:35:33.814458 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:35:33.815803 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:35:33.817091 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:35:33.818478 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:35:33.820736 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:35:33.822248 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:35:33.823632 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:35:33.825046 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:35:33.826498 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:35:33.827837 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:35:33.829215 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:35:33.830799 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:35:33.831833 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:35:33.833141 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:35:33.834607 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:35:33.835971 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:35:33.837449 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:35:33.838844 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:35:33.840764 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:35:33.929675 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:35:33.931515 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:35:33.933918 [ 17373 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:35:33.975039 [ 17373 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:35:34.024339 [ 17373 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:35:34.863058 [ 17373 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:35:34.863766 [ 17373 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:35:34.864500 [ 17373 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:35:35.674241 [ 17373 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:35:35.675056 [ 17373 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:35:35.676849 [ 17373 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:35:35.679096 [ 17373 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:35.686075 [ 17373 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:35.693043 [ 17373 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:36.089338 [ 17373 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:36.105176 [ 17373 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:35:36.106648 [ 17373 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:36.158834 [ 17373 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:35:36.218466 [ 17373 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:35:36.219929 [ 17373 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:35:36.249856 [ 17373 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:35:36.266443 [ 17373 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:35:36.311182 [ 17373 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:35:36.311900 [ 17373 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:35:36.312568 [ 17373 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:35:36.313242 [ 17373 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:35:36.313952 [ 17373 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:35:36.315498 [ 17373 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:36.317317 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.389858 [ 17373 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:36.393300 [ 17373 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:36.394013 [ 17373 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:36.401854 [ 17373 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:36.404429 [ 17373 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh 2025.04.02 03:35:36.405072 [ 17373 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh 2025.04.02 03:35:36.405544 [ 17373 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh, size 4 2025.04.02 03:35:36.406971 [ 17373 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh. 2025.04.02 03:35:36.407347 [ 17972 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh 2025.04.02 03:35:36.424874 [ 17972 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh, size 4 2025.04.02 03:35:36.426476 [ 17373 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/glc/ifodanwqiflbenxefvrulfhopgekh. 2025.04.02 03:35:36.429529 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/glc/ifodanwqiflbenxefvrulfhopgekh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:36.437661 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/glc/ifodanwqiflbenxefvrulfhopgekh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:36.438653 [ 17373 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/glc/ifodanwqiflbenxefvrulfhopgekh, Version: Latest, Offset: 2 2025.04.02 03:35:36.544775 [ 17373 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/glc/ifodanwqiflbenxefvrulfhopgekh 2025.04.02 03:35:36.545515 [ 17373 ] {} deleteFileFromS3: Object with path s3/glc/ifodanwqiflbenxefvrulfhopgekh was removed from S3 2025.04.02 03:35:36.546324 [ 17373 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:35:36.547138 [ 17373 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:35:36.570439 [ 17373 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:36.574751 [ 17373 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:36.575438 [ 17373 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:36.580847 [ 17373 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:36.623025 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:36.634888 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:36.635807 [ 17373 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:35:36.648761 [ 17373 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:35:36.649838 [ 17373 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:35:36 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C861248A94F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:35:36.652659 [ 17373 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:35:36.663876 [ 17373 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:36.664634 [ 17373 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:35:36.691826 [ 17373 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:35:36.692769 [ 17373 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:35:36.694005 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.695245 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.696391 [ 17373 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:36.697464 [ 17373 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:36.698698 [ 17373 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:35:36.699861 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.701035 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.719803 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.721049 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.722269 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:36.745170 [ 17373 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:36.749600 [ 17373 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:36.750271 [ 17373 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:36.757112 [ 17373 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:36.771610 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ail/rnetcynrmzifwffkstwgeqyfhnnea (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:36.779940 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ail/rnetcynrmzifwffkstwgeqyfhnnea (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:36.780920 [ 17373 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ail/rnetcynrmzifwffkstwgeqyfhnnea, Version: Latest, Offset: 2 2025.04.02 03:35:36.795745 [ 17373 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ail/rnetcynrmzifwffkstwgeqyfhnnea 2025.04.02 03:35:36.796346 [ 17373 ] {} deleteFileFromS3: Object with path special/ail/rnetcynrmzifwffkstwgeqyfhnnea was removed from S3 2025.04.02 03:35:36.797026 [ 17373 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:35:36.797924 [ 17373 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:35:37.028331 [ 17373 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:37.045009 [ 17373 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:37.057342 [ 17373 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:37.127222 [ 17373 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:37.155944 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dhr/ofrcyoxrtlosogfyysbjvuicpldaw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:37.213322 [ 17373 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dhr/ofrcyoxrtlosogfyysbjvuicpldaw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:37.214479 [ 17373 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/dhr/ofrcyoxrtlosogfyysbjvuicpldaw, Version: Latest, Offset: 2 2025.04.02 03:35:37.250310 [ 17373 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/dhr/ofrcyoxrtlosogfyysbjvuicpldaw 2025.04.02 03:35:37.251055 [ 17373 ] {} deleteFileFromS3: Object with path test_02944/dhr/ofrcyoxrtlosogfyysbjvuicpldaw was removed from S3 2025.04.02 03:35:37.251877 [ 17373 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:35:37.252832 [ 17373 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:35:37.254193 [ 17373 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:37.321253 [ 17373 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:37.419184 [ 17373 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:35:37.420002 [ 17373 ] {} KeeperSnapshotManager: Found snapshot_20.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:37.420677 [ 17373 ] {} KeeperSnapshotManager: Found snapshot_21.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:37.421421 [ 17373 ] {} KeeperSnapshotManager: Found snapshot_22.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:37.433556 [ 17373 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:35:37.434348 [ 17373 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:35:37.436236 [ 17373 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:35:37.437177 [ 17373 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:35:37.437938 [ 17373 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:35:37.438662 [ 17373 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 22 2025.04.02 03:35:37.446298 [ 17373 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:35:37.447478 [ 17373 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 22 2025.04.02 03:35:37.450468 [ 17373 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 22 entries 2025.04.02 03:35:37.451551 [ 17373 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:35:37.452649 [ 17373 ] {} KeeperServer: Last local log idx 22 2025.04.02 03:35:37.453763 [ 17373 ] {} KeeperServer: Will use config from log store with log index 22 2025.04.02 03:35:37.462983 [ 17373 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:35:37.482921 [ 17373 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:35:37.486294 [ 17373 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:35:37.488906 [ 17373 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:35:37.489876 [ 17373 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:35:37.490919 [ 17373 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:35:37.492356 [ 17373 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:35:37.494143 [ 17373 ] {} RaftInstance: === INIT RAFT SERVER === commit index 22 term 22 election timer allowed log store start 1, end 22 config log idx 22, prev log idx 21 -- ASYNC REPLICATION -- 2025.04.02 03:35:37.495275 [ 17373 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:35:37.496620 [ 17373 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:35:37.497690 [ 17373 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:35:37.498080 [ 18003 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:35:37.550459 [ 17986 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:35:37.551679 [ 17986 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:35:37.551826 [ 17373 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:35:37.553382 [ 17986 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 22, state term 22, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:35:37.554084 [ 17986 ] {} RaftInstance: pre-vote term (0) is different, reset it to 22 2025.04.02 03:35:37.555409 [ 17986 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:35:37.560310 [ 17986 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 23, log idx 22, log term 22, priority (target 1 / mine 1) 2025.04.02 03:35:37.561405 [ 17986 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:35:37.563278 [ 17986 ] {} RaftInstance: state machine commit index 22, precommit index 22, last log index 22 2025.04.02 03:35:37.565799 [ 17984 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:35:37.567271 [ 17986 ] {} RaftInstance: [BECOME LEADER] appended new config at 23 2025.04.02 03:35:37.571310 [ 18002 ] {} RaftInstance: config at index 23 is committed, prev config log idx 22 2025.04.02 03:35:37.572311 [ 18002 ] {} RaftInstance: new config log idx 23, prev log idx 22, cur config log idx 22, prev log idx 21 2025.04.02 03:35:37.573142 [ 18002 ] {} RaftInstance: new configuration: log idx 23, prev log idx 22 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 23 2025.04.02 03:35:37.576194 [ 17373 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:35:37.577529 [ 17373 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:35:37.586059 [ 17373 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:35:37.586864 [ 17373 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:35:37.607643 [ 17373 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:35:37.608247 [ 17373 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:35:37.609841 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:35:37.611155 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:35:37.612164 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:35:37.613246 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:35:37.614667 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:35:37.615960 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:35:37.617170 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:35:37.618378 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:35:37.620311 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:35:37.621556 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:35:37.622657 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:35:37.623813 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:35:37.625030 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:35:37.667047 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:35:37.668544 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:35:37.670086 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:35:37.671379 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:35:37.672698 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:35:37.674287 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:35:37.675737 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:35:37.677073 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:35:37.678551 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:35:37.679841 [ 17373 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:35:37.684618 [ 17373 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:35:37.685344 [ 17373 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:35:38.550810 [ 17373 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:35:38.551920 [ 17373 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:38.554384 [ 17373 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:35:38.557164 [ 17373 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:35:38.562504 [ 17373 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:35:38.563131 [ 18012 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:35:39.032788 [ 17373 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:35:39.039922 [ 17373 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:35:39.048705 [ 17373 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:35:39.053461 [ 17373 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:35:39.060005 [ 17373 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:35:39.061473 [ 17373 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:35:39.070671 [ 17373 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:35:39.078624 [ 17373 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:35:39.079764 [ 17373 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:35:39.079989 [ 17390 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:35:39.087555 [ 17390 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:35:43.832171 [ 17373 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:43.841697 [ 17373 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:35:43.865523 [ 17373 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:35:43.866188 [ 17373 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:35:43.867137 [ 17389 ] {} CancellationChecker: Execution took 10246 ms. 2025.04.02 03:35:43.868760 [ 17373 ] {} Application: Shutting down storages. 2025.04.02 03:35:43.876175 [ 17373 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:35:43.929787 [ 17373 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:35:43.933324 [ 17373 ] {} Context: Shutting down workload entity storage 2025.04.02 03:35:43.937295 [ 17373 ] {} Context: Shutting down named sessions 2025.04.02 03:35:43.971980 [ 17373 ] {} Context: Shutting down database catalog 2025.04.02 03:35:43.972908 [ 17373 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:35:43.983276 [ 17373 ] {} Context: Shutting down merges executor 2025.04.02 03:35:43.986969 [ 17373 ] {} Context: Shutting down fetches executor 2025.04.02 03:35:44.018356 [ 17373 ] {} Context: Shutting down moves executor 2025.04.02 03:35:44.020476 [ 17373 ] {} Context: Shutting down common executor 2025.04.02 03:35:44.022514 [ 17373 ] {} Context: Shutting down DDLWorker 2025.04.02 03:35:44.023167 [ 17373 ] {} Context: Shutting down caches 2025.04.02 03:35:44.024251 [ 17373 ] {} Context: Shutting down AccessControl 2025.04.02 03:35:44.028870 [ 17373 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:35:44.119744 [ 17373 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:35:44.409640 [ 17373 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:35:44.415145 [ 17373 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:35:44.439357 [ 17373 ] {} Application: Shut down storages. 2025.04.02 03:35:44.440147 [ 17373 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:35:44.847339 [ 17373 ] {} Application: Closed all listening sockets. 2025.04.02 03:35:44.848211 [ 17373 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:35:44.849275 [ 17373 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:35:45.083067 [ 17373 ] {} RaftInstance: shutting down raft core 2025.04.02 03:35:45.084592 [ 17373 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:35:45.085424 [ 17373 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:35:45.086219 [ 17373 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:35:45.087227 [ 17373 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:35:45.087962 [ 17373 ] {} RaftInstance: reset all pointers. 2025.04.02 03:35:45.088880 [ 17373 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:35:45.090524 [ 18003 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:35:45.090648 [ 17373 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:35:45.091917 [ 17373 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:35:45.092800 [ 17373 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:35:45.093717 [ 17373 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:35:45.094441 [ 17373 ] {} RaftInstance: manually create a snapshot on 23 2025.04.02 03:35:45.104008 [ 17373 ] {} RaftInstance: creating a snapshot for index 23 2025.04.02 03:35:45.105104 [ 17373 ] {} RaftInstance: create snapshot idx 23 log_term 23 2025.04.02 03:35:45.106098 [ 17373 ] {} KeeperStateMachine: Creating snapshot 23 2025.04.02 03:35:45.107156 [ 17373 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:35:45.110763 [ 17373 ] {} KeeperStateMachine: Created persistent snapshot 23 with path snapshot_23.bin.zstd 2025.04.02 03:35:45.111739 [ 17373 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:35:45.112566 [ 17373 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:35:45.113545 [ 17373 ] {} RaftInstance: snapshot idx 23 log_term 23 created, compact the log store if needed 2025.04.02 03:35:45.115486 [ 17373 ] {} RaftInstance: create snapshot idx 23 log_term 23 done: 9408 us elapsed 2025.04.02 03:35:45.116836 [ 17989 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:35:45.119050 [ 17987 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:35:45.119234 [ 17995 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:35:45.119270 [ 17991 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:35:45.119478 [ 17994 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:35:45.119657 [ 17998 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:35:45.119670 [ 17996 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:35:45.119860 [ 17993 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:35:45.120148 [ 18001 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:45.119873 [ 17997 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:35:45.120297 [ 17990 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:45.120403 [ 17986 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:45.120533 [ 17999 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:45.120644 [ 17989 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:45.120671 [ 17992 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:45.120812 [ 17988 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:35:45.120053 [ 18000 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:35:45.131930 [ 17984 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:35:45.132019 [ 17373 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:45.133322 [ 17985 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:35:45.136297 [ 17373 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:35:45.137398 [ 17373 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:35:45.138022 [ 17373 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:35:45.139602 [ 17373 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:35:45.140805 [ 17373 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:45.142953 [ 17373 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:35:45.143688 [ 17373 ] {} Context: Destructing threadpool writer 2025.04.02 03:35:45.240794 [ 17373 ] {} Application: Destroyed global context. 2025.04.02 03:35:45.243072 [ 17373 ] {} Application: Waiting for background threads 2025.04.02 03:35:45.424401 [ 17373 ] {} Application: Background threads finished in 181 ms 2025.04.02 03:35:45.465109 [ 17373 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:35:45.477756 [ 17373 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:35:45.629272 [ 17373 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:45.630264 [ 17373 ] {} Application: shutting down 2025.04.02 03:35:45.630941 [ 17373 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:35:45.632691 [ 17374 ] {} BaseDaemon: Received signal -2 2025.04.02 03:35:45.633620 [ 17374 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:35:45.826477 [ 17372 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:35:46.644901 [ 18122 ] {} Application: Will watch for the process with pid 18123 2025.04.02 03:35:46.645105 [ 18123 ] {} Application: Forked a child process to watch 2025.04.02 03:35:46.646038 [ 18123 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:35:46.754772 [ 18123 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 18123 2025.04.02 03:35:46.755239 [ 18123 ] {} Application: starting up 2025.04.02 03:35:46.755260 [ 18123 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:35:46.764839 [ 18123 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:35:46.766708 [ 18123 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:35:46.768759 [ 18123 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:35:46.769753 [ 18123 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:35:46.771172 [ 18123 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:35:46.772534 [ 18123 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:35:46.778075 [ 18123 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:35:46.779459 [ 18123 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:35:46.780418 [ 18123 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:35:46.781178 [ 18123 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:35:46.781928 [ 18123 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:35:49.063698 [ 18123 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:35:49.076619 [ 18123 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:35:49.109391 [ 18123 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:35:49.126311 [ 18123 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:35:49.138108 [ 18123 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:35:49.560953 [ 18123 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:35:49.561678 [ 18123 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:35:49.578233 [ 18138 ] {} CancellationChecker: Started worker function 2025.04.02 03:35:49.578768 [ 18123 ] {} Application: Initializing DateLUT. 2025.04.02 03:35:49.579445 [ 18123 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:35:49.581277 [ 18123 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:35:49.585334 [ 18123 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:35:49.591466 [ 18123 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:35:49.592324 [ 18123 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:35:49.593291 [ 18123 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:35:49.595696 [ 18123 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:35:49.596753 [ 18123 ] {} Application: Initializing interserver credentials. 2025.04.02 03:35:49.605018 [ 18123 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:35:49.728460 [ 18123 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:49.729027 [ 18123 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:35:49.730406 [ 18123 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:35:49.732718 [ 18123 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:35:49.738312 [ 18123 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:35:49.739065 [ 18123 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:35:49.743309 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:35:49.745072 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:35:49.794592 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:35:49.796010 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:35:49.797543 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:35:49.799019 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:35:49.854377 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:35:49.858096 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:35:49.890223 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:35:49.891963 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:35:49.910394 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:35:49.922524 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:35:49.924181 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:35:49.937817 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:35:49.945839 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:35:49.956402 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:35:49.958048 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:35:49.989248 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:35:50.014344 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:35:50.031006 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:35:50.046658 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:35:50.062936 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:35:50.067012 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:35:50.083080 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:35:50.085431 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:35:50.114051 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:35:50.122254 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:35:50.148511 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:35:50.156380 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:35:50.158244 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:35:50.159762 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:35:50.161321 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:35:50.162907 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:35:50.164588 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:35:50.166087 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:35:50.167741 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:35:50.263667 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:35:50.266031 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:35:50.267799 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:35:50.322191 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:35:50.324729 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:35:50.327212 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:35:50.329159 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:35:50.331306 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:35:50.333122 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:35:50.334942 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:35:50.336778 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:35:50.338336 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:35:50.340193 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:35:50.342451 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:35:50.345372 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:35:50.347580 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:35:50.349618 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:35:50.351557 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:35:50.353217 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:35:50.354760 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:35:50.356470 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:35:50.358091 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:35:50.359390 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:35:50.360674 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:35:50.362460 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:35:50.364085 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:35:50.365631 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:35:50.367120 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:35:50.368369 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:35:50.369956 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:35:50.371641 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:35:50.374004 [ 18123 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:35:50.585165 [ 18123 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:35:50.592689 [ 18123 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:35:51.578526 [ 18123 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:35:51.579468 [ 18123 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:35:51.580302 [ 18123 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:35:52.110594 [ 18123 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:35:52.111396 [ 18123 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:35:52.113358 [ 18123 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:35:52.115862 [ 18123 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:52.122999 [ 18123 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:52.129652 [ 18123 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:35:52.434441 [ 18123 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:35:52.516203 [ 18123 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:35:52.536416 [ 18123 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:52.552101 [ 18123 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:35:52.641665 [ 18123 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:35:52.643156 [ 18123 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:35:52.648004 [ 18123 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:35:52.649229 [ 18123 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:35:52.753150 [ 18123 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:35:52.754291 [ 18123 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:35:52.759641 [ 18123 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:35:52.760319 [ 18123 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:35:52.760968 [ 18123 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:35:52.762520 [ 18123 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:52.763797 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:52.948526 [ 18123 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:52.953399 [ 18123 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:52.954232 [ 18123 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:52.963837 [ 18123 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:52.966659 [ 18123 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr 2025.04.02 03:35:52.967230 [ 18123 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr 2025.04.02 03:35:52.967750 [ 18123 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr, size 4 2025.04.02 03:35:52.969556 [ 18722 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr 2025.04.02 03:35:52.988085 [ 18722 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr, size 4 2025.04.02 03:35:53.031222 [ 18123 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr. 2025.04.02 03:35:53.033181 [ 18123 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/smn/tlahjhyaxpffubiwggdukjqytuwbr. 2025.04.02 03:35:53.037543 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/smn/tlahjhyaxpffubiwggdukjqytuwbr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.047266 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/smn/tlahjhyaxpffubiwggdukjqytuwbr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.048414 [ 18123 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/smn/tlahjhyaxpffubiwggdukjqytuwbr, Version: Latest, Offset: 2 2025.04.02 03:35:53.067140 [ 18123 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/smn/tlahjhyaxpffubiwggdukjqytuwbr 2025.04.02 03:35:53.067884 [ 18123 ] {} deleteFileFromS3: Object with path s3/smn/tlahjhyaxpffubiwggdukjqytuwbr was removed from S3 2025.04.02 03:35:53.068582 [ 18123 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:35:53.069467 [ 18123 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:35:53.090541 [ 18123 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:53.094987 [ 18123 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:53.095582 [ 18123 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:53.100704 [ 18123 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:53.127035 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.139464 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.140513 [ 18123 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:35:53.153645 [ 18123 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:35:53.154705 [ 18123 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:35:53 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C89EA0CA964 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:35:53.157073 [ 18123 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:35:53.242069 [ 18123 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:53.242992 [ 18123 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:35:53.243966 [ 18123 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:35:53.245227 [ 18123 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:35:53.246592 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.248374 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.249751 [ 18123 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:53.251157 [ 18123 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:53.252419 [ 18123 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:35:53.253926 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.255343 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.285939 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.310129 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.342189 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.545818 [ 18123 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:53.565922 [ 18123 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:53.585345 [ 18123 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:53.643038 [ 18123 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:53.660503 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/cwq/spomgbdymdbzszopuujctmoobzdou (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.674053 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/cwq/spomgbdymdbzszopuujctmoobzdou (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.675183 [ 18123 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/cwq/spomgbdymdbzszopuujctmoobzdou, Version: Latest, Offset: 2 2025.04.02 03:35:53.742603 [ 18123 ] {} deleteFileFromS3: No blob storage log, not writing blob special/cwq/spomgbdymdbzszopuujctmoobzdou 2025.04.02 03:35:53.743262 [ 18123 ] {} deleteFileFromS3: Object with path special/cwq/spomgbdymdbzszopuujctmoobzdou was removed from S3 2025.04.02 03:35:53.743813 [ 18123 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:35:53.744792 [ 18123 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:35:53.781269 [ 18123 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:35:53.785652 [ 18123 ] {} S3Client: Provider type: Unknown 2025.04.02 03:35:53.786366 [ 18123 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:35:53.793015 [ 18123 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:35:53.805917 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/oys/xtlyfotgwggsiwnlxnmqtpqeunfiu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.813228 [ 18123 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/oys/xtlyfotgwggsiwnlxnmqtpqeunfiu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:35:53.814283 [ 18123 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/oys/xtlyfotgwggsiwnlxnmqtpqeunfiu, Version: Latest, Offset: 2 2025.04.02 03:35:53.829027 [ 18123 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/oys/xtlyfotgwggsiwnlxnmqtpqeunfiu 2025.04.02 03:35:53.829839 [ 18123 ] {} deleteFileFromS3: Object with path test_02944/oys/xtlyfotgwggsiwnlxnmqtpqeunfiu was removed from S3 2025.04.02 03:35:53.830476 [ 18123 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:35:53.831291 [ 18123 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:35:53.832307 [ 18123 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:35:53.856598 [ 18123 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:35:53.885558 [ 18123 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:35:53.886522 [ 18123 ] {} KeeperSnapshotManager: Found snapshot_23.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:53.887200 [ 18123 ] {} KeeperSnapshotManager: Found snapshot_21.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:53.887932 [ 18123 ] {} KeeperSnapshotManager: Found snapshot_22.bin.zstd on LocalSnapshotDisk 2025.04.02 03:35:53.899294 [ 18123 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:35:53.900062 [ 18123 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:35:53.901584 [ 18123 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:35:53.902234 [ 18123 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:35:53.902887 [ 18123 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:35:53.903412 [ 18123 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 23 2025.04.02 03:35:53.910234 [ 18123 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:35:53.911340 [ 18123 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 23 2025.04.02 03:35:53.914476 [ 18123 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 23 entries 2025.04.02 03:35:53.915446 [ 18123 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:35:53.916461 [ 18123 ] {} KeeperServer: Last local log idx 23 2025.04.02 03:35:53.917642 [ 18123 ] {} KeeperServer: Will use config from log store with log index 23 2025.04.02 03:35:53.927424 [ 18123 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:35:53.953567 [ 18123 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:35:53.957050 [ 18123 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:35:53.959537 [ 18123 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:35:53.960375 [ 18123 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:35:53.961163 [ 18123 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:35:53.962566 [ 18123 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:35:53.964239 [ 18123 ] {} RaftInstance: === INIT RAFT SERVER === commit index 23 term 23 election timer allowed log store start 1, end 23 config log idx 23, prev log idx 22 -- ASYNC REPLICATION -- 2025.04.02 03:35:53.965305 [ 18123 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:35:53.966752 [ 18123 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:35:53.967922 [ 18123 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:35:53.968246 [ 18753 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:35:54.020735 [ 18737 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:35:54.021660 [ 18737 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:35:54.021913 [ 18123 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:35:54.023104 [ 18737 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 23, state term 23, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:35:54.023779 [ 18737 ] {} RaftInstance: pre-vote term (0) is different, reset it to 23 2025.04.02 03:35:54.025442 [ 18737 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:35:54.030237 [ 18737 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 24, log idx 23, log term 23, priority (target 1 / mine 1) 2025.04.02 03:35:54.031496 [ 18737 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:35:54.033370 [ 18737 ] {} RaftInstance: state machine commit index 23, precommit index 23, last log index 23 2025.04.02 03:35:54.035985 [ 18734 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:35:54.037710 [ 18737 ] {} RaftInstance: [BECOME LEADER] appended new config at 24 2025.04.02 03:35:54.041621 [ 18752 ] {} RaftInstance: config at index 24 is committed, prev config log idx 23 2025.04.02 03:35:54.042654 [ 18752 ] {} RaftInstance: new config log idx 24, prev log idx 23, cur config log idx 23, prev log idx 22 2025.04.02 03:35:54.043477 [ 18752 ] {} RaftInstance: new configuration: log idx 24, prev log idx 23 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 24 2025.04.02 03:35:54.046339 [ 18123 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:35:54.047651 [ 18123 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:35:54.067230 [ 18123 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:35:54.067936 [ 18123 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:35:54.080240 [ 18123 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:35:54.080875 [ 18123 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:35:54.082438 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:35:54.083539 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:35:54.084501 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:35:54.085657 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:35:54.086867 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:35:54.088175 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:35:54.089305 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:35:54.090438 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:35:54.092337 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:35:54.093596 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:35:54.094926 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:35:54.096460 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:35:54.097857 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:35:54.099051 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:35:54.100238 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:35:54.101552 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:35:54.102727 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:35:54.103981 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:35:54.104950 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:35:54.140355 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:35:54.141969 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:35:54.143525 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:35:54.145125 [ 18123 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:35:54.149898 [ 18123 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:35:54.150748 [ 18123 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:35:54.968875 [ 18123 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:35:54.969946 [ 18123 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:35:54.971850 [ 18123 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:35:54.974529 [ 18123 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:35:54.982959 [ 18123 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:35:54.983359 [ 18762 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:35:55.426446 [ 18123 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:35:55.466978 [ 18123 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:35:55.586377 [ 18123 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:35:55.592821 [ 18123 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:35:55.600327 [ 18123 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:35:55.602070 [ 18123 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:35:55.607529 [ 18123 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:35:55.615949 [ 18123 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:35:55.617077 [ 18123 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:35:55.617167 [ 18140 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:35:55.624770 [ 18140 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:35:59.886218 [ 18123 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:35:59.887521 [ 18123 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:35:59.892319 [ 18123 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:35:59.893086 [ 18123 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:35:59.894152 [ 18138 ] {} CancellationChecker: Execution took 10335 ms. 2025.04.02 03:35:59.895806 [ 18123 ] {} Application: Shutting down storages. 2025.04.02 03:35:59.896548 [ 18123 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:35:59.904513 [ 18123 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:35:59.905128 [ 18123 ] {} Context: Shutting down workload entity storage 2025.04.02 03:35:59.905846 [ 18123 ] {} Context: Shutting down named sessions 2025.04.02 03:35:59.907390 [ 18123 ] {} Context: Shutting down database catalog 2025.04.02 03:35:59.908327 [ 18123 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:35:59.909682 [ 18123 ] {} Context: Shutting down merges executor 2025.04.02 03:35:59.912550 [ 18123 ] {} Context: Shutting down fetches executor 2025.04.02 03:35:59.983512 [ 18123 ] {} Context: Shutting down moves executor 2025.04.02 03:35:59.985820 [ 18123 ] {} Context: Shutting down common executor 2025.04.02 03:35:59.988060 [ 18123 ] {} Context: Shutting down DDLWorker 2025.04.02 03:35:59.988707 [ 18123 ] {} Context: Shutting down caches 2025.04.02 03:35:59.990083 [ 18123 ] {} Context: Shutting down AccessControl 2025.04.02 03:35:59.994913 [ 18123 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:36:00.002600 [ 18123 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:36:00.464814 [ 18123 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:36:00.470213 [ 18123 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:36:00.494184 [ 18123 ] {} Application: Shut down storages. 2025.04.02 03:36:00.494909 [ 18123 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:36:00.827771 [ 18123 ] {} Application: Closed all listening sockets. 2025.04.02 03:36:00.828602 [ 18123 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:36:00.830151 [ 18123 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:36:01.073290 [ 18123 ] {} RaftInstance: shutting down raft core 2025.04.02 03:36:01.074819 [ 18123 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:36:01.075631 [ 18123 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:36:01.101278 [ 18123 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:36:01.102682 [ 18123 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:36:01.104064 [ 18123 ] {} RaftInstance: reset all pointers. 2025.04.02 03:36:01.133800 [ 18123 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:36:01.135000 [ 18753 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:36:01.135134 [ 18123 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:36:01.136206 [ 18123 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:36:01.136869 [ 18123 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:36:01.137736 [ 18123 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:36:01.149548 [ 18123 ] {} RaftInstance: manually create a snapshot on 24 2025.04.02 03:36:01.182213 [ 18123 ] {} RaftInstance: creating a snapshot for index 24 2025.04.02 03:36:01.197534 [ 18123 ] {} RaftInstance: create snapshot idx 24 log_term 24 2025.04.02 03:36:01.225451 [ 18123 ] {} KeeperStateMachine: Creating snapshot 24 2025.04.02 03:36:01.249336 [ 18123 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:36:01.269137 [ 18123 ] {} KeeperStateMachine: Created persistent snapshot 24 with path snapshot_24.bin.zstd 2025.04.02 03:36:01.270176 [ 18123 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:36:01.270914 [ 18123 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:36:01.271775 [ 18123 ] {} RaftInstance: snapshot idx 24 log_term 24 created, compact the log store if needed 2025.04.02 03:36:01.286066 [ 18123 ] {} RaftInstance: create snapshot idx 24 log_term 24 done: 76194 us elapsed 2025.04.02 03:36:01.289175 [ 18739 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:36:01.294428 [ 18736 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:36:01.294611 [ 18738 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:36:01.294737 [ 18746 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:36:01.294956 [ 18743 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:36:01.294975 [ 18748 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:36:01.295671 [ 18749 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:36:01.295483 [ 18750 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:36:01.295124 [ 18745 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:36:01.296139 [ 18739 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:01.295973 [ 18737 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:36:01.296083 [ 18747 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:01.295815 [ 18751 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:36:01.296253 [ 18744 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:36:01.296759 [ 18742 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:36:01.296558 [ 18740 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:36:01.296301 [ 18741 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:36:01.303586 [ 18734 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:36:01.303781 [ 18123 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:36:01.304803 [ 18735 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:36:01.307698 [ 18123 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:36:01.308908 [ 18123 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:36:01.309492 [ 18123 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:36:01.311018 [ 18123 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:36:01.311923 [ 18123 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:36:01.313625 [ 18123 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:36:01.314309 [ 18123 ] {} Context: Destructing threadpool writer 2025.04.02 03:36:01.347628 [ 18123 ] {} Application: Destroyed global context. 2025.04.02 03:36:01.349459 [ 18123 ] {} Application: Waiting for background threads 2025.04.02 03:36:01.405585 [ 18123 ] {} Application: Background threads finished in 56 ms 2025.04.02 03:36:01.409346 [ 18123 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:36:01.409990 [ 18123 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:36:01.429774 [ 18123 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:36:01.430640 [ 18123 ] {} Application: shutting down 2025.04.02 03:36:01.431211 [ 18123 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:36:01.432782 [ 18124 ] {} BaseDaemon: Received signal -2 2025.04.02 03:36:01.433649 [ 18124 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:36:01.542278 [ 18122 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:36:02.298574 [ 18868 ] {} Application: Will watch for the process with pid 18869 2025.04.02 03:36:02.298731 [ 18869 ] {} Application: Forked a child process to watch 2025.04.02 03:36:02.299455 [ 18869 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:36:02.404792 [ 18869 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 18869 2025.04.02 03:36:02.405385 [ 18869 ] {} Application: starting up 2025.04.02 03:36:02.405405 [ 18869 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:36:02.414580 [ 18869 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:36:02.416341 [ 18869 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:36:02.418547 [ 18869 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:36:02.419629 [ 18869 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:36:02.420660 [ 18869 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:36:02.421947 [ 18869 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:36:02.427847 [ 18869 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:36:02.429366 [ 18869 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:36:02.430339 [ 18869 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:36:02.431217 [ 18869 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:36:02.432071 [ 18869 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:36:04.774555 [ 18869 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:36:04.794818 [ 18869 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:36:04.856246 [ 18869 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:36:04.857531 [ 18869 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:36:04.859454 [ 18869 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:36:05.089780 [ 18869 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:36:05.090437 [ 18869 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:36:05.092282 [ 18869 ] {} Application: Initializing DateLUT. 2025.04.02 03:36:05.092873 [ 18869 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:36:05.094501 [ 18869 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:36:05.097362 [ 18869 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:36:05.098604 [ 18885 ] {} CancellationChecker: Started worker function 2025.04.02 03:36:05.104323 [ 18869 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:36:05.105226 [ 18869 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:36:05.106101 [ 18869 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:36:05.108519 [ 18869 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:36:05.109589 [ 18869 ] {} Application: Initializing interserver credentials. 2025.04.02 03:36:05.117246 [ 18869 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:36:05.163206 [ 18869 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:36:05.163726 [ 18869 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 03:36:05.165108 [ 18869 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:36:05.167618 [ 18869 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:36:05.174922 [ 18869 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:36:05.175606 [ 18869 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:36:05.179873 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:36:05.184124 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:36:05.268134 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:36:05.269904 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:36:05.271460 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 03:36:05.273111 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:36:05.276366 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:36:05.277992 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:36:05.279381 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:36:05.280725 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:36:05.282330 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:36:05.283987 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:36:05.285406 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:36:05.286780 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:36:05.287910 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:36:05.289523 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:36:05.290804 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:36:05.292138 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:36:05.293551 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:36:05.294916 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:36:05.296107 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:36:05.297345 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:36:05.298672 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:36:05.300150 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:36:05.301708 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:36:05.303110 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:36:05.304167 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:36:05.305875 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:36:05.307125 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:36:05.308474 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:36:05.309825 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:36:05.311016 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:36:05.312286 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:36:05.313488 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:36:05.314755 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:36:05.316162 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:36:05.317639 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:36:05.318773 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:36:05.319993 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:36:05.321542 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:36:05.323213 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:36:05.324396 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:36:05.325747 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:36:05.327213 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 03:36:05.328511 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:36:05.329781 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:36:05.331091 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:36:05.332487 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:36:05.333720 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:36:05.335058 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:36:05.337303 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:36:05.339014 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:36:05.340780 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:36:05.342231 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:36:05.343424 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:36:05.344747 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:36:05.346338 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:36:05.347754 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:36:05.348669 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:36:05.350047 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:36:05.351432 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:36:05.366520 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:36:05.368258 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:36:05.397397 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:36:05.422745 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:36:05.437499 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:36:05.454511 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:36:05.457235 [ 18869 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:36:05.696110 [ 18869 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:36:05.704437 [ 18869 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:36:06.589660 [ 18869 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:36:06.590431 [ 18869 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:36:06.591217 [ 18869 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:36:07.074475 [ 18869 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:36:07.075060 [ 18869 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:36:07.076782 [ 18869 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:36:07.079922 [ 18869 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:36:07.141969 [ 18869 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:36:07.219528 [ 18869 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:36:07.628430 [ 18869 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 03:36:07.631471 [ 18869 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:36:07.632507 [ 18869 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:36:07.638309 [ 18869 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:36:07.642333 [ 18869 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 03:36:07.643554 [ 18869 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:36:07.646283 [ 18869 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:36:07.647601 [ 18869 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:36:07.668440 [ 18869 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:36:07.669037 [ 18869 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:36:07.669704 [ 18869 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 03:36:07.670402 [ 18869 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 03:36:07.671091 [ 18869 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:36:07.672460 [ 18869 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:36:07.673672 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.751355 [ 18869 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:36:07.755750 [ 18869 ] {} S3Client: Provider type: Unknown 2025.04.02 03:36:07.756407 [ 18869 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:36:07.764935 [ 18869 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:36:07.767691 [ 18869 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma 2025.04.02 03:36:07.768306 [ 18869 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma 2025.04.02 03:36:07.768805 [ 18869 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma, size 4 2025.04.02 03:36:07.770209 [ 18869 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma. 2025.04.02 03:36:07.770521 [ 19464 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma 2025.04.02 03:36:07.789236 [ 19464 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma, size 4 2025.04.02 03:36:07.790718 [ 18869 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/ktp/qerwglaqopuotscnylkkqjjbvssma. 2025.04.02 03:36:07.796795 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ktp/qerwglaqopuotscnylkkqjjbvssma (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:07.806122 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ktp/qerwglaqopuotscnylkkqjjbvssma (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:07.807250 [ 18869 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/ktp/qerwglaqopuotscnylkkqjjbvssma, Version: Latest, Offset: 2 2025.04.02 03:36:07.822053 [ 18869 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/ktp/qerwglaqopuotscnylkkqjjbvssma 2025.04.02 03:36:07.822680 [ 18869 ] {} deleteFileFromS3: Object with path s3/ktp/qerwglaqopuotscnylkkqjjbvssma was removed from S3 2025.04.02 03:36:07.823482 [ 18869 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:36:07.824259 [ 18869 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:36:07.845288 [ 18869 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:36:07.849395 [ 18869 ] {} S3Client: Provider type: Unknown 2025.04.02 03:36:07.850035 [ 18869 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:36:07.855292 [ 18869 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:36:07.871925 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:07.884803 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:07.885958 [ 18869 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 03:36:07.920270 [ 18869 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:36:07.924516 [ 18869 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:36:07 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325C8D5A3598A4 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:36:07.927152 [ 18869 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:36:07.946565 [ 18869 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:36:07.947397 [ 18869 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:36:07.948263 [ 18869 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:36:07.949379 [ 18869 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:36:07.950563 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.951695 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.952904 [ 18869 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:36:07.954244 [ 18869 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:36:07.955432 [ 18869 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:36:07.956855 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.958281 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.959578 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.961094 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.962387 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:07.991645 [ 18869 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:36:07.996361 [ 18869 ] {} S3Client: Provider type: Unknown 2025.04.02 03:36:07.997243 [ 18869 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:36:08.005228 [ 18869 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:36:08.021009 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/qew/kasxydmmyftzujoqkavrlabiisxmd (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:08.091925 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/qew/kasxydmmyftzujoqkavrlabiisxmd (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:08.165670 [ 18869 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/qew/kasxydmmyftzujoqkavrlabiisxmd, Version: Latest, Offset: 2 2025.04.02 03:36:08.313382 [ 18869 ] {} deleteFileFromS3: No blob storage log, not writing blob special/qew/kasxydmmyftzujoqkavrlabiisxmd 2025.04.02 03:36:08.321381 [ 18869 ] {} deleteFileFromS3: Object with path special/qew/kasxydmmyftzujoqkavrlabiisxmd was removed from S3 2025.04.02 03:36:08.338202 [ 18869 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:36:08.377671 [ 18869 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:36:08.501125 [ 18869 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:36:08.505041 [ 18869 ] {} S3Client: Provider type: Unknown 2025.04.02 03:36:08.506038 [ 18869 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:36:08.515012 [ 18869 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:36:08.531878 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/rsu/vzmlsgmwnanbfziesbdhnbulfurrv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:08.541935 [ 18869 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/rsu/vzmlsgmwnanbfziesbdhnbulfurrv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 03:36:08.543221 [ 18869 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/rsu/vzmlsgmwnanbfziesbdhnbulfurrv, Version: Latest, Offset: 2 2025.04.02 03:36:08.558170 [ 18869 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/rsu/vzmlsgmwnanbfziesbdhnbulfurrv 2025.04.02 03:36:08.559340 [ 18869 ] {} deleteFileFromS3: Object with path test_02944/rsu/vzmlsgmwnanbfziesbdhnbulfurrv was removed from S3 2025.04.02 03:36:08.560055 [ 18869 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:36:08.560818 [ 18869 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:36:08.562650 [ 18869 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:36:08.630504 [ 18869 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:36:08.667850 [ 18869 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:36:08.668725 [ 18869 ] {} KeeperSnapshotManager: Found snapshot_24.bin.zstd on LocalSnapshotDisk 2025.04.02 03:36:08.669483 [ 18869 ] {} KeeperSnapshotManager: Found snapshot_23.bin.zstd on LocalSnapshotDisk 2025.04.02 03:36:08.670153 [ 18869 ] {} KeeperSnapshotManager: Found snapshot_22.bin.zstd on LocalSnapshotDisk 2025.04.02 03:36:08.681175 [ 18869 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:36:08.681947 [ 18869 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:36:08.683796 [ 18869 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:36:08.684686 [ 18869 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:36:08.685470 [ 18869 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:36:08.686096 [ 18869 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 24 2025.04.02 03:36:08.693457 [ 18869 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:36:08.694895 [ 18869 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 24 2025.04.02 03:36:08.698306 [ 18869 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 24 entries 2025.04.02 03:36:08.699288 [ 18869 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:36:08.700295 [ 18869 ] {} KeeperServer: Last local log idx 24 2025.04.02 03:36:08.701427 [ 18869 ] {} KeeperServer: Will use config from log store with log index 24 2025.04.02 03:36:08.710549 [ 18869 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:36:08.721320 [ 18869 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:36:08.724431 [ 18869 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:36:08.726810 [ 18869 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:36:08.727601 [ 18869 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:36:08.728602 [ 18869 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:36:08.734484 [ 18869 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:36:08.736111 [ 18869 ] {} RaftInstance: === INIT RAFT SERVER === commit index 24 term 24 election timer allowed log store start 1, end 24 config log idx 24, prev log idx 23 -- ASYNC REPLICATION -- 2025.04.02 03:36:08.737030 [ 18869 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:36:08.738698 [ 18869 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:36:08.739916 [ 18869 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:36:08.740279 [ 19495 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:36:08.792782 [ 19479 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:36:08.793744 [ 19479 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:36:08.793852 [ 18869 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:36:08.795283 [ 19479 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 24, state term 24, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:36:08.796002 [ 19479 ] {} RaftInstance: pre-vote term (0) is different, reset it to 24 2025.04.02 03:36:08.797166 [ 19479 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:36:08.802793 [ 19479 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 25, log idx 24, log term 24, priority (target 1 / mine 1) 2025.04.02 03:36:08.803873 [ 19479 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:36:08.805494 [ 19479 ] {} RaftInstance: state machine commit index 24, precommit index 24, last log index 24 2025.04.02 03:36:08.807940 [ 19476 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 03:36:08.812561 [ 19479 ] {} RaftInstance: [BECOME LEADER] appended new config at 25 2025.04.02 03:36:08.816946 [ 19494 ] {} RaftInstance: config at index 25 is committed, prev config log idx 24 2025.04.02 03:36:08.818174 [ 19494 ] {} RaftInstance: new config log idx 25, prev log idx 24, cur config log idx 24, prev log idx 23 2025.04.02 03:36:08.818984 [ 19494 ] {} RaftInstance: new configuration: log idx 25, prev log idx 24 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 25 2025.04.02 03:36:08.822225 [ 18869 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:36:08.823565 [ 18869 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:36:08.834992 [ 18869 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:36:08.835900 [ 18869 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:36:08.848217 [ 18869 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:36:08.848820 [ 18869 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:36:08.850549 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:36:08.851792 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:36:08.852589 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:36:08.853797 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:36:08.854967 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:36:08.856121 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:36:08.857279 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:36:08.858424 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:36:08.860144 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:36:08.861486 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:36:08.862799 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:36:08.864572 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:36:08.865977 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:36:08.867337 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:36:08.868627 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:36:08.870014 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:36:08.871199 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:36:08.872551 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:36:08.873742 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:36:08.875153 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:36:08.876378 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:36:08.877678 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:36:08.879263 [ 18869 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:36:08.885117 [ 18869 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:36:08.885850 [ 18869 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:36:09.746842 [ 18869 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:36:09.748048 [ 18869 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:36:09.749811 [ 18869 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:36:09.752330 [ 18869 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:36:09.758428 [ 18869 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:36:09.758793 [ 19504 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:36:10.207077 [ 18869 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:36:10.212785 [ 18869 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:36:10.222837 [ 18869 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:36:10.228334 [ 18869 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:36:10.236625 [ 18869 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 03:36:10.238519 [ 18869 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:36:10.244421 [ 18869 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:36:10.255015 [ 18869 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:36:10.256175 [ 18869 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:36:10.256334 [ 18886 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:36:10.263992 [ 18886 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:36:14.772688 [ 18869 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:36:14.773591 [ 18869 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:36:14.777934 [ 18869 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:36:14.778580 [ 18869 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:36:14.779692 [ 18885 ] {} CancellationChecker: Execution took 9691 ms. 2025.04.02 03:36:14.781521 [ 18869 ] {} Application: Shutting down storages. 2025.04.02 03:36:14.782325 [ 18869 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:36:14.789708 [ 18869 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:36:14.790347 [ 18869 ] {} Context: Shutting down workload entity storage 2025.04.02 03:36:14.791095 [ 18869 ] {} Context: Shutting down named sessions 2025.04.02 03:36:14.792962 [ 18869 ] {} Context: Shutting down database catalog 2025.04.02 03:36:14.793847 [ 18869 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:36:14.795197 [ 18869 ] {} Context: Shutting down merges executor 2025.04.02 03:36:14.798231 [ 18869 ] {} Context: Shutting down fetches executor 2025.04.02 03:36:14.801033 [ 18869 ] {} Context: Shutting down moves executor 2025.04.02 03:36:14.802913 [ 18869 ] {} Context: Shutting down common executor 2025.04.02 03:36:14.804975 [ 18869 ] {} Context: Shutting down DDLWorker 2025.04.02 03:36:14.805656 [ 18869 ] {} Context: Shutting down caches 2025.04.02 03:36:14.807041 [ 18869 ] {} Context: Shutting down AccessControl 2025.04.02 03:36:14.811666 [ 18869 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:36:14.898743 [ 18869 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:36:15.073462 [ 18869 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:36:15.078689 [ 18869 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:36:15.093357 [ 18869 ] {} Application: Shut down storages. 2025.04.02 03:36:15.094042 [ 18869 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:36:15.595621 [ 18869 ] {} Application: Closed all listening sockets. 2025.04.02 03:36:15.596831 [ 18869 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:36:15.598671 [ 18869 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:36:15.837091 [ 18869 ] {} RaftInstance: shutting down raft core 2025.04.02 03:36:15.838731 [ 18869 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:36:15.839724 [ 18869 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:36:15.840605 [ 18869 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:36:15.842156 [ 18869 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:36:15.843546 [ 18869 ] {} RaftInstance: reset all pointers. 2025.04.02 03:36:15.844655 [ 18869 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:36:15.845893 [ 19495 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:36:15.846132 [ 18869 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:36:15.847459 [ 18869 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:36:15.848397 [ 18869 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:36:15.849720 [ 18869 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:36:15.850452 [ 18869 ] {} RaftInstance: manually create a snapshot on 25 2025.04.02 03:36:15.852620 [ 18869 ] {} RaftInstance: creating a snapshot for index 25 2025.04.02 03:36:15.906279 [ 18869 ] {} RaftInstance: create snapshot idx 25 log_term 25 2025.04.02 03:36:15.907492 [ 18869 ] {} KeeperStateMachine: Creating snapshot 25 2025.04.02 03:36:15.908642 [ 18869 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:36:15.912188 [ 18869 ] {} KeeperStateMachine: Created persistent snapshot 25 with path snapshot_25.bin.zstd 2025.04.02 03:36:15.913109 [ 18869 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:36:15.913893 [ 18869 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:36:15.914830 [ 18869 ] {} RaftInstance: snapshot idx 25 log_term 25 created, compact the log store if needed 2025.04.02 03:36:15.916965 [ 18869 ] {} RaftInstance: create snapshot idx 25 log_term 25 done: 9372 us elapsed 2025.04.02 03:36:15.918483 [ 19481 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:36:15.920746 [ 19485 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:36:15.920828 [ 19484 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:36:15.921209 [ 19486 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:36:15.921111 [ 19480 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:36:15.921699 [ 19490 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:36:15.921355 [ 19491 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:36:15.921870 [ 19487 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:36:15.921998 [ 19493 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:36:15.922168 [ 19482 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:15.922318 [ 19488 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:36:15.922452 [ 19489 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:36:15.922604 [ 19479 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:15.922699 [ 19478 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:15.922823 [ 19492 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:15.922935 [ 19483 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:36:15.923052 [ 19481 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:36:15.928187 [ 19476 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 03:36:15.928453 [ 18869 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:36:15.929703 [ 19477 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:36:15.933128 [ 18869 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:36:15.934454 [ 18869 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:36:15.935114 [ 18869 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:36:15.936909 [ 18869 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:36:15.938085 [ 18869 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:36:15.939732 [ 18869 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:36:15.940345 [ 18869 ] {} Context: Destructing threadpool writer 2025.04.02 03:36:15.994830 [ 18869 ] {} Application: Destroyed global context. 2025.04.02 03:36:15.997159 [ 18869 ] {} Application: Waiting for background threads 2025.04.02 03:36:16.140452 [ 18869 ] {} Application: Background threads finished in 143 ms 2025.04.02 03:36:16.144900 [ 18869 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:36:16.145693 [ 18869 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:36:16.236322 [ 18869 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:36:16.237442 [ 18869 ] {} Application: shutting down 2025.04.02 03:36:16.238113 [ 18869 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:36:16.239983 [ 18870 ] {} BaseDaemon: Received signal -2 2025.04.02 03:36:16.240827 [ 18870 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:36:16.440340 [ 18868 ] {} Application: Child process exited normally with code 233.