2025.04.02 03:59:15.496564 [ 9597 ] {} Application: Will watch for the process with pid 9599 2025.04.02 03:59:15.497828 [ 9599 ] {} Application: Forked a child process to watch 2025.04.02 03:59:15.499230 [ 9599 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:59:15.989377 [ 9599 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 9599 2025.04.02 03:59:15.990247 [ 9599 ] {} Application: starting up 2025.04.02 03:59:15.990348 [ 9599 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:59:16.022752 [ 9599 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:59:16.022898 [ 9599 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 03:59:16.023123 [ 9599 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:59:16.023192 [ 9599 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:59:16.023230 [ 9599 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:59:16.023275 [ 9599 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 03:59:16.024740 [ 9599 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:59:16.025187 [ 9599 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:59:16.025237 [ 9599 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:59:16.025423 [ 9599 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:59:16.025479 [ 9599 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:59:17.018974 [ 9599 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 03:59:17.021354 [ 9599 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:59:17.021441 [ 9599 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 03:59:17.021624 [ 9599 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:59:17.022431 [ 9599 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:59:17.365199 [ 9611 ] {} CancellationChecker: Started worker function 2025.04.02 03:59:17.365842 [ 9599 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:59:17.365933 [ 9599 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:59:17.366011 [ 9599 ] {} Application: Initializing DateLUT. 2025.04.02 03:59:17.366070 [ 9599 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:59:17.366509 [ 9599 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:59:17.367081 [ 9599 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:59:17.392430 [ 9599 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:59:17.392625 [ 9599 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:59:17.393195 [ 9599 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:59:17.393937 [ 9599 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 03:59:17.394061 [ 9599 ] {} Application: Initializing interserver credentials. 2025.04.02 03:59:17.395528 [ 9599 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:59:17.404219 [ 9599 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:59:17.404965 [ 9599 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:59:17.501350 [ 9599 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:59:17.501499 [ 9599 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:59:17.513710 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:59:17.515681 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:59:17.516393 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:59:17.517247 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:59:17.517974 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:59:17.526078 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:59:17.526921 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:59:17.527600 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:59:17.528121 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:59:17.528667 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:59:17.529376 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:59:17.529837 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:59:17.530436 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:59:17.530950 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:59:17.531803 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:59:17.532354 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:59:17.532941 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:59:17.533546 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:59:17.534215 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:59:17.534974 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:59:17.535597 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:59:17.536205 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:59:17.537332 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:59:17.539115 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:59:17.539789 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:59:17.541282 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:59:17.543248 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:59:17.543993 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:59:17.544611 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:59:17.545222 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:59:17.545918 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:59:17.546743 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:59:17.547515 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:59:17.548091 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:59:17.548840 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:59:17.549469 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:59:17.550225 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:59:17.551136 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:59:17.551812 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:59:17.553770 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:59:17.554982 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:59:17.555799 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:59:17.556548 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:59:17.557287 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:59:17.558178 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:59:17.559006 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:59:17.559813 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:59:17.560528 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:59:17.620437 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:59:17.622466 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:59:17.624294 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:59:17.625473 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:59:17.626199 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:59:17.626882 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:59:17.628045 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:59:17.628871 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:59:17.629870 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:59:17.630614 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:59:17.631357 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:59:17.632046 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:59:17.633171 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:59:17.633901 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:59:17.634856 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:59:17.635980 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:59:17.636917 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:59:17.640504 [ 9599 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:59:17.823778 [ 9599 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:59:17.826685 [ 9599 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:59:17.887184 [ 9599 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:59:17.887326 [ 9599 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:59:17.887388 [ 9599 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:59:17.913188 [ 9599 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:59:17.913321 [ 9599 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:59:17.913410 [ 9599 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:59:17.913629 [ 9599 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:17.920669 [ 9599 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:17.927538 [ 9599 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:17.942063 [ 9599 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:59:17.942275 [ 9599 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:17.945169 [ 9599 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:59:17.946171 [ 9599 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:59:17.947485 [ 9599 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:59:17.947574 [ 9599 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:59:17.949433 [ 9599 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:59:17.949490 [ 9599 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:59:17.949518 [ 9599 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:59:17.949569 [ 9599 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:59:17.949613 [ 9599 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:59:17.949849 [ 9599 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:17.949924 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.057385 [ 9599 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:18.067202 [ 9599 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:18.067318 [ 9599 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:18.068348 [ 9599 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/isj/vtmozxlzwizxrbhldhanybdzrierd 2025.04.02 03:59:18.068935 [ 9599 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/isj/vtmozxlzwizxrbhldhanybdzrierd. 2025.04.02 03:59:18.076509 [ 10185 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/isj/vtmozxlzwizxrbhldhanybdzrierd, size 4 2025.04.02 03:59:18.077177 [ 9599 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/isj/vtmozxlzwizxrbhldhanybdzrierd. 2025.04.02 03:59:18.086806 [ 9599 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/isj/vtmozxlzwizxrbhldhanybdzrierd 2025.04.02 03:59:18.086878 [ 9599 ] {} deleteFileFromS3: Object with path s3/isj/vtmozxlzwizxrbhldhanybdzrierd was removed from S3 2025.04.02 03:59:18.086931 [ 9599 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:59:18.086986 [ 9599 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:59:18.090279 [ 9599 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:18.100076 [ 9599 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:18.100162 [ 9599 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:18.122206 [ 9599 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:59:18.122499 [ 9599 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:59:18 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DD108B68C1D x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:59:18.122664 [ 9599 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:59:18.127810 [ 9599 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 03:59:18.127872 [ 9599 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 03:59:18.127926 [ 9599 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:59:18.127995 [ 9599 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:59:18.128124 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.128195 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.128271 [ 9599 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:18.128333 [ 9599 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:18.128412 [ 9599 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:59:18.128470 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.128523 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.128582 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.128635 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.128696 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.132001 [ 9599 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:18.142319 [ 9599 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:18.142441 [ 9599 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:18.159180 [ 9599 ] {} deleteFileFromS3: No blob storage log, not writing blob special/jlv/mpzvxaecapshvbdrcykouvzknkaln 2025.04.02 03:59:18.159271 [ 9599 ] {} deleteFileFromS3: Object with path special/jlv/mpzvxaecapshvbdrcykouvzknkaln was removed from S3 2025.04.02 03:59:18.159322 [ 9599 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:59:18.159357 [ 9599 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:59:18.162794 [ 9599 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:18.172697 [ 9599 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:18.172781 [ 9599 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:18.204732 [ 9599 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/vyf/dfjoyzkbxzfjbmrcmlwcofrshswbf 2025.04.02 03:59:18.204803 [ 9599 ] {} deleteFileFromS3: Object with path test_02944/vyf/dfjoyzkbxzfjbmrcmlwcofrshswbf was removed from S3 2025.04.02 03:59:18.204856 [ 9599 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:59:18.204899 [ 9599 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:59:18.205058 [ 9599 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:18.208594 [ 9599 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:18.212892 [ 9599 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:59:18.213003 [ 9599 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 03:59:18.214828 [ 9599 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:59:18.214993 [ 9599 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:59:18.216250 [ 9599 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:59:18.216336 [ 9599 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:59:18.216384 [ 9599 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 03:59:18.216420 [ 9599 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 03:59:18.216455 [ 9599 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 03:59:18.216982 [ 9599 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 12 entries 2025.04.02 03:59:18.217049 [ 9599 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:59:18.217149 [ 9599 ] {} KeeperServer: Last local log idx 12 2025.04.02 03:59:18.217195 [ 9599 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 12 2025.04.02 03:59:18.218425 [ 9599 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:59:18.229761 [ 9599 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:59:18.230180 [ 9599 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:59:18.230319 [ 9599 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:59:18.230378 [ 9599 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:59:18.230495 [ 9599 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:59:18.230545 [ 9599 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:59:18.230629 [ 9599 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 12 election timer allowed log store start 1, end 12 config log idx 12, prev log idx 11 -- ASYNC REPLICATION -- 2025.04.02 03:59:18.230677 [ 9599 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 03:59:18.230749 [ 9599 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:59:18.230809 [ 9599 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:59:18.231594 [ 9599 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:59:18.231741 [ 10212 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:59:18.282191 [ 10195 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:59:18.282612 [ 10195 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:59:18.282762 [ 10195 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 12, state term 12, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:59:18.282795 [ 9599 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:59:18.282857 [ 10195 ] {} RaftInstance: pre-vote term (0) is different, reset it to 12 2025.04.02 03:59:18.283186 [ 10195 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:59:18.286900 [ 10195 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 13, log idx 12, log term 12, priority (target 1 / mine 1) 2025.04.02 03:59:18.287042 [ 10195 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:59:18.287121 [ 10195 ] {} RaftInstance: state machine commit index 0, precommit index 12, last log index 12 2025.04.02 03:59:18.287205 [ 10195 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 03:59:18.287745 [ 10195 ] {} RaftInstance: [BECOME LEADER] appended new config at 13 2025.04.02 03:59:18.288061 [ 10211 ] {} RaftInstance: config at index 1 is committed, prev config log idx 12 2025.04.02 03:59:18.288146 [ 10211 ] {} RaftInstance: skipped config 1, latest config 12 2025.04.02 03:59:18.288295 [ 10211 ] {} RaftInstance: config at index 2 is committed, prev config log idx 12 2025.04.02 03:59:18.288342 [ 10211 ] {} RaftInstance: skipped config 2, latest config 12 2025.04.02 03:59:18.288425 [ 10211 ] {} RaftInstance: config at index 3 is committed, prev config log idx 12 2025.04.02 03:59:18.288470 [ 10211 ] {} RaftInstance: skipped config 3, latest config 12 2025.04.02 03:59:18.288573 [ 10211 ] {} RaftInstance: config at index 4 is committed, prev config log idx 12 2025.04.02 03:59:18.288613 [ 10211 ] {} RaftInstance: skipped config 4, latest config 12 2025.04.02 03:59:18.288682 [ 10211 ] {} RaftInstance: config at index 5 is committed, prev config log idx 12 2025.04.02 03:59:18.288717 [ 10211 ] {} RaftInstance: skipped config 5, latest config 12 2025.04.02 03:59:18.288788 [ 10211 ] {} RaftInstance: config at index 6 is committed, prev config log idx 12 2025.04.02 03:59:18.288824 [ 10211 ] {} RaftInstance: skipped config 6, latest config 12 2025.04.02 03:59:18.288892 [ 10211 ] {} RaftInstance: config at index 7 is committed, prev config log idx 12 2025.04.02 03:59:18.288929 [ 10211 ] {} RaftInstance: skipped config 7, latest config 12 2025.04.02 03:59:18.288995 [ 10211 ] {} RaftInstance: config at index 8 is committed, prev config log idx 12 2025.04.02 03:59:18.289060 [ 10211 ] {} RaftInstance: skipped config 8, latest config 12 2025.04.02 03:59:18.289130 [ 10211 ] {} RaftInstance: config at index 9 is committed, prev config log idx 12 2025.04.02 03:59:18.289159 [ 10211 ] {} RaftInstance: skipped config 9, latest config 12 2025.04.02 03:59:18.289216 [ 10211 ] {} RaftInstance: config at index 10 is committed, prev config log idx 12 2025.04.02 03:59:18.289252 [ 10211 ] {} RaftInstance: skipped config 10, latest config 12 2025.04.02 03:59:18.289333 [ 10211 ] {} RaftInstance: config at index 11 is committed, prev config log idx 12 2025.04.02 03:59:18.289364 [ 10211 ] {} RaftInstance: skipped config 11, latest config 12 2025.04.02 03:59:18.289419 [ 10211 ] {} RaftInstance: config at index 12 is committed, prev config log idx 12 2025.04.02 03:59:18.289447 [ 10211 ] {} RaftInstance: skipped config 12, latest config 12 2025.04.02 03:59:18.289517 [ 10211 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 03:59:18.289561 [ 10211 ] {} KeeperServer: Preprocessing done 2025.04.02 03:59:18.289618 [ 10211 ] {} RaftInstance: config at index 13 is committed, prev config log idx 12 2025.04.02 03:59:18.289683 [ 10211 ] {} RaftInstance: new config log idx 13, prev log idx 12, cur config log idx 12, prev log idx 11 2025.04.02 03:59:18.289774 [ 10211 ] {} RaftInstance: new configuration: log idx 13, prev log idx 12 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 13 2025.04.02 03:59:18.289944 [ 9599 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:59:18.290883 [ 9599 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:59:18.292710 [ 9599 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:59:18.293186 [ 9599 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:59:18.306272 [ 9599 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:59:18.306434 [ 9599 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:59:18.307738 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:59:18.308160 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:59:18.308782 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:59:18.309081 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:59:18.309348 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:59:18.309598 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:59:18.309829 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:59:18.310164 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:59:18.314343 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:59:18.314840 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:59:18.315231 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:59:18.315587 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:59:18.315928 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:59:18.316285 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:59:18.316592 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:59:18.316999 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:59:18.317371 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:59:18.317767 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:59:18.318133 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:59:18.318585 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:59:18.318963 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:59:18.319431 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:59:18.320204 [ 9599 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:59:18.327503 [ 9599 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:59:18.327721 [ 9599 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:59:18.409383 [ 9599 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:59:18.409525 [ 9599 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:18.412707 [ 9599 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:59:18.413999 [ 9599 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:59:18.414737 [ 9599 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:59:18.415190 [ 10217 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:59:18.423832 [ 9599 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:59:18.427167 [ 9599 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:59:18.433389 [ 9599 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:59:18.436649 [ 9599 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:59:18.445568 [ 9599 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:59:18.533311 [ 9599 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:59:18.534896 [ 9599 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:59:18.535014 [ 9599 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:59:18.535149 [ 9612 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:59:18.536044 [ 9612 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:59:23.212526 [ 9599 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:23.213131 [ 9599 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:59:23.213504 [ 9599 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:59:23.213575 [ 9599 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:59:23.213734 [ 9611 ] {} CancellationChecker: Execution took 5848 ms. 2025.04.02 03:59:23.213982 [ 9599 ] {} Application: Shutting down storages. 2025.04.02 03:59:23.214047 [ 9599 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:59:23.215672 [ 9599 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:59:23.215740 [ 9599 ] {} Context: Shutting down workload entity storage 2025.04.02 03:59:23.215778 [ 9599 ] {} Context: Shutting down named sessions 2025.04.02 03:59:23.215849 [ 9599 ] {} Context: Shutting down database catalog 2025.04.02 03:59:23.215894 [ 9599 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:59:23.216004 [ 9599 ] {} Context: Shutting down merges executor 2025.04.02 03:59:23.216721 [ 9599 ] {} Context: Shutting down fetches executor 2025.04.02 03:59:23.217154 [ 9599 ] {} Context: Shutting down moves executor 2025.04.02 03:59:23.217449 [ 9599 ] {} Context: Shutting down common executor 2025.04.02 03:59:23.217673 [ 9599 ] {} Context: Shutting down DDLWorker 2025.04.02 03:59:23.217711 [ 9599 ] {} Context: Shutting down caches 2025.04.02 03:59:23.217759 [ 9599 ] {} Context: Shutting down AccessControl 2025.04.02 03:59:23.218133 [ 9599 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:59:23.221044 [ 9599 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:59:23.256378 [ 9599 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:59:23.256810 [ 9599 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:59:23.257413 [ 9599 ] {} Application: Shut down storages. 2025.04.02 03:59:23.257469 [ 9599 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:59:23.550235 [ 9599 ] {} Application: Closed all listening sockets. 2025.04.02 03:59:23.550361 [ 9599 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:59:23.569445 [ 9599 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:59:23.793177 [ 9599 ] {} RaftInstance: shutting down raft core 2025.04.02 03:59:23.793359 [ 9599 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:59:23.793471 [ 9599 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:59:23.793550 [ 9599 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:59:23.793618 [ 9599 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:59:23.793741 [ 9599 ] {} RaftInstance: reset all pointers. 2025.04.02 03:59:23.793806 [ 9599 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:59:23.793957 [ 9599 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:59:23.793992 [ 10212 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:59:23.794204 [ 9599 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:59:23.794301 [ 9599 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:59:23.794359 [ 9599 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:59:23.794640 [ 10198 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:59:23.794878 [ 10197 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 03:59:23.794875 [ 10199 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:59:23.795143 [ 10198 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:59:23.795314 [ 10207 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:59:23.795212 [ 10206 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:59:23.795177 [ 10203 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:59:23.795214 [ 10204 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:59:23.795484 [ 10195 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:59:23.795425 [ 10200 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:59:23.795478 [ 10208 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:59:23.795770 [ 10201 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:59:23.795787 [ 10210 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:59:23.795703 [ 10196 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:59:23.795770 [ 10209 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:59:23.795563 [ 10202 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:59:23.795699 [ 10205 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:59:23.796309 [ 9599 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:23.796435 [ 10194 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:59:23.797162 [ 9599 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:59:23.797355 [ 9599 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:59:23.797413 [ 9599 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:59:23.797493 [ 9599 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:59:23.797553 [ 9599 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:23.797747 [ 9599 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:23.797795 [ 9599 ] {} Context: Destructing threadpool writer 2025.04.02 03:59:23.838985 [ 9599 ] {} Application: Destroyed global context. 2025.04.02 03:59:23.839662 [ 9599 ] {} Application: Waiting for background threads 2025.04.02 03:59:23.914141 [ 9599 ] {} Application: Background threads finished in 74 ms 2025.04.02 03:59:23.914935 [ 9599 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:59:23.915001 [ 9599 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:24.031860 [ 9599 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:24.032174 [ 9599 ] {} Application: shutting down 2025.04.02 03:59:24.032209 [ 9599 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:59:24.040353 [ 9602 ] {} BaseDaemon: Received signal -2 2025.04.02 03:59:24.040468 [ 9602 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:59:24.170319 [ 9597 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:59:24.602473 [ 10329 ] {} Application: Will watch for the process with pid 10331 2025.04.02 03:59:24.604106 [ 10331 ] {} Application: Forked a child process to watch 2025.04.02 03:59:24.605867 [ 10331 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:59:25.215518 [ 10331 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 10331 2025.04.02 03:59:25.216434 [ 10331 ] {} Application: starting up 2025.04.02 03:59:25.216528 [ 10331 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:59:25.248024 [ 10331 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:59:25.248152 [ 10331 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 03:59:25.248376 [ 10331 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:59:25.248440 [ 10331 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:59:25.248484 [ 10331 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:59:25.248520 [ 10331 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 03:59:25.250363 [ 10331 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:59:25.250818 [ 10331 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:59:25.250866 [ 10331 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:59:25.251043 [ 10331 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:59:25.251096 [ 10331 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:59:26.181551 [ 10331 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 03:59:26.183733 [ 10331 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:59:26.183807 [ 10331 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 03:59:26.183973 [ 10331 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:59:26.184731 [ 10331 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:59:26.444594 [ 10344 ] {} CancellationChecker: Started worker function 2025.04.02 03:59:26.444805 [ 10331 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:59:26.444864 [ 10331 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:59:26.444927 [ 10331 ] {} Application: Initializing DateLUT. 2025.04.02 03:59:26.444971 [ 10331 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:59:26.445310 [ 10331 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:59:26.445788 [ 10331 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:59:26.498113 [ 10331 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:59:26.498337 [ 10331 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:59:26.498909 [ 10331 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:59:26.499657 [ 10331 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 03:59:26.499824 [ 10331 ] {} Application: Initializing interserver credentials. 2025.04.02 03:59:26.501298 [ 10331 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:59:26.582464 [ 10331 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:59:26.583226 [ 10331 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:59:26.596962 [ 10331 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:59:26.597110 [ 10331 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:59:26.608996 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:59:26.610567 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:59:26.610976 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:59:26.611433 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:59:26.611888 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:59:26.619447 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:59:26.620296 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:59:26.620947 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:59:26.621496 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:59:26.622059 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:59:26.625686 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:59:26.626127 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:59:26.675244 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:59:26.676313 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:59:26.677444 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:59:26.678148 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:59:26.730187 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:59:26.731256 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:59:26.732122 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:59:26.732905 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:59:26.733690 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:59:26.734487 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:59:26.735931 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:59:26.738041 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:59:26.738786 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:59:26.740581 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:59:26.742854 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:59:26.743685 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:59:26.744327 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:59:26.745024 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:59:26.745811 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:59:26.746532 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:59:26.747455 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:59:26.748130 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:59:26.749081 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:59:26.749795 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:59:26.750840 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:59:26.751843 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:59:26.752672 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:59:26.755055 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:59:26.756158 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:59:26.757080 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:59:26.757918 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:59:26.758811 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:59:26.759906 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:59:26.760767 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:59:26.761669 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:59:26.762620 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:59:26.824084 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:59:26.825448 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:59:26.826805 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:59:26.827618 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:59:26.828293 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:59:26.828832 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:59:26.829772 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:59:26.830488 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:59:26.831196 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:59:26.831708 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:59:26.832327 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:59:26.832875 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:59:26.833719 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:59:26.834257 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:59:26.834989 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:59:26.835818 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:59:26.836467 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:59:26.838758 [ 10331 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:59:26.886076 [ 10331 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:59:26.887961 [ 10331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:59:27.044836 [ 10331 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:59:27.044979 [ 10331 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:59:27.045100 [ 10331 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:59:27.164746 [ 10331 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:59:27.164869 [ 10331 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:59:27.164981 [ 10331 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:59:27.165219 [ 10331 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:27.172866 [ 10331 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:27.245246 [ 10331 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:27.263769 [ 10331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:59:27.264064 [ 10331 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:27.315000 [ 10331 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:59:27.316748 [ 10331 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:59:27.318727 [ 10331 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:59:27.318863 [ 10331 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:59:27.321674 [ 10331 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:59:27.321797 [ 10331 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:59:27.321884 [ 10331 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:59:27.321978 [ 10331 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:59:27.322035 [ 10331 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:59:27.322453 [ 10331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:27.322623 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.537434 [ 10331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:27.602570 [ 10331 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:27.602754 [ 10331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:27.604688 [ 10331 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/luj/tscojaryaswmpindouucziewtazce 2025.04.02 03:59:27.605417 [ 10331 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/luj/tscojaryaswmpindouucziewtazce. 2025.04.02 03:59:27.612065 [ 10920 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/luj/tscojaryaswmpindouucziewtazce, size 4 2025.04.02 03:59:27.612966 [ 10331 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/luj/tscojaryaswmpindouucziewtazce. 2025.04.02 03:59:27.623737 [ 10331 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/luj/tscojaryaswmpindouucziewtazce 2025.04.02 03:59:27.623813 [ 10331 ] {} deleteFileFromS3: Object with path s3/luj/tscojaryaswmpindouucziewtazce was removed from S3 2025.04.02 03:59:27.623876 [ 10331 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:59:27.623936 [ 10331 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:59:27.628022 [ 10331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:27.641842 [ 10331 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:27.641942 [ 10331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:27.671114 [ 10331 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:59:27.671512 [ 10331 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:59:27 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DD341DC9A6F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:59:27.671804 [ 10331 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:59:27.679205 [ 10331 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 03:59:27.679375 [ 10331 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 03:59:27.679497 [ 10331 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:59:27.679586 [ 10331 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:59:27.679760 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.679890 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.679995 [ 10331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:27.680096 [ 10331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:27.680219 [ 10331 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:59:27.680353 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.680453 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.680574 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.680679 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.680797 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.686739 [ 10331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:27.706857 [ 10331 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:27.707016 [ 10331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:27.728684 [ 10331 ] {} deleteFileFromS3: No blob storage log, not writing blob special/gss/gbhqdojuchvikvdzutnqrgtefhsyv 2025.04.02 03:59:27.728818 [ 10331 ] {} deleteFileFromS3: Object with path special/gss/gbhqdojuchvikvdzutnqrgtefhsyv was removed from S3 2025.04.02 03:59:27.728905 [ 10331 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:59:27.728969 [ 10331 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:59:27.734963 [ 10331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:27.789435 [ 10331 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:27.789584 [ 10331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:27.811554 [ 10331 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/vhc/eniqioxqsvnuaspuitcscizcvhwpc 2025.04.02 03:59:27.811714 [ 10331 ] {} deleteFileFromS3: Object with path test_02944/vhc/eniqioxqsvnuaspuitcscizcvhwpc was removed from S3 2025.04.02 03:59:27.811815 [ 10331 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:59:27.811894 [ 10331 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:59:27.812121 [ 10331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:27.817732 [ 10331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:27.822579 [ 10331 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:59:27.822730 [ 10331 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 03:59:27.824480 [ 10331 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:59:27.824660 [ 10331 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:59:27.825897 [ 10331 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:59:27.825958 [ 10331 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:59:27.826001 [ 10331 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 03:59:27.826053 [ 10331 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 03:59:27.826090 [ 10331 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 03:59:27.906206 [ 10331 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 13 entries 2025.04.02 03:59:27.906445 [ 10331 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:59:27.906638 [ 10331 ] {} KeeperServer: Last local log idx 13 2025.04.02 03:59:27.906732 [ 10331 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 13 2025.04.02 03:59:27.908643 [ 10331 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:59:27.994769 [ 10331 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:59:27.995296 [ 10331 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:59:27.995448 [ 10331 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:59:27.995529 [ 10331 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:59:27.995614 [ 10331 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:59:27.995667 [ 10331 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:59:27.995760 [ 10331 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 13 election timer allowed log store start 1, end 13 config log idx 13, prev log idx 12 -- ASYNC REPLICATION -- 2025.04.02 03:59:27.995810 [ 10331 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 03:59:27.995915 [ 10331 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:59:27.995997 [ 10331 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:59:27.996778 [ 10331 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:59:27.996903 [ 10949 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:59:28.047386 [ 10932 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:59:28.047628 [ 10932 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:59:28.047779 [ 10932 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 13, state term 13, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:59:28.047861 [ 10932 ] {} RaftInstance: pre-vote term (0) is different, reset it to 13 2025.04.02 03:59:28.047983 [ 10331 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:59:28.048251 [ 10932 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:59:28.051751 [ 10932 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 14, log idx 13, log term 13, priority (target 1 / mine 1) 2025.04.02 03:59:28.051855 [ 10932 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:59:28.051933 [ 10932 ] {} RaftInstance: state machine commit index 0, precommit index 13, last log index 13 2025.04.02 03:59:28.052011 [ 10932 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 03:59:28.052473 [ 10932 ] {} RaftInstance: [BECOME LEADER] appended new config at 14 2025.04.02 03:59:28.052840 [ 10948 ] {} RaftInstance: config at index 1 is committed, prev config log idx 13 2025.04.02 03:59:28.052946 [ 10948 ] {} RaftInstance: skipped config 1, latest config 13 2025.04.02 03:59:28.053104 [ 10948 ] {} RaftInstance: config at index 2 is committed, prev config log idx 13 2025.04.02 03:59:28.053186 [ 10948 ] {} RaftInstance: skipped config 2, latest config 13 2025.04.02 03:59:28.053352 [ 10948 ] {} RaftInstance: config at index 3 is committed, prev config log idx 13 2025.04.02 03:59:28.053409 [ 10948 ] {} RaftInstance: skipped config 3, latest config 13 2025.04.02 03:59:28.053491 [ 10948 ] {} RaftInstance: config at index 4 is committed, prev config log idx 13 2025.04.02 03:59:28.053546 [ 10948 ] {} RaftInstance: skipped config 4, latest config 13 2025.04.02 03:59:28.053641 [ 10948 ] {} RaftInstance: config at index 5 is committed, prev config log idx 13 2025.04.02 03:59:28.053684 [ 10948 ] {} RaftInstance: skipped config 5, latest config 13 2025.04.02 03:59:28.053758 [ 10948 ] {} RaftInstance: config at index 6 is committed, prev config log idx 13 2025.04.02 03:59:28.053795 [ 10948 ] {} RaftInstance: skipped config 6, latest config 13 2025.04.02 03:59:28.053867 [ 10948 ] {} RaftInstance: config at index 7 is committed, prev config log idx 13 2025.04.02 03:59:28.053909 [ 10948 ] {} RaftInstance: skipped config 7, latest config 13 2025.04.02 03:59:28.053985 [ 10948 ] {} RaftInstance: config at index 8 is committed, prev config log idx 13 2025.04.02 03:59:28.054040 [ 10948 ] {} RaftInstance: skipped config 8, latest config 13 2025.04.02 03:59:28.054109 [ 10948 ] {} RaftInstance: config at index 9 is committed, prev config log idx 13 2025.04.02 03:59:28.054143 [ 10948 ] {} RaftInstance: skipped config 9, latest config 13 2025.04.02 03:59:28.054223 [ 10948 ] {} RaftInstance: config at index 10 is committed, prev config log idx 13 2025.04.02 03:59:28.054257 [ 10948 ] {} RaftInstance: skipped config 10, latest config 13 2025.04.02 03:59:28.054369 [ 10948 ] {} RaftInstance: config at index 11 is committed, prev config log idx 13 2025.04.02 03:59:28.054526 [ 10948 ] {} RaftInstance: skipped config 11, latest config 13 2025.04.02 03:59:28.054670 [ 10948 ] {} RaftInstance: config at index 12 is committed, prev config log idx 13 2025.04.02 03:59:28.054723 [ 10948 ] {} RaftInstance: skipped config 12, latest config 13 2025.04.02 03:59:28.054819 [ 10948 ] {} RaftInstance: config at index 13 is committed, prev config log idx 13 2025.04.02 03:59:28.054899 [ 10948 ] {} RaftInstance: skipped config 13, latest config 13 2025.04.02 03:59:28.055014 [ 10948 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 03:59:28.055058 [ 10948 ] {} KeeperServer: Preprocessing done 2025.04.02 03:59:28.055111 [ 10948 ] {} RaftInstance: config at index 14 is committed, prev config log idx 13 2025.04.02 03:59:28.055166 [ 10948 ] {} RaftInstance: new config log idx 14, prev log idx 13, cur config log idx 13, prev log idx 12 2025.04.02 03:59:28.055292 [ 10948 ] {} RaftInstance: new configuration: log idx 14, prev log idx 13 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 14 2025.04.02 03:59:28.055476 [ 10331 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:59:28.056344 [ 10331 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:59:28.058237 [ 10331 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:59:28.058681 [ 10331 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:59:28.074974 [ 10331 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:59:28.075094 [ 10331 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:59:28.076552 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:59:28.077073 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:59:28.077801 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:59:28.078166 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:59:28.078523 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:59:28.078825 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:59:28.079120 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:59:28.079548 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:59:28.085183 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:59:28.085809 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:59:28.086337 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:59:28.086899 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:59:28.087468 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:59:28.087985 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:59:28.088485 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:59:28.089052 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:59:28.089587 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:59:28.090241 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:59:28.090812 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:59:28.091373 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:59:28.091880 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:59:28.092520 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:59:28.093703 [ 10331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:59:28.185896 [ 10331 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:59:28.186175 [ 10331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:59:28.193033 [ 10331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:59:28.193147 [ 10331 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:28.196511 [ 10331 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:59:28.197779 [ 10331 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:59:28.198556 [ 10331 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:59:28.201563 [ 10955 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:59:28.207839 [ 10331 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:59:28.211501 [ 10331 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:59:28.313661 [ 10331 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:59:28.317332 [ 10331 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:59:28.325919 [ 10331 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:59:28.332833 [ 10331 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:59:28.334471 [ 10331 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:59:28.334596 [ 10331 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:59:28.334639 [ 10345 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:59:28.335364 [ 10345 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:59:33.125951 [ 10331 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:33.126633 [ 10331 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:59:33.127052 [ 10331 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:59:33.127123 [ 10331 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:59:33.127246 [ 10344 ] {} CancellationChecker: Execution took 6682 ms. 2025.04.02 03:59:33.127542 [ 10331 ] {} Application: Shutting down storages. 2025.04.02 03:59:33.127642 [ 10331 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:59:33.128986 [ 10331 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:59:33.129032 [ 10331 ] {} Context: Shutting down workload entity storage 2025.04.02 03:59:33.129065 [ 10331 ] {} Context: Shutting down named sessions 2025.04.02 03:59:33.129123 [ 10331 ] {} Context: Shutting down database catalog 2025.04.02 03:59:33.129164 [ 10331 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:59:33.129223 [ 10331 ] {} Context: Shutting down merges executor 2025.04.02 03:59:33.129591 [ 10331 ] {} Context: Shutting down fetches executor 2025.04.02 03:59:33.129956 [ 10331 ] {} Context: Shutting down moves executor 2025.04.02 03:59:33.130179 [ 10331 ] {} Context: Shutting down common executor 2025.04.02 03:59:33.130425 [ 10331 ] {} Context: Shutting down DDLWorker 2025.04.02 03:59:33.130462 [ 10331 ] {} Context: Shutting down caches 2025.04.02 03:59:33.130495 [ 10331 ] {} Context: Shutting down AccessControl 2025.04.02 03:59:33.130816 [ 10331 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:59:33.132970 [ 10331 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:59:33.233080 [ 10331 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:59:33.233374 [ 10331 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:59:33.234140 [ 10331 ] {} Application: Shut down storages. 2025.04.02 03:59:33.234204 [ 10331 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:59:33.566026 [ 10331 ] {} Application: Closed all listening sockets. 2025.04.02 03:59:33.566170 [ 10331 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:59:33.566236 [ 10331 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:59:34.058267 [ 10331 ] {} RaftInstance: shutting down raft core 2025.04.02 03:59:34.058444 [ 10331 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:59:34.058559 [ 10331 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:59:34.058618 [ 10331 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:59:34.058667 [ 10331 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:59:34.058714 [ 10331 ] {} RaftInstance: reset all pointers. 2025.04.02 03:59:34.058761 [ 10331 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:59:34.058928 [ 10331 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:59:34.058954 [ 10949 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:59:34.059127 [ 10331 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:59:34.059181 [ 10331 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:59:34.059223 [ 10331 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:59:34.059604 [ 10932 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 03:59:34.059771 [ 10936 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:59:34.060016 [ 10941 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:59:34.059872 [ 10939 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:59:34.059875 [ 10937 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:59:34.059560 [ 10935 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:59:34.060171 [ 10933 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:59:34.060189 [ 10947 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:59:34.060349 [ 10942 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:59:34.060186 [ 10943 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:59:34.060190 [ 10940 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:59:34.060214 [ 10938 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:59:34.060225 [ 10946 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:59:34.060245 [ 10945 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:59:34.060218 [ 10944 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:59:34.060218 [ 10934 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:59:34.060679 [ 10935 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:59:34.060986 [ 10331 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:34.061117 [ 10931 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:59:34.061692 [ 10331 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:59:34.061840 [ 10331 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:59:34.061885 [ 10331 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:59:34.061945 [ 10331 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:59:34.061987 [ 10331 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:34.062140 [ 10331 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:34.062186 [ 10331 ] {} Context: Destructing threadpool writer 2025.04.02 03:59:34.065336 [ 10331 ] {} Application: Destroyed global context. 2025.04.02 03:59:34.065937 [ 10331 ] {} Application: Waiting for background threads 2025.04.02 03:59:34.136373 [ 10331 ] {} Application: Background threads finished in 70 ms 2025.04.02 03:59:34.137018 [ 10331 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:59:34.137083 [ 10331 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:34.148664 [ 10331 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:34.148910 [ 10331 ] {} Application: shutting down 2025.04.02 03:59:34.148944 [ 10331 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:59:34.193088 [ 10334 ] {} BaseDaemon: Received signal -2 2025.04.02 03:59:34.193199 [ 10334 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:59:34.436945 [ 10329 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:59:35.220854 [ 11071 ] {} Application: Will watch for the process with pid 11073 2025.04.02 03:59:35.222172 [ 11073 ] {} Application: Forked a child process to watch 2025.04.02 03:59:35.223659 [ 11073 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:59:35.751695 [ 11073 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 11073 2025.04.02 03:59:35.752653 [ 11073 ] {} Application: starting up 2025.04.02 03:59:35.752749 [ 11073 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:59:35.788672 [ 11073 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:59:35.788822 [ 11073 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 03:59:35.789033 [ 11073 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:59:35.789098 [ 11073 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:59:35.789133 [ 11073 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:59:35.789163 [ 11073 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 03:59:35.790193 [ 11073 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:59:35.790642 [ 11073 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:59:35.790691 [ 11073 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:59:35.790898 [ 11073 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:59:35.790978 [ 11073 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:59:36.638551 [ 11073 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 03:59:36.640624 [ 11073 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:59:36.640697 [ 11073 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 03:59:36.640859 [ 11073 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:59:36.641497 [ 11073 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:59:36.875449 [ 11083 ] {} CancellationChecker: Started worker function 2025.04.02 03:59:36.875838 [ 11073 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:59:36.875945 [ 11073 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:59:36.876019 [ 11073 ] {} Application: Initializing DateLUT. 2025.04.02 03:59:36.876068 [ 11073 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:59:36.876390 [ 11073 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:59:36.876878 [ 11073 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:59:36.895856 [ 11073 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:59:36.896001 [ 11073 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:59:36.896415 [ 11073 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:59:36.896964 [ 11073 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 03:59:36.897119 [ 11073 ] {} Application: Initializing interserver credentials. 2025.04.02 03:59:36.898264 [ 11073 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:59:36.904252 [ 11073 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:59:36.904728 [ 11073 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:59:36.921896 [ 11073 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:59:36.922019 [ 11073 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:59:36.934118 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:59:36.935365 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:59:36.935830 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:59:36.936372 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:59:36.936843 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:59:36.941677 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:59:36.942112 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:59:36.942636 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:59:36.943078 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:59:36.943468 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:59:36.943913 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:59:36.944251 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:59:36.944612 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:59:36.944925 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:59:36.945431 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:59:36.945756 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:59:36.946106 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:59:36.946537 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:59:36.946989 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:59:36.947382 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:59:36.947841 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:59:36.948214 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:59:36.948997 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:59:36.950048 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:59:36.950434 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:59:36.951438 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:59:36.952643 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:59:36.953071 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:59:36.953417 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:59:36.953811 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:59:36.954199 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:59:36.954637 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:59:36.955144 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:59:36.955581 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:59:36.956111 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:59:36.956608 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:59:36.957158 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:59:36.957806 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:59:36.958271 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:59:36.959490 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:59:36.960105 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:59:36.960650 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:59:36.961134 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:59:36.961566 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:59:36.962102 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:59:36.962668 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:59:36.963134 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:59:36.963668 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:59:36.966355 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:59:36.967258 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:59:36.968345 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:59:36.969007 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:59:36.969465 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:59:36.969876 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:59:36.970697 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:59:36.971171 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:59:36.971766 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:59:36.972165 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:59:36.972610 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:59:36.973100 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:59:36.973806 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:59:36.974301 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:59:37.002795 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:59:37.003978 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:59:37.004653 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:59:37.006750 [ 11073 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:59:37.203548 [ 11073 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:59:37.205511 [ 11073 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:59:37.241895 [ 11073 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:59:37.241978 [ 11073 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:59:37.242017 [ 11073 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:59:37.336660 [ 11073 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:59:37.336759 [ 11073 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:59:37.336839 [ 11073 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:59:37.337017 [ 11073 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:37.343887 [ 11073 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:37.350872 [ 11073 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:37.364323 [ 11073 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:59:37.364480 [ 11073 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:37.366559 [ 11073 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:59:37.367402 [ 11073 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:59:37.368451 [ 11073 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:59:37.368517 [ 11073 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:59:37.369932 [ 11073 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:59:37.369968 [ 11073 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:59:37.369991 [ 11073 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:59:37.370032 [ 11073 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:59:37.370055 [ 11073 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:59:37.370226 [ 11073 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:37.370286 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.745180 [ 11073 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:37.756352 [ 11073 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:37.756442 [ 11073 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:37.757450 [ 11073 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/wyy/nmohukcxnvjpwflmcarlqyrvpjwrh 2025.04.02 03:59:37.757941 [ 11073 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/wyy/nmohukcxnvjpwflmcarlqyrvpjwrh. 2025.04.02 03:59:37.844460 [ 11659 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/wyy/nmohukcxnvjpwflmcarlqyrvpjwrh, size 4 2025.04.02 03:59:37.845175 [ 11073 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/wyy/nmohukcxnvjpwflmcarlqyrvpjwrh. 2025.04.02 03:59:37.854121 [ 11073 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/wyy/nmohukcxnvjpwflmcarlqyrvpjwrh 2025.04.02 03:59:37.854206 [ 11073 ] {} deleteFileFromS3: Object with path s3/wyy/nmohukcxnvjpwflmcarlqyrvpjwrh was removed from S3 2025.04.02 03:59:37.854285 [ 11073 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:59:37.854380 [ 11073 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:59:37.858131 [ 11073 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:37.870438 [ 11073 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:37.870538 [ 11073 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:37.891485 [ 11073 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:59:37.891743 [ 11073 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:59:37 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DD5A3103532 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:59:37.891971 [ 11073 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:59:37.897593 [ 11073 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 03:59:37.897673 [ 11073 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 03:59:37.897742 [ 11073 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:59:37.897807 [ 11073 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:59:37.897966 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.898067 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.898143 [ 11073 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:37.898211 [ 11073 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:37.898318 [ 11073 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:59:37.993230 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.993483 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.993623 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.993720 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:37.993841 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:38.008551 [ 11073 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:38.021630 [ 11073 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:38.021730 [ 11073 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:38.137439 [ 11073 ] {} deleteFileFromS3: No blob storage log, not writing blob special/tdy/efumeqtuoafgsppuxxwpqvlspjmma 2025.04.02 03:59:38.137513 [ 11073 ] {} deleteFileFromS3: Object with path special/tdy/efumeqtuoafgsppuxxwpqvlspjmma was removed from S3 2025.04.02 03:59:38.137561 [ 11073 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:59:38.137601 [ 11073 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:59:38.141153 [ 11073 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:38.152628 [ 11073 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:38.152716 [ 11073 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:38.167809 [ 11073 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/njq/uwpoaxbvixiukuasduwzytupzclfd 2025.04.02 03:59:38.167887 [ 11073 ] {} deleteFileFromS3: Object with path test_02944/njq/uwpoaxbvixiukuasduwzytupzclfd was removed from S3 2025.04.02 03:59:38.167937 [ 11073 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:59:38.167977 [ 11073 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:59:38.168141 [ 11073 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:38.171790 [ 11073 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:38.176073 [ 11073 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:59:38.176198 [ 11073 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 03:59:38.178160 [ 11073 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:59:38.178450 [ 11073 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:59:38.179511 [ 11073 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:59:38.179630 [ 11073 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:59:38.179690 [ 11073 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 03:59:38.179733 [ 11073 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 03:59:38.179773 [ 11073 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 03:59:38.180280 [ 11073 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 14 entries 2025.04.02 03:59:38.180370 [ 11073 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:59:38.180473 [ 11073 ] {} KeeperServer: Last local log idx 14 2025.04.02 03:59:38.180528 [ 11073 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 14 2025.04.02 03:59:38.181886 [ 11073 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:59:38.192717 [ 11073 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:59:38.193050 [ 11073 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:59:38.193153 [ 11073 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:59:38.193216 [ 11073 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:59:38.193282 [ 11073 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:59:38.193343 [ 11073 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:59:38.193421 [ 11073 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 14 election timer allowed log store start 1, end 14 config log idx 14, prev log idx 13 -- ASYNC REPLICATION -- 2025.04.02 03:59:38.193467 [ 11073 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 03:59:38.193540 [ 11073 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:59:38.193599 [ 11073 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:59:38.194115 [ 11073 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:59:38.194226 [ 11686 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:59:38.244606 [ 11669 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:59:38.244872 [ 11669 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:59:38.245027 [ 11669 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 14, state term 14, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:59:38.245138 [ 11073 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:59:38.245143 [ 11669 ] {} RaftInstance: pre-vote term (0) is different, reset it to 14 2025.04.02 03:59:38.245640 [ 11669 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:59:38.249320 [ 11669 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 15, log idx 14, log term 14, priority (target 1 / mine 1) 2025.04.02 03:59:38.249426 [ 11669 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:59:38.249514 [ 11669 ] {} RaftInstance: state machine commit index 0, precommit index 14, last log index 14 2025.04.02 03:59:38.249605 [ 11669 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 03:59:38.249972 [ 11669 ] {} RaftInstance: [BECOME LEADER] appended new config at 15 2025.04.02 03:59:38.250290 [ 11685 ] {} RaftInstance: config at index 1 is committed, prev config log idx 14 2025.04.02 03:59:38.250475 [ 11685 ] {} RaftInstance: skipped config 1, latest config 14 2025.04.02 03:59:38.250616 [ 11685 ] {} RaftInstance: config at index 2 is committed, prev config log idx 14 2025.04.02 03:59:38.250662 [ 11685 ] {} RaftInstance: skipped config 2, latest config 14 2025.04.02 03:59:38.250742 [ 11685 ] {} RaftInstance: config at index 3 is committed, prev config log idx 14 2025.04.02 03:59:38.250786 [ 11685 ] {} RaftInstance: skipped config 3, latest config 14 2025.04.02 03:59:38.250859 [ 11685 ] {} RaftInstance: config at index 4 is committed, prev config log idx 14 2025.04.02 03:59:38.250897 [ 11685 ] {} RaftInstance: skipped config 4, latest config 14 2025.04.02 03:59:38.250981 [ 11685 ] {} RaftInstance: config at index 5 is committed, prev config log idx 14 2025.04.02 03:59:38.251018 [ 11685 ] {} RaftInstance: skipped config 5, latest config 14 2025.04.02 03:59:38.251100 [ 11685 ] {} RaftInstance: config at index 6 is committed, prev config log idx 14 2025.04.02 03:59:38.251157 [ 11685 ] {} RaftInstance: skipped config 6, latest config 14 2025.04.02 03:59:38.251230 [ 11685 ] {} RaftInstance: config at index 7 is committed, prev config log idx 14 2025.04.02 03:59:38.251265 [ 11685 ] {} RaftInstance: skipped config 7, latest config 14 2025.04.02 03:59:38.251351 [ 11685 ] {} RaftInstance: config at index 8 is committed, prev config log idx 14 2025.04.02 03:59:38.251405 [ 11685 ] {} RaftInstance: skipped config 8, latest config 14 2025.04.02 03:59:38.251475 [ 11685 ] {} RaftInstance: config at index 9 is committed, prev config log idx 14 2025.04.02 03:59:38.251509 [ 11685 ] {} RaftInstance: skipped config 9, latest config 14 2025.04.02 03:59:38.251576 [ 11685 ] {} RaftInstance: config at index 10 is committed, prev config log idx 14 2025.04.02 03:59:38.251610 [ 11685 ] {} RaftInstance: skipped config 10, latest config 14 2025.04.02 03:59:38.251680 [ 11685 ] {} RaftInstance: config at index 11 is committed, prev config log idx 14 2025.04.02 03:59:38.251710 [ 11685 ] {} RaftInstance: skipped config 11, latest config 14 2025.04.02 03:59:38.251765 [ 11685 ] {} RaftInstance: config at index 12 is committed, prev config log idx 14 2025.04.02 03:59:38.251793 [ 11685 ] {} RaftInstance: skipped config 12, latest config 14 2025.04.02 03:59:38.251856 [ 11685 ] {} RaftInstance: config at index 13 is committed, prev config log idx 14 2025.04.02 03:59:38.251891 [ 11685 ] {} RaftInstance: skipped config 13, latest config 14 2025.04.02 03:59:38.251943 [ 11685 ] {} RaftInstance: config at index 14 is committed, prev config log idx 14 2025.04.02 03:59:38.251973 [ 11685 ] {} RaftInstance: skipped config 14, latest config 14 2025.04.02 03:59:38.252048 [ 11685 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 03:59:38.252089 [ 11685 ] {} KeeperServer: Preprocessing done 2025.04.02 03:59:38.252139 [ 11685 ] {} RaftInstance: config at index 15 is committed, prev config log idx 14 2025.04.02 03:59:38.252197 [ 11685 ] {} RaftInstance: new config log idx 15, prev log idx 14, cur config log idx 14, prev log idx 13 2025.04.02 03:59:38.252285 [ 11685 ] {} RaftInstance: new configuration: log idx 15, prev log idx 14 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 15 2025.04.02 03:59:38.252443 [ 11073 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:59:38.253212 [ 11073 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:59:38.255377 [ 11073 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:59:38.255900 [ 11073 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:59:38.268557 [ 11073 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:59:38.268658 [ 11073 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:59:38.269808 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:59:38.270222 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:59:38.270827 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:59:38.271120 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:59:38.271387 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:59:38.271631 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:59:38.271876 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:59:38.272199 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:59:38.276271 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:59:38.276676 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:59:38.277040 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:59:38.277429 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:59:38.277816 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:59:38.278169 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:59:38.278589 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:59:38.278985 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:59:38.279343 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:59:38.279766 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:59:38.280075 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:59:38.280427 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:59:38.280755 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:59:38.281173 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:59:38.281921 [ 11073 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:59:38.289077 [ 11073 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:59:38.289258 [ 11073 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:59:38.295821 [ 11073 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:59:38.295925 [ 11073 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:38.298879 [ 11073 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:59:38.300082 [ 11073 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:59:38.300766 [ 11073 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:59:38.301317 [ 11692 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:59:38.308798 [ 11073 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:59:38.311640 [ 11073 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:59:38.319408 [ 11073 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:59:38.322330 [ 11073 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:59:38.329605 [ 11073 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:59:38.331218 [ 11073 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:59:38.332514 [ 11073 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:59:38.332611 [ 11073 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:59:38.332680 [ 11084 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:59:38.333512 [ 11084 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:59:42.630147 [ 11073 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:42.630580 [ 11073 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:59:42.630862 [ 11073 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:59:42.630915 [ 11073 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:59:42.631219 [ 11083 ] {} CancellationChecker: Execution took 5755 ms. 2025.04.02 03:59:42.631891 [ 11073 ] {} Application: Shutting down storages. 2025.04.02 03:59:42.631941 [ 11073 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:59:42.633024 [ 11073 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:59:42.633076 [ 11073 ] {} Context: Shutting down workload entity storage 2025.04.02 03:59:42.633111 [ 11073 ] {} Context: Shutting down named sessions 2025.04.02 03:59:42.633167 [ 11073 ] {} Context: Shutting down database catalog 2025.04.02 03:59:42.633200 [ 11073 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:59:42.633258 [ 11073 ] {} Context: Shutting down merges executor 2025.04.02 03:59:42.633750 [ 11073 ] {} Context: Shutting down fetches executor 2025.04.02 03:59:42.634211 [ 11073 ] {} Context: Shutting down moves executor 2025.04.02 03:59:42.634561 [ 11073 ] {} Context: Shutting down common executor 2025.04.02 03:59:42.634837 [ 11073 ] {} Context: Shutting down DDLWorker 2025.04.02 03:59:42.634866 [ 11073 ] {} Context: Shutting down caches 2025.04.02 03:59:42.634896 [ 11073 ] {} Context: Shutting down AccessControl 2025.04.02 03:59:42.635203 [ 11073 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:59:42.637450 [ 11073 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:59:42.648723 [ 11073 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:59:42.648989 [ 11073 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:59:42.649441 [ 11073 ] {} Application: Shut down storages. 2025.04.02 03:59:42.649494 [ 11073 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:59:42.761987 [ 11073 ] {} Application: Closed all listening sockets. 2025.04.02 03:59:42.762086 [ 11073 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:59:42.762140 [ 11073 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:59:43.255444 [ 11073 ] {} RaftInstance: shutting down raft core 2025.04.02 03:59:43.255578 [ 11073 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:59:43.256264 [ 11073 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:59:43.256332 [ 11073 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:59:43.256369 [ 11073 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:59:43.256408 [ 11073 ] {} RaftInstance: reset all pointers. 2025.04.02 03:59:43.256441 [ 11073 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:59:43.256550 [ 11073 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:59:43.256583 [ 11686 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:59:43.256705 [ 11073 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:59:43.256749 [ 11073 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:59:43.256781 [ 11073 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:59:43.256990 [ 11672 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:59:43.257164 [ 11671 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 03:59:43.257162 [ 11670 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:59:43.257282 [ 11673 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:59:43.257323 [ 11676 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:59:43.257387 [ 11675 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:59:43.257484 [ 11679 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:59:43.257486 [ 11680 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:59:43.257611 [ 11672 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:59:43.257607 [ 11682 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:59:43.257500 [ 11678 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:59:43.257701 [ 11669 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:59:43.257496 [ 11677 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:59:43.257638 [ 11681 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:59:43.257751 [ 11683 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:59:43.258033 [ 11674 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:59:43.258132 [ 11684 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:59:43.258459 [ 11073 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:43.258634 [ 11668 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:59:43.259332 [ 11073 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:59:43.259498 [ 11073 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:59:43.259541 [ 11073 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:59:43.259601 [ 11073 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:59:43.259650 [ 11073 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:43.259784 [ 11073 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:43.259835 [ 11073 ] {} Context: Destructing threadpool writer 2025.04.02 03:59:43.263253 [ 11073 ] {} Application: Destroyed global context. 2025.04.02 03:59:43.263812 [ 11073 ] {} Application: Waiting for background threads 2025.04.02 03:59:43.345747 [ 11073 ] {} Application: Background threads finished in 81 ms 2025.04.02 03:59:43.346367 [ 11073 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:59:43.346582 [ 11073 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:43.447730 [ 11073 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:43.448078 [ 11073 ] {} Application: shutting down 2025.04.02 03:59:43.448153 [ 11073 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:59:43.457244 [ 11076 ] {} BaseDaemon: Received signal -2 2025.04.02 03:59:43.457364 [ 11076 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:59:43.587869 [ 11071 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:59:44.257884 [ 11803 ] {} Application: Will watch for the process with pid 11805 2025.04.02 03:59:44.259562 [ 11805 ] {} Application: Forked a child process to watch 2025.04.02 03:59:44.261383 [ 11805 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:59:44.761278 [ 11805 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 11805 2025.04.02 03:59:44.762201 [ 11805 ] {} Application: starting up 2025.04.02 03:59:44.762340 [ 11805 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:59:44.795196 [ 11805 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:59:44.795379 [ 11805 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 03:59:44.795626 [ 11805 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:59:44.795693 [ 11805 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:59:44.795728 [ 11805 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:59:44.795762 [ 11805 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 03:59:44.797391 [ 11805 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:59:44.797824 [ 11805 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:59:44.797875 [ 11805 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:59:44.798046 [ 11805 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:59:44.798100 [ 11805 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:59:45.775465 [ 11805 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 03:59:45.777520 [ 11805 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:59:45.777585 [ 11805 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 03:59:45.777740 [ 11805 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:59:45.778424 [ 11805 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:59:46.102850 [ 11815 ] {} CancellationChecker: Started worker function 2025.04.02 03:59:46.103288 [ 11805 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:59:46.103396 [ 11805 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:59:46.103455 [ 11805 ] {} Application: Initializing DateLUT. 2025.04.02 03:59:46.103501 [ 11805 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:59:46.103796 [ 11805 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:59:46.104341 [ 11805 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:59:46.190605 [ 11805 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:59:46.190813 [ 11805 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:59:46.191401 [ 11805 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:59:46.192171 [ 11805 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 03:59:46.192362 [ 11805 ] {} Application: Initializing interserver credentials. 2025.04.02 03:59:46.193923 [ 11805 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:59:46.204125 [ 11805 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:59:46.204909 [ 11805 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:59:46.300964 [ 11805 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:59:46.301114 [ 11805 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:59:46.314419 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:59:46.316176 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:59:46.316900 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:59:46.317750 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:59:46.318571 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:59:46.327443 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:59:46.328176 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:59:46.328918 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:59:46.329716 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:59:46.330348 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:59:46.331289 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:59:46.331916 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:59:46.332609 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:59:46.333200 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:59:46.334181 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:59:46.334922 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:59:46.335666 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:59:46.336367 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:59:46.337190 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:59:46.337885 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:59:46.338665 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:59:46.339429 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:59:46.340975 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:59:46.342950 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:59:46.343596 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:59:46.345549 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:59:46.347881 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:59:46.348642 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:59:46.349302 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:59:46.349995 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:59:46.350846 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:59:46.351586 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:59:46.352333 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:59:46.352825 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:59:46.353354 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:59:46.353792 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:59:46.354301 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:59:46.354912 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:59:46.355349 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:59:46.356453 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:59:46.357089 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:59:46.357515 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:59:46.357946 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:59:46.389428 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:59:46.390367 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:59:46.391053 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:59:46.391550 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:59:46.392040 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:59:46.394589 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:59:46.395467 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:59:46.396418 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:59:46.397128 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:59:46.397552 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:59:46.397936 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:59:46.398693 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:59:46.399231 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:59:46.399826 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:59:46.400253 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:59:46.400769 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:59:46.401210 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:59:46.401890 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:59:46.402305 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:59:46.402883 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:59:46.403562 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:59:46.404076 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:59:46.405908 [ 11805 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:59:46.564831 [ 11805 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:59:46.566683 [ 11805 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:59:46.603186 [ 11805 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:59:46.603274 [ 11805 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:59:46.603331 [ 11805 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:59:46.644351 [ 11805 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:59:46.644441 [ 11805 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:59:46.644512 [ 11805 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:59:46.644751 [ 11805 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:46.650657 [ 11805 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:46.656476 [ 11805 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:46.668574 [ 11805 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:59:46.668709 [ 11805 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:46.670917 [ 11805 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:59:46.671790 [ 11805 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:59:46.672830 [ 11805 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:59:46.672915 [ 11805 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:59:46.674416 [ 11805 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:59:46.674454 [ 11805 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:59:46.674477 [ 11805 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:59:46.674521 [ 11805 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:59:46.674545 [ 11805 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:59:46.674717 [ 11805 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:46.674777 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.847087 [ 11805 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:46.857075 [ 11805 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:46.857145 [ 11805 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:46.858160 [ 11805 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/hwt/fvbinhwdmownvsazphpvvksokzdim 2025.04.02 03:59:46.858736 [ 11805 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/hwt/fvbinhwdmownvsazphpvvksokzdim. 2025.04.02 03:59:46.866364 [ 12391 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/hwt/fvbinhwdmownvsazphpvvksokzdim, size 4 2025.04.02 03:59:46.867113 [ 11805 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/hwt/fvbinhwdmownvsazphpvvksokzdim. 2025.04.02 03:59:46.876235 [ 11805 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/hwt/fvbinhwdmownvsazphpvvksokzdim 2025.04.02 03:59:46.876292 [ 11805 ] {} deleteFileFromS3: Object with path s3/hwt/fvbinhwdmownvsazphpvvksokzdim was removed from S3 2025.04.02 03:59:46.876364 [ 11805 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:59:46.876418 [ 11805 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:59:46.879436 [ 11805 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:46.889054 [ 11805 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:46.889108 [ 11805 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:46.910371 [ 11805 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:59:46.910620 [ 11805 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:59:46 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DD7BCA14829 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:59:46.910770 [ 11805 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:59:46.915411 [ 11805 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 03:59:46.915461 [ 11805 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 03:59:46.915534 [ 11805 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:59:46.915583 [ 11805 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:59:46.915694 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.915761 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.915819 [ 11805 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:46.915873 [ 11805 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:46.915931 [ 11805 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:59:46.915992 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.916066 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.916129 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.916181 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.916240 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:46.919154 [ 11805 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:46.947440 [ 11805 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:46.947506 [ 11805 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:47.039174 [ 11805 ] {} deleteFileFromS3: No blob storage log, not writing blob special/yfp/pffmqatcdgvropyfpijfzrcjcwooh 2025.04.02 03:59:47.039261 [ 11805 ] {} deleteFileFromS3: Object with path special/yfp/pffmqatcdgvropyfpijfzrcjcwooh was removed from S3 2025.04.02 03:59:47.039339 [ 11805 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:59:47.039384 [ 11805 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:59:47.043039 [ 11805 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:47.054744 [ 11805 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:47.054824 [ 11805 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:47.071590 [ 11805 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ljv/oukkoxaftsxshrjhswbdoffropnou 2025.04.02 03:59:47.071696 [ 11805 ] {} deleteFileFromS3: Object with path test_02944/ljv/oukkoxaftsxshrjhswbdoffropnou was removed from S3 2025.04.02 03:59:47.071781 [ 11805 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:59:47.071848 [ 11805 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:59:47.072048 [ 11805 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:47.077410 [ 11805 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:47.083782 [ 11805 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:59:47.083948 [ 11805 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 03:59:47.086704 [ 11805 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:59:47.086933 [ 11805 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:59:47.088161 [ 11805 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:59:47.088245 [ 11805 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:59:47.088361 [ 11805 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 03:59:47.088426 [ 11805 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 03:59:47.088495 [ 11805 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 03:59:47.089223 [ 11805 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 15 entries 2025.04.02 03:59:47.089344 [ 11805 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:59:47.089495 [ 11805 ] {} KeeperServer: Last local log idx 15 2025.04.02 03:59:47.089605 [ 11805 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 15 2025.04.02 03:59:47.091628 [ 11805 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:59:47.138078 [ 11805 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:59:47.138651 [ 11805 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:59:47.138817 [ 11805 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:59:47.138985 [ 11805 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:59:47.139126 [ 11805 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:59:47.139208 [ 11805 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:59:47.139364 [ 11805 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 15 election timer allowed log store start 1, end 15 config log idx 15, prev log idx 14 -- ASYNC REPLICATION -- 2025.04.02 03:59:47.139445 [ 11805 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 03:59:47.139566 [ 11805 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:59:47.139695 [ 11805 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:59:47.140590 [ 11805 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:59:47.191038 [ 12401 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:59:47.191229 [ 12401 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:59:47.191371 [ 12401 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 15, state term 15, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:59:47.191432 [ 12401 ] {} RaftInstance: pre-vote term (0) is different, reset it to 15 2025.04.02 03:59:47.191764 [ 11805 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:59:47.191778 [ 12401 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:59:47.194747 [ 12401 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 16, log idx 15, log term 15, priority (target 1 / mine 1) 2025.04.02 03:59:47.194825 [ 12401 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:59:47.194883 [ 12401 ] {} RaftInstance: state machine commit index 0, precommit index 15, last log index 15 2025.04.02 03:59:47.194953 [ 12401 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 03:59:47.195413 [ 12401 ] {} RaftInstance: [BECOME LEADER] appended new config at 16 2025.04.02 03:59:47.195869 [ 12418 ] {} RaftInstance: config at index 1 is committed, prev config log idx 15 2025.04.02 03:59:47.196000 [ 12418 ] {} RaftInstance: skipped config 1, latest config 15 2025.04.02 03:59:47.196174 [ 12418 ] {} RaftInstance: config at index 2 is committed, prev config log idx 15 2025.04.02 03:59:47.196226 [ 12418 ] {} RaftInstance: skipped config 2, latest config 15 2025.04.02 03:59:47.196329 [ 12418 ] {} RaftInstance: config at index 3 is committed, prev config log idx 15 2025.04.02 03:59:47.196370 [ 12418 ] {} RaftInstance: skipped config 3, latest config 15 2025.04.02 03:59:47.196481 [ 12418 ] {} RaftInstance: config at index 4 is committed, prev config log idx 15 2025.04.02 03:59:47.196521 [ 12418 ] {} RaftInstance: skipped config 4, latest config 15 2025.04.02 03:59:47.196612 [ 12418 ] {} RaftInstance: config at index 5 is committed, prev config log idx 15 2025.04.02 03:59:47.196649 [ 12418 ] {} RaftInstance: skipped config 5, latest config 15 2025.04.02 03:59:47.196719 [ 12418 ] {} RaftInstance: config at index 6 is committed, prev config log idx 15 2025.04.02 03:59:47.196759 [ 12418 ] {} RaftInstance: skipped config 6, latest config 15 2025.04.02 03:59:47.196846 [ 12418 ] {} RaftInstance: config at index 7 is committed, prev config log idx 15 2025.04.02 03:59:47.196893 [ 12418 ] {} RaftInstance: skipped config 7, latest config 15 2025.04.02 03:59:47.196973 [ 12418 ] {} RaftInstance: config at index 8 is committed, prev config log idx 15 2025.04.02 03:59:47.197023 [ 12418 ] {} RaftInstance: skipped config 8, latest config 15 2025.04.02 03:59:47.197099 [ 12418 ] {} RaftInstance: config at index 9 is committed, prev config log idx 15 2025.04.02 03:59:47.197137 [ 12418 ] {} RaftInstance: skipped config 9, latest config 15 2025.04.02 03:59:47.197201 [ 12418 ] {} RaftInstance: config at index 10 is committed, prev config log idx 15 2025.04.02 03:59:47.197236 [ 12418 ] {} RaftInstance: skipped config 10, latest config 15 2025.04.02 03:59:47.197302 [ 12418 ] {} RaftInstance: config at index 11 is committed, prev config log idx 15 2025.04.02 03:59:47.197356 [ 12418 ] {} RaftInstance: skipped config 11, latest config 15 2025.04.02 03:59:47.197435 [ 12418 ] {} RaftInstance: config at index 12 is committed, prev config log idx 15 2025.04.02 03:59:47.197470 [ 12418 ] {} RaftInstance: skipped config 12, latest config 15 2025.04.02 03:59:47.197530 [ 12418 ] {} RaftInstance: config at index 13 is committed, prev config log idx 15 2025.04.02 03:59:47.197559 [ 12418 ] {} RaftInstance: skipped config 13, latest config 15 2025.04.02 03:59:47.197632 [ 12418 ] {} RaftInstance: config at index 14 is committed, prev config log idx 15 2025.04.02 03:59:47.197662 [ 12418 ] {} RaftInstance: skipped config 14, latest config 15 2025.04.02 03:59:47.197748 [ 12418 ] {} RaftInstance: config at index 15 is committed, prev config log idx 15 2025.04.02 03:59:47.197777 [ 12418 ] {} RaftInstance: skipped config 15, latest config 15 2025.04.02 03:59:47.197853 [ 12418 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 03:59:47.197905 [ 12418 ] {} KeeperServer: Preprocessing done 2025.04.02 03:59:47.197952 [ 12418 ] {} RaftInstance: config at index 16 is committed, prev config log idx 15 2025.04.02 03:59:47.198016 [ 12418 ] {} RaftInstance: new config log idx 16, prev log idx 15, cur config log idx 15, prev log idx 14 2025.04.02 03:59:47.198108 [ 12418 ] {} RaftInstance: new configuration: log idx 16, prev log idx 15 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 16 2025.04.02 03:59:47.198308 [ 11805 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:59:47.198997 [ 12419 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:59:47.199463 [ 11805 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:59:47.201622 [ 11805 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:59:47.202019 [ 11805 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:59:47.220712 [ 11805 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:59:47.220839 [ 11805 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:59:47.222560 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:59:47.223140 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:59:47.223961 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:59:47.224383 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:59:47.224759 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:59:47.225132 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:59:47.225507 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:59:47.226083 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:59:47.232997 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:59:47.233645 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:59:47.234197 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:59:47.234979 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:59:47.235670 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:59:47.236247 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:59:47.236828 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:59:47.237490 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:59:47.238184 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:59:47.239020 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:59:47.239697 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:59:47.240481 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:59:47.241113 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:59:47.241934 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:59:47.243381 [ 11805 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:59:47.257671 [ 11805 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:59:47.258157 [ 11805 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:59:47.271189 [ 11805 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:59:47.271359 [ 11805 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:47.276874 [ 11805 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:59:47.278805 [ 11805 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:59:47.279429 [ 11805 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:59:47.279931 [ 12423 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:59:47.288782 [ 11805 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:59:47.292085 [ 11805 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:59:47.298371 [ 11805 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:59:47.301647 [ 11805 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:59:47.355417 [ 11805 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:59:47.357252 [ 11805 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:59:47.358775 [ 11805 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:59:47.358879 [ 11805 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:59:47.358920 [ 11816 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:59:47.359611 [ 11816 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:59:52.332909 [ 11805 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:52.333397 [ 11805 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:59:52.333785 [ 11805 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:59:52.333864 [ 11805 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:59:52.334047 [ 11815 ] {} CancellationChecker: Execution took 6231 ms. 2025.04.02 03:59:52.334351 [ 11805 ] {} Application: Shutting down storages. 2025.04.02 03:59:52.334449 [ 11805 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:59:52.336035 [ 11805 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:59:52.336094 [ 11805 ] {} Context: Shutting down workload entity storage 2025.04.02 03:59:52.336129 [ 11805 ] {} Context: Shutting down named sessions 2025.04.02 03:59:52.336195 [ 11805 ] {} Context: Shutting down database catalog 2025.04.02 03:59:52.336237 [ 11805 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:59:52.336304 [ 11805 ] {} Context: Shutting down merges executor 2025.04.02 03:59:52.336713 [ 11805 ] {} Context: Shutting down fetches executor 2025.04.02 03:59:52.337166 [ 11805 ] {} Context: Shutting down moves executor 2025.04.02 03:59:52.337447 [ 11805 ] {} Context: Shutting down common executor 2025.04.02 03:59:52.337738 [ 11805 ] {} Context: Shutting down DDLWorker 2025.04.02 03:59:52.337772 [ 11805 ] {} Context: Shutting down caches 2025.04.02 03:59:52.337812 [ 11805 ] {} Context: Shutting down AccessControl 2025.04.02 03:59:52.338096 [ 11805 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:59:52.342282 [ 11805 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:59:52.375363 [ 11805 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:59:52.376027 [ 11805 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:59:52.377024 [ 11805 ] {} Application: Shut down storages. 2025.04.02 03:59:52.377097 [ 11805 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:59:52.709379 [ 11805 ] {} Application: Closed all listening sockets. 2025.04.02 03:59:52.709495 [ 11805 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:59:52.709567 [ 11805 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:59:53.202186 [ 11805 ] {} RaftInstance: shutting down raft core 2025.04.02 03:59:53.202353 [ 11805 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:59:53.228173 [ 11805 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:59:53.228285 [ 11805 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:59:53.228384 [ 11805 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:59:53.228461 [ 11805 ] {} RaftInstance: reset all pointers. 2025.04.02 03:59:53.228523 [ 11805 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:59:53.229872 [ 11805 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:59:53.229905 [ 12419 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:59:53.230144 [ 11805 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:59:53.230218 [ 11805 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:59:53.230273 [ 11805 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:59:53.230769 [ 12401 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:59:53.230801 [ 12403 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:59:53.230951 [ 12402 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:59:53.230980 [ 12409 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:59:53.231233 [ 12415 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:59:53.231061 [ 12414 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:59:53.231447 [ 12412 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:59:53.231431 [ 12417 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:59:53.231783 [ 12406 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:59:53.231756 [ 12416 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:59:53.231799 [ 12407 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:59:53.231488 [ 12411 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:59:53.231453 [ 12408 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:59:53.231817 [ 12405 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:59:53.231483 [ 12413 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:59:53.291552 [ 12404 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:59:53.291891 [ 12404 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:59:53.292235 [ 11805 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:53.292458 [ 12400 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:59:53.293474 [ 11805 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:59:53.293712 [ 11805 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:59:53.293794 [ 11805 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:59:53.293882 [ 11805 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:59:53.293947 [ 11805 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:53.294130 [ 11805 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:59:53.294183 [ 11805 ] {} Context: Destructing threadpool writer 2025.04.02 03:59:53.367574 [ 11805 ] {} Application: Destroyed global context. 2025.04.02 03:59:53.368285 [ 11805 ] {} Application: Waiting for background threads 2025.04.02 03:59:53.533945 [ 11805 ] {} Application: Background threads finished in 165 ms 2025.04.02 03:59:53.534637 [ 11805 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:59:53.534712 [ 11805 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:59:53.550102 [ 11805 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:59:53.550663 [ 11805 ] {} Application: shutting down 2025.04.02 03:59:53.550707 [ 11805 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:59:53.560470 [ 11808 ] {} BaseDaemon: Received signal -2 2025.04.02 03:59:53.560575 [ 11808 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:59:53.937382 [ 11803 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:59:54.359683 [ 12540 ] {} Application: Will watch for the process with pid 12542 2025.04.02 03:59:54.361204 [ 12542 ] {} Application: Forked a child process to watch 2025.04.02 03:59:54.362907 [ 12542 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:59:55.195042 [ 12542 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 12542 2025.04.02 03:59:55.196662 [ 12542 ] {} Application: starting up 2025.04.02 03:59:55.196790 [ 12542 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:59:55.244943 [ 12542 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:59:55.245098 [ 12542 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 03:59:55.245358 [ 12542 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:59:55.245434 [ 12542 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:59:55.245472 [ 12542 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:59:55.245505 [ 12542 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 03:59:55.247070 [ 12542 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:59:55.247576 [ 12542 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:59:55.247630 [ 12542 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:59:55.247831 [ 12542 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:59:55.247923 [ 12542 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:59:56.086026 [ 12542 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 03:59:56.088281 [ 12542 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:59:56.088372 [ 12542 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 03:59:56.088535 [ 12542 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:59:56.089396 [ 12542 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:59:56.377182 [ 12556 ] {} CancellationChecker: Started worker function 2025.04.02 03:59:56.377683 [ 12542 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:59:56.377793 [ 12542 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:59:56.377892 [ 12542 ] {} Application: Initializing DateLUT. 2025.04.02 03:59:56.377954 [ 12542 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:59:56.378303 [ 12542 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:59:56.378951 [ 12542 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:59:56.403423 [ 12542 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:59:56.403650 [ 12542 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:59:56.404215 [ 12542 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:59:56.405080 [ 12542 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 03:59:56.405227 [ 12542 ] {} Application: Initializing interserver credentials. 2025.04.02 03:59:56.406663 [ 12542 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:59:56.416580 [ 12542 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:59:56.417369 [ 12542 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:59:56.481033 [ 12542 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:59:56.481139 [ 12542 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:59:56.489868 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:59:56.491150 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:59:56.491624 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:59:56.492124 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:59:56.492570 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:59:56.497516 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:59:56.497962 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:59:56.498454 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:59:56.498841 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:59:56.499190 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:59:56.499724 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:59:56.500080 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:59:56.500450 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:59:56.500781 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:59:56.501328 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:59:56.501701 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:59:56.502062 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:59:56.502533 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:59:56.503017 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:59:56.503446 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:59:56.503837 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:59:56.504270 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:59:56.505275 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:59:56.506989 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:59:56.507520 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:59:56.508733 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:59:56.510350 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:59:56.510856 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:59:56.511246 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:59:56.511672 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:59:56.512101 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:59:56.512539 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:59:56.513022 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:59:56.513583 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:59:56.514148 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:59:56.514989 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:59:56.515565 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:59:56.516213 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:59:56.517105 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:59:56.599661 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:59:56.601005 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:59:56.601786 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:59:56.602550 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:59:56.603208 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:59:56.603981 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:59:56.604557 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:59:56.605126 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:59:56.605831 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:59:56.609293 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:59:56.610365 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:59:56.611724 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:59:56.612563 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:59:56.613119 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:59:56.613665 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:59:56.624079 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:59:56.625297 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:59:56.626265 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:59:56.627073 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:59:56.627839 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:59:56.628515 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:59:56.629411 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:59:56.629990 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:59:56.630745 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:59:56.631648 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:59:56.632295 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:59:56.634851 [ 12542 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:59:56.828179 [ 12542 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:59:56.830162 [ 12542 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:59:56.868112 [ 12542 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:59:56.868231 [ 12542 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:59:56.868287 [ 12542 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:59:56.883609 [ 12542 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:59:56.883687 [ 12542 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:59:56.883742 [ 12542 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:59:56.883870 [ 12542 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:56.901714 [ 12542 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:56.908678 [ 12542 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:59:56.922138 [ 12542 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:59:56.922331 [ 12542 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:56.925152 [ 12542 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:59:56.926069 [ 12542 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:59:56.927228 [ 12542 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:59:56.927314 [ 12542 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:59:56.928921 [ 12542 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:59:56.928962 [ 12542 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 03:59:56.928987 [ 12542 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:59:56.929031 [ 12542 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:59:56.929055 [ 12542 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:59:56.929242 [ 12542 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:56.929309 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.124474 [ 12542 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:57.134787 [ 12542 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:57.134873 [ 12542 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:57.135985 [ 12542 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/zvj/dvfosxyvwymjnfojdmaziuvxdubox 2025.04.02 03:59:57.136619 [ 12542 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/zvj/dvfosxyvwymjnfojdmaziuvxdubox. 2025.04.02 03:59:57.143743 [ 13128 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/zvj/dvfosxyvwymjnfojdmaziuvxdubox, size 4 2025.04.02 03:59:57.144476 [ 12542 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/zvj/dvfosxyvwymjnfojdmaziuvxdubox. 2025.04.02 03:59:57.217072 [ 12542 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/zvj/dvfosxyvwymjnfojdmaziuvxdubox 2025.04.02 03:59:57.217150 [ 12542 ] {} deleteFileFromS3: Object with path s3/zvj/dvfosxyvwymjnfojdmaziuvxdubox was removed from S3 2025.04.02 03:59:57.217215 [ 12542 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:59:57.217289 [ 12542 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:59:57.220935 [ 12542 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:57.323769 [ 12542 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:57.323863 [ 12542 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:57.346778 [ 12542 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:59:57.347069 [ 12542 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:59:57 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DDA2AAF277C x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:59:57.347308 [ 12542 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:59:57.352663 [ 12542 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 03:59:57.352734 [ 12542 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 03:59:57.352795 [ 12542 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:59:57.352852 [ 12542 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:59:57.352995 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.353084 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.353164 [ 12542 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:57.353269 [ 12542 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:57.353403 [ 12542 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:59:57.353509 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.353611 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.353727 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.353795 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.353909 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.358292 [ 12542 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:57.370193 [ 12542 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:57.370273 [ 12542 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:57.385091 [ 12542 ] {} deleteFileFromS3: No blob storage log, not writing blob special/zbz/bfdgeaquhurhzychjxfnivvnxcnmj 2025.04.02 03:59:57.385185 [ 12542 ] {} deleteFileFromS3: Object with path special/zbz/bfdgeaquhurhzychjxfnivvnxcnmj was removed from S3 2025.04.02 03:59:57.385255 [ 12542 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:59:57.385304 [ 12542 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:59:57.389174 [ 12542 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:59:57.399506 [ 12542 ] {} S3Client: Provider type: Unknown 2025.04.02 03:59:57.399569 [ 12542 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:59:57.417949 [ 12542 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/onk/esfpnxjvymaawgazohoxnjxzqvgep 2025.04.02 03:59:57.418017 [ 12542 ] {} deleteFileFromS3: Object with path test_02944/onk/esfpnxjvymaawgazohoxnjxzqvgep was removed from S3 2025.04.02 03:59:57.418062 [ 12542 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:59:57.418098 [ 12542 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:59:57.418253 [ 12542 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:59:57.422084 [ 12542 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:59:57.427039 [ 12542 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:59:57.427148 [ 12542 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 03:59:57.428951 [ 12542 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:59:57.429162 [ 12542 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:59:57.430485 [ 12542 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:59:57.430552 [ 12542 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:59:57.430593 [ 12542 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 03:59:57.430627 [ 12542 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 03:59:57.430686 [ 12542 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 03:59:57.431199 [ 12542 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 16 entries 2025.04.02 03:59:57.431260 [ 12542 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:59:57.431372 [ 12542 ] {} KeeperServer: Last local log idx 16 2025.04.02 03:59:57.431425 [ 12542 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 16 2025.04.02 03:59:57.432803 [ 12542 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:59:57.444649 [ 12542 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:59:57.445102 [ 12542 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:59:57.445205 [ 12542 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:59:57.445262 [ 12542 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:59:57.445351 [ 12542 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:59:57.445412 [ 12542 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:59:57.445492 [ 12542 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 16 election timer allowed log store start 1, end 16 config log idx 16, prev log idx 15 -- ASYNC REPLICATION -- 2025.04.02 03:59:57.445535 [ 12542 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 03:59:57.445610 [ 12542 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:59:57.445670 [ 12542 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:59:57.446625 [ 12542 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:59:57.446824 [ 13159 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:59:57.497198 [ 13142 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:59:57.497576 [ 13142 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:59:57.497629 [ 12542 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:59:57.497731 [ 13142 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 16, state term 16, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:59:57.497846 [ 13142 ] {} RaftInstance: pre-vote term (0) is different, reset it to 16 2025.04.02 03:59:57.498203 [ 13142 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:59:57.594187 [ 13142 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 17, log idx 16, log term 16, priority (target 1 / mine 1) 2025.04.02 03:59:57.594366 [ 13142 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:59:57.594513 [ 13142 ] {} RaftInstance: state machine commit index 0, precommit index 16, last log index 16 2025.04.02 03:59:57.594592 [ 13142 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 03:59:57.595008 [ 13142 ] {} RaftInstance: [BECOME LEADER] appended new config at 17 2025.04.02 03:59:57.595410 [ 13158 ] {} RaftInstance: config at index 1 is committed, prev config log idx 16 2025.04.02 03:59:57.595673 [ 13158 ] {} RaftInstance: skipped config 1, latest config 16 2025.04.02 03:59:57.595910 [ 13158 ] {} RaftInstance: config at index 2 is committed, prev config log idx 16 2025.04.02 03:59:57.595988 [ 13158 ] {} RaftInstance: skipped config 2, latest config 16 2025.04.02 03:59:57.596142 [ 13158 ] {} RaftInstance: config at index 3 is committed, prev config log idx 16 2025.04.02 03:59:57.596217 [ 13158 ] {} RaftInstance: skipped config 3, latest config 16 2025.04.02 03:59:57.596429 [ 13158 ] {} RaftInstance: config at index 4 is committed, prev config log idx 16 2025.04.02 03:59:57.596497 [ 13158 ] {} RaftInstance: skipped config 4, latest config 16 2025.04.02 03:59:57.596610 [ 13158 ] {} RaftInstance: config at index 5 is committed, prev config log idx 16 2025.04.02 03:59:57.596700 [ 13158 ] {} RaftInstance: skipped config 5, latest config 16 2025.04.02 03:59:57.596822 [ 13158 ] {} RaftInstance: config at index 6 is committed, prev config log idx 16 2025.04.02 03:59:57.596884 [ 13158 ] {} RaftInstance: skipped config 6, latest config 16 2025.04.02 03:59:57.597006 [ 13158 ] {} RaftInstance: config at index 7 is committed, prev config log idx 16 2025.04.02 03:59:57.597066 [ 13158 ] {} RaftInstance: skipped config 7, latest config 16 2025.04.02 03:59:57.597175 [ 13158 ] {} RaftInstance: config at index 8 is committed, prev config log idx 16 2025.04.02 03:59:57.597262 [ 13158 ] {} RaftInstance: skipped config 8, latest config 16 2025.04.02 03:59:57.597444 [ 13158 ] {} RaftInstance: config at index 9 is committed, prev config log idx 16 2025.04.02 03:59:57.597534 [ 13158 ] {} RaftInstance: skipped config 9, latest config 16 2025.04.02 03:59:57.597648 [ 13158 ] {} RaftInstance: config at index 10 is committed, prev config log idx 16 2025.04.02 03:59:57.597705 [ 13158 ] {} RaftInstance: skipped config 10, latest config 16 2025.04.02 03:59:57.597819 [ 13158 ] {} RaftInstance: config at index 11 is committed, prev config log idx 16 2025.04.02 03:59:57.597914 [ 13158 ] {} RaftInstance: skipped config 11, latest config 16 2025.04.02 03:59:57.598025 [ 13158 ] {} RaftInstance: config at index 12 is committed, prev config log idx 16 2025.04.02 03:59:57.598080 [ 13158 ] {} RaftInstance: skipped config 12, latest config 16 2025.04.02 03:59:57.598200 [ 13158 ] {} RaftInstance: config at index 13 is committed, prev config log idx 16 2025.04.02 03:59:57.598302 [ 13158 ] {} RaftInstance: skipped config 13, latest config 16 2025.04.02 03:59:57.598523 [ 13158 ] {} RaftInstance: config at index 14 is committed, prev config log idx 16 2025.04.02 03:59:57.598588 [ 13158 ] {} RaftInstance: skipped config 14, latest config 16 2025.04.02 03:59:57.598748 [ 13158 ] {} RaftInstance: config at index 15 is committed, prev config log idx 16 2025.04.02 03:59:57.598809 [ 13158 ] {} RaftInstance: skipped config 15, latest config 16 2025.04.02 03:59:57.598930 [ 13158 ] {} RaftInstance: config at index 16 is committed, prev config log idx 16 2025.04.02 03:59:57.598988 [ 13158 ] {} RaftInstance: skipped config 16, latest config 16 2025.04.02 03:59:57.599137 [ 13158 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 03:59:57.599252 [ 13158 ] {} KeeperServer: Preprocessing done 2025.04.02 03:59:57.599353 [ 13158 ] {} RaftInstance: config at index 17 is committed, prev config log idx 16 2025.04.02 03:59:57.599465 [ 13158 ] {} RaftInstance: new config log idx 17, prev log idx 16, cur config log idx 16, prev log idx 15 2025.04.02 03:59:57.599648 [ 13158 ] {} RaftInstance: new configuration: log idx 17, prev log idx 16 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 17 2025.04.02 03:59:57.599894 [ 12542 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:59:57.600833 [ 12542 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:59:57.602801 [ 12542 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:59:57.603305 [ 12542 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:59:57.617705 [ 12542 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:59:57.617775 [ 12542 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:59:57.618904 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:59:57.619294 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:59:57.619866 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:59:57.620157 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:59:57.620421 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:59:57.620672 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:59:57.620920 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:59:57.621297 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:59:57.625523 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:59:57.625920 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:59:57.626278 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:59:57.626735 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:59:57.627121 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:59:57.627502 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:59:57.627863 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:59:57.628308 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:59:57.628771 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:59:57.629313 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:59:57.629734 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:59:57.630183 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:59:57.630636 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:59:57.631191 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:59:57.632180 [ 12542 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:59:57.695166 [ 12542 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:59:57.695412 [ 12542 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:59:57.703877 [ 12542 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:59:57.703984 [ 12542 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:59:57.707800 [ 12542 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:59:57.709223 [ 12542 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:59:57.709938 [ 12542 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:59:57.710815 [ 13165 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:59:57.719937 [ 12542 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:59:57.723624 [ 12542 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:59:57.731016 [ 12542 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:59:57.734694 [ 12542 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:59:57.744413 [ 12542 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:59:57.746089 [ 12542 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:59:57.747553 [ 12542 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:59:57.747651 [ 12542 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:59:57.747787 [ 12557 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:59:57.748651 [ 12557 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:02.811266 [ 12542 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:02.812819 [ 12542 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:02.813327 [ 12542 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:02.813435 [ 12542 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:02.813576 [ 12556 ] {} CancellationChecker: Execution took 6436 ms. 2025.04.02 04:00:02.813854 [ 12542 ] {} Application: Shutting down storages. 2025.04.02 04:00:02.813929 [ 12542 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:02.815883 [ 12542 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:02.815970 [ 12542 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:02.816061 [ 12542 ] {} Context: Shutting down named sessions 2025.04.02 04:00:02.816176 [ 12542 ] {} Context: Shutting down database catalog 2025.04.02 04:00:02.816250 [ 12542 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:02.816348 [ 12542 ] {} Context: Shutting down merges executor 2025.04.02 04:00:02.817015 [ 12542 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:02.817426 [ 12542 ] {} Context: Shutting down moves executor 2025.04.02 04:00:02.817743 [ 12542 ] {} Context: Shutting down common executor 2025.04.02 04:00:02.817973 [ 12542 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:02.818013 [ 12542 ] {} Context: Shutting down caches 2025.04.02 04:00:02.818064 [ 12542 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:02.818430 [ 12542 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:02.884723 [ 12542 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:02.979563 [ 12542 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:02.979970 [ 12542 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:02.980954 [ 12542 ] {} Application: Shut down storages. 2025.04.02 04:00:02.981021 [ 12542 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:03.110754 [ 12542 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:03.110915 [ 12542 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:03.110999 [ 12542 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:03.603100 [ 12542 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:03.603327 [ 12542 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:03.603473 [ 12542 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:03.603556 [ 12542 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:03.603631 [ 12542 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:03.603709 [ 12542 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:03.603774 [ 12542 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:03.603914 [ 12542 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:03.603923 [ 13159 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:03.604082 [ 12542 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:03.604151 [ 12542 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:03.604211 [ 12542 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:03.604590 [ 13145 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:00:03.604895 [ 13144 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:00:03.605107 [ 13154 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:03.604948 [ 13143 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:03.605255 [ 13155 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:03.605313 [ 13142 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:03.605400 [ 13145 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:03.605305 [ 13156 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:03.605314 [ 13151 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:03.605559 [ 13157 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:03.605343 [ 13147 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:03.605482 [ 13150 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:00:03.605345 [ 13152 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:03.605314 [ 13146 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:03.605370 [ 13153 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:03.605499 [ 13148 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:03.605554 [ 13149 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:03.606279 [ 12542 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:03.606534 [ 13141 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:00:03.607329 [ 12542 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:03.607555 [ 12542 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:03.607609 [ 12542 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:03.607686 [ 12542 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:03.607742 [ 12542 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:03.607926 [ 12542 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:03.607975 [ 12542 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:03.611882 [ 12542 ] {} Application: Destroyed global context. 2025.04.02 04:00:03.612608 [ 12542 ] {} Application: Waiting for background threads 2025.04.02 04:00:03.718743 [ 12542 ] {} Application: Background threads finished in 106 ms 2025.04.02 04:00:03.719315 [ 12542 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:03.719394 [ 12542 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:03.733022 [ 12542 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:03.733295 [ 12542 ] {} Application: shutting down 2025.04.02 04:00:03.733337 [ 12542 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:00:03.771958 [ 12546 ] {} BaseDaemon: Received signal -2 2025.04.02 04:00:03.772056 [ 12546 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:00:03.884069 [ 12540 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:00:04.288917 [ 13277 ] {} Application: Will watch for the process with pid 13279 2025.04.02 04:00:04.290491 [ 13279 ] {} Application: Forked a child process to watch 2025.04.02 04:00:04.292143 [ 13279 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:00:04.871776 [ 13279 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 13279 2025.04.02 04:00:04.873143 [ 13279 ] {} Application: starting up 2025.04.02 04:00:04.873289 [ 13279 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:00:04.924990 [ 13279 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:00:04.925190 [ 13279 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:00:04.925503 [ 13279 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:00:04.925600 [ 13279 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:00:04.925654 [ 13279 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:00:04.925708 [ 13279 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:00:04.927607 [ 13279 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:00:04.928282 [ 13279 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:00:04.928353 [ 13279 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:00:04.928630 [ 13279 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:00:04.928714 [ 13279 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:00:06.254173 [ 13279 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:00:06.256674 [ 13279 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:00:06.256740 [ 13279 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:00:06.256892 [ 13279 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:00:06.257690 [ 13279 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:00:06.486894 [ 13806 ] {} CancellationChecker: Started worker function 2025.04.02 04:00:06.487295 [ 13279 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:00:06.487396 [ 13279 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:00:06.487455 [ 13279 ] {} Application: Initializing DateLUT. 2025.04.02 04:00:06.487500 [ 13279 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:00:06.487799 [ 13279 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:00:06.488258 [ 13279 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:00:06.503540 [ 13279 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:00:06.503690 [ 13279 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:00:06.504064 [ 13279 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:00:06.504594 [ 13279 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:00:06.504699 [ 13279 ] {} Application: Initializing interserver credentials. 2025.04.02 04:00:06.505889 [ 13279 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:00:06.512087 [ 13279 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:00:06.512548 [ 13279 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:00:06.523923 [ 13279 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:00:06.524096 [ 13279 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:00:06.531997 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:00:06.532938 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:00:06.533324 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:00:06.533835 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:00:06.534299 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:00:06.538746 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:00:06.539131 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:00:06.539537 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:00:06.539888 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:00:06.540237 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:00:06.540719 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:00:06.541048 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:00:06.541432 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:00:06.541746 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:00:06.542270 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:00:06.542652 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:00:06.543027 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:00:06.543447 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:00:06.543846 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:00:06.544254 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:00:06.544669 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:00:06.545037 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:00:06.545831 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:00:06.643757 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:00:06.644769 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:00:06.731778 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:00:06.734121 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:00:06.734855 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:00:06.735449 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:00:06.735981 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:00:06.736621 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:00:06.737211 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:00:06.737970 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:00:06.738592 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:00:06.739379 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:00:06.739859 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:00:06.740603 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:00:06.741404 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:00:06.742116 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:00:06.756088 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:00:06.757054 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:00:06.757623 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:00:06.758191 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:00:06.758786 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:00:06.759503 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:00:06.760109 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:00:06.760742 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:00:06.761328 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:00:06.764623 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:00:06.765771 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:00:06.767013 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:00:06.767833 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:00:06.768494 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:00:06.768999 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:00:06.769968 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:00:06.770632 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:00:06.771326 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:00:06.771912 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:00:06.772536 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:00:06.773120 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:00:06.773950 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:00:06.774543 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:00:06.775228 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:00:06.776115 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:00:06.776852 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:00:06.779270 [ 13279 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:00:06.906791 [ 13279 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:00:06.908814 [ 13279 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:00:06.984783 [ 13279 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:00:06.984898 [ 13279 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:00:06.984941 [ 13279 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:00:07.005260 [ 13279 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:00:07.005341 [ 13279 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:00:07.005415 [ 13279 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:00:07.005539 [ 13279 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:07.011614 [ 13279 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:07.098428 [ 13279 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:07.110514 [ 13279 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:00:07.110719 [ 13279 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:07.113015 [ 13279 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:00:07.113932 [ 13279 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:00:07.115064 [ 13279 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:00:07.115155 [ 13279 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:00:07.116695 [ 13279 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:00:07.116733 [ 13279 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:00:07.116756 [ 13279 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:00:07.116801 [ 13279 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:00:07.116835 [ 13279 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:00:07.117003 [ 13279 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:07.117064 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.380064 [ 13279 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:07.393846 [ 13279 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:07.393944 [ 13279 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:07.395357 [ 13279 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/ycq/eqfkisajxgsexlmqxwbfxtpnzafxl 2025.04.02 04:00:07.395990 [ 13279 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/ycq/eqfkisajxgsexlmqxwbfxtpnzafxl. 2025.04.02 04:00:07.404168 [ 13866 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/ycq/eqfkisajxgsexlmqxwbfxtpnzafxl, size 4 2025.04.02 04:00:07.404890 [ 13279 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/ycq/eqfkisajxgsexlmqxwbfxtpnzafxl. 2025.04.02 04:00:07.414684 [ 13279 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/ycq/eqfkisajxgsexlmqxwbfxtpnzafxl 2025.04.02 04:00:07.414768 [ 13279 ] {} deleteFileFromS3: Object with path s3/ycq/eqfkisajxgsexlmqxwbfxtpnzafxl was removed from S3 2025.04.02 04:00:07.414839 [ 13279 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:00:07.414931 [ 13279 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:00:07.418514 [ 13279 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:07.430601 [ 13279 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:07.430686 [ 13279 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:07.456506 [ 13279 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:00:07.456864 [ 13279 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:00:07 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DDC854228C8 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:00:07.457120 [ 13279 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:00:07.463788 [ 13279 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:00:07.463909 [ 13279 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:00:07.464014 [ 13279 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:00:07.464100 [ 13279 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:00:07.464283 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.464431 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.464544 [ 13279 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:07.464670 [ 13279 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:07.464793 [ 13279 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:00:07.464904 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.465011 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.465123 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.465219 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.465326 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.470707 [ 13279 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:07.488645 [ 13279 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:07.488779 [ 13279 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:07.509444 [ 13279 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ofh/wynxgnyfenhtutqihohtdrekcpvfp 2025.04.02 04:00:07.509547 [ 13279 ] {} deleteFileFromS3: Object with path special/ofh/wynxgnyfenhtutqihohtdrekcpvfp was removed from S3 2025.04.02 04:00:07.509616 [ 13279 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:00:07.509676 [ 13279 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:00:07.520093 [ 13279 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:07.536180 [ 13279 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:07.536315 [ 13279 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:07.554808 [ 13279 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ctv/rneaoccmggrdrptyuawrapipizxau 2025.04.02 04:00:07.554910 [ 13279 ] {} deleteFileFromS3: Object with path test_02944/ctv/rneaoccmggrdrptyuawrapipizxau was removed from S3 2025.04.02 04:00:07.554992 [ 13279 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:00:07.555059 [ 13279 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:00:07.555276 [ 13279 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:07.560114 [ 13279 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:07.564766 [ 13279 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:00:07.564903 [ 13279 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:00:07.567115 [ 13279 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:00:07.567310 [ 13279 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:00:07.568562 [ 13279 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:00:07.568634 [ 13279 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:00:07.568688 [ 13279 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:00:07.568734 [ 13279 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:00:07.568784 [ 13279 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:00:07.569387 [ 13279 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 17 entries 2025.04.02 04:00:07.569471 [ 13279 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:00:07.569612 [ 13279 ] {} KeeperServer: Last local log idx 17 2025.04.02 04:00:07.569681 [ 13279 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 17 2025.04.02 04:00:07.571392 [ 13279 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:00:07.585857 [ 13279 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:00:07.586375 [ 13279 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:00:07.586563 [ 13279 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:00:07.586649 [ 13279 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:00:07.586746 [ 13279 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:00:07.586805 [ 13279 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:00:07.586923 [ 13279 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 17 election timer allowed log store start 1, end 17 config log idx 17, prev log idx 16 -- ASYNC REPLICATION -- 2025.04.02 04:00:07.586991 [ 13279 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:00:07.587086 [ 13279 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:00:07.587163 [ 13279 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:00:07.588008 [ 13279 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:00:07.588148 [ 13896 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:00:07.638764 [ 13879 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:00:07.638989 [ 13879 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:00:07.639127 [ 13879 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 17, state term 17, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:00:07.639206 [ 13879 ] {} RaftInstance: pre-vote term (0) is different, reset it to 17 2025.04.02 04:00:07.639280 [ 13279 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:00:07.639769 [ 13879 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:00:07.643362 [ 13879 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 18, log idx 17, log term 17, priority (target 1 / mine 1) 2025.04.02 04:00:07.643503 [ 13879 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:00:07.643581 [ 13879 ] {} RaftInstance: state machine commit index 0, precommit index 17, last log index 17 2025.04.02 04:00:07.643657 [ 13879 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:00:07.644090 [ 13879 ] {} RaftInstance: [BECOME LEADER] appended new config at 18 2025.04.02 04:00:07.644468 [ 13895 ] {} RaftInstance: config at index 1 is committed, prev config log idx 17 2025.04.02 04:00:07.644612 [ 13895 ] {} RaftInstance: skipped config 1, latest config 17 2025.04.02 04:00:07.644819 [ 13895 ] {} RaftInstance: config at index 2 is committed, prev config log idx 17 2025.04.02 04:00:07.644909 [ 13895 ] {} RaftInstance: skipped config 2, latest config 17 2025.04.02 04:00:07.645041 [ 13895 ] {} RaftInstance: config at index 3 is committed, prev config log idx 17 2025.04.02 04:00:07.645137 [ 13895 ] {} RaftInstance: skipped config 3, latest config 17 2025.04.02 04:00:07.645264 [ 13895 ] {} RaftInstance: config at index 4 is committed, prev config log idx 17 2025.04.02 04:00:07.645326 [ 13895 ] {} RaftInstance: skipped config 4, latest config 17 2025.04.02 04:00:07.645493 [ 13895 ] {} RaftInstance: config at index 5 is committed, prev config log idx 17 2025.04.02 04:00:07.645609 [ 13895 ] {} RaftInstance: skipped config 5, latest config 17 2025.04.02 04:00:07.645785 [ 13895 ] {} RaftInstance: config at index 6 is committed, prev config log idx 17 2025.04.02 04:00:07.645875 [ 13895 ] {} RaftInstance: skipped config 6, latest config 17 2025.04.02 04:00:07.646012 [ 13895 ] {} RaftInstance: config at index 7 is committed, prev config log idx 17 2025.04.02 04:00:07.646073 [ 13895 ] {} RaftInstance: skipped config 7, latest config 17 2025.04.02 04:00:07.646197 [ 13895 ] {} RaftInstance: config at index 8 is committed, prev config log idx 17 2025.04.02 04:00:07.646273 [ 13895 ] {} RaftInstance: skipped config 8, latest config 17 2025.04.02 04:00:07.646482 [ 13895 ] {} RaftInstance: config at index 9 is committed, prev config log idx 17 2025.04.02 04:00:07.646543 [ 13895 ] {} RaftInstance: skipped config 9, latest config 17 2025.04.02 04:00:07.646667 [ 13895 ] {} RaftInstance: config at index 10 is committed, prev config log idx 17 2025.04.02 04:00:07.646721 [ 13895 ] {} RaftInstance: skipped config 10, latest config 17 2025.04.02 04:00:07.646813 [ 13895 ] {} RaftInstance: config at index 11 is committed, prev config log idx 17 2025.04.02 04:00:07.646867 [ 13895 ] {} RaftInstance: skipped config 11, latest config 17 2025.04.02 04:00:07.646972 [ 13895 ] {} RaftInstance: config at index 12 is committed, prev config log idx 17 2025.04.02 04:00:07.647027 [ 13895 ] {} RaftInstance: skipped config 12, latest config 17 2025.04.02 04:00:07.647130 [ 13895 ] {} RaftInstance: config at index 13 is committed, prev config log idx 17 2025.04.02 04:00:07.647220 [ 13895 ] {} RaftInstance: skipped config 13, latest config 17 2025.04.02 04:00:07.647329 [ 13895 ] {} RaftInstance: config at index 14 is committed, prev config log idx 17 2025.04.02 04:00:07.647396 [ 13895 ] {} RaftInstance: skipped config 14, latest config 17 2025.04.02 04:00:07.647504 [ 13895 ] {} RaftInstance: config at index 15 is committed, prev config log idx 17 2025.04.02 04:00:07.647552 [ 13895 ] {} RaftInstance: skipped config 15, latest config 17 2025.04.02 04:00:07.647662 [ 13895 ] {} RaftInstance: config at index 16 is committed, prev config log idx 17 2025.04.02 04:00:07.647723 [ 13895 ] {} RaftInstance: skipped config 16, latest config 17 2025.04.02 04:00:07.647823 [ 13895 ] {} RaftInstance: config at index 17 is committed, prev config log idx 17 2025.04.02 04:00:07.647882 [ 13895 ] {} RaftInstance: skipped config 17, latest config 17 2025.04.02 04:00:07.648018 [ 13895 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:00:07.648093 [ 13895 ] {} KeeperServer: Preprocessing done 2025.04.02 04:00:07.648176 [ 13895 ] {} RaftInstance: config at index 18 is committed, prev config log idx 17 2025.04.02 04:00:07.648265 [ 13895 ] {} RaftInstance: new config log idx 18, prev log idx 17, cur config log idx 17, prev log idx 16 2025.04.02 04:00:07.648413 [ 13895 ] {} RaftInstance: new configuration: log idx 18, prev log idx 17 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 18 2025.04.02 04:00:07.648669 [ 13279 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:00:07.649760 [ 13279 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:00:07.651955 [ 13279 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:00:07.652429 [ 13279 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:00:07.752595 [ 13279 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:00:07.752721 [ 13279 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:00:07.754166 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:00:07.754726 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:00:07.755434 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:00:07.755796 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:00:07.756128 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:00:07.756462 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:00:07.756793 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:00:07.757251 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:00:07.763286 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:00:07.763992 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:00:07.764569 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:00:07.765128 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:00:07.765704 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:00:07.766233 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:00:07.766836 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:00:07.767472 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:00:07.768056 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:00:07.768759 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:00:07.769315 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:00:07.769939 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:00:07.770557 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:00:07.771281 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:00:07.772548 [ 13279 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:00:07.785530 [ 13279 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:00:07.785957 [ 13279 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:00:07.797996 [ 13279 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:00:07.798204 [ 13279 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:07.803791 [ 13279 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:00:07.806004 [ 13279 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:00:07.893209 [ 13279 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:00:07.893891 [ 13902 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:00:08.000615 [ 13279 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:00:08.004266 [ 13279 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:00:08.011451 [ 13279 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:00:08.015326 [ 13279 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:00:08.025015 [ 13279 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:00:08.027191 [ 13279 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:00:08.029029 [ 13279 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:00:08.029147 [ 13279 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:00:08.029319 [ 13295 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:00:08.030142 [ 13295 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:12.896390 [ 13279 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:12.896841 [ 13279 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:12.897219 [ 13279 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:12.897299 [ 13279 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:12.897483 [ 13806 ] {} CancellationChecker: Execution took 6410 ms. 2025.04.02 04:00:12.897757 [ 13279 ] {} Application: Shutting down storages. 2025.04.02 04:00:12.897804 [ 13279 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:12.899394 [ 13279 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:12.899449 [ 13279 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:12.899478 [ 13279 ] {} Context: Shutting down named sessions 2025.04.02 04:00:12.899533 [ 13279 ] {} Context: Shutting down database catalog 2025.04.02 04:00:12.899567 [ 13279 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:12.899639 [ 13279 ] {} Context: Shutting down merges executor 2025.04.02 04:00:12.900253 [ 13279 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:12.900768 [ 13279 ] {} Context: Shutting down moves executor 2025.04.02 04:00:12.901006 [ 13279 ] {} Context: Shutting down common executor 2025.04.02 04:00:12.901322 [ 13279 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:12.901364 [ 13279 ] {} Context: Shutting down caches 2025.04.02 04:00:12.901433 [ 13279 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:12.901703 [ 13279 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:12.990172 [ 13279 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:12.991528 [ 13279 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:12.992068 [ 13279 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:12.992600 [ 13279 ] {} Application: Shut down storages. 2025.04.02 04:00:12.992646 [ 13279 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:13.159723 [ 13279 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:13.159817 [ 13279 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:13.159882 [ 13279 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:13.652254 [ 13279 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:13.652400 [ 13279 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:13.652482 [ 13279 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:13.652535 [ 13279 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:13.652587 [ 13279 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:13.652632 [ 13279 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:13.652686 [ 13279 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:13.652830 [ 13279 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:13.652855 [ 13896 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:13.653038 [ 13279 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:13.653095 [ 13279 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:13.653134 [ 13279 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:13.653358 [ 13882 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:00:13.653617 [ 13879 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:00:13.653628 [ 13880 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:13.653804 [ 13887 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:13.653822 [ 13885 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:13.654145 [ 13890 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:13.654143 [ 13888 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:13.654144 [ 13892 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:13.654537 [ 13882 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:13.654537 [ 13881 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:13.654538 [ 13883 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:00:13.654583 [ 13886 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:13.654582 [ 13884 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:13.654200 [ 13889 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:00:13.654483 [ 13894 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:13.654206 [ 13891 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:13.654184 [ 13893 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:00:13.655247 [ 13279 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:13.655395 [ 13878 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:00:13.655955 [ 13279 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:13.656104 [ 13279 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:13.656149 [ 13279 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:13.656218 [ 13279 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:13.656263 [ 13279 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:13.656471 [ 13279 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:13.656534 [ 13279 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:13.659486 [ 13279 ] {} Application: Destroyed global context. 2025.04.02 04:00:13.660008 [ 13279 ] {} Application: Waiting for background threads 2025.04.02 04:00:13.725927 [ 13279 ] {} Application: Background threads finished in 65 ms 2025.04.02 04:00:13.726459 [ 13279 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:13.726517 [ 13279 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:13.741694 [ 13279 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:13.742125 [ 13279 ] {} Application: shutting down 2025.04.02 04:00:13.742184 [ 13279 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:00:13.750573 [ 13282 ] {} BaseDaemon: Received signal -2 2025.04.02 04:00:13.750697 [ 13282 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:00:13.961116 [ 13277 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:00:14.366423 [ 14014 ] {} Application: Will watch for the process with pid 14016 2025.04.02 04:00:14.367907 [ 14016 ] {} Application: Forked a child process to watch 2025.04.02 04:00:14.369708 [ 14016 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:00:14.885933 [ 14016 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 14016 2025.04.02 04:00:14.886860 [ 14016 ] {} Application: starting up 2025.04.02 04:00:14.886949 [ 14016 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:00:14.918342 [ 14016 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:00:14.918520 [ 14016 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:00:14.918726 [ 14016 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:00:14.918794 [ 14016 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:00:14.918829 [ 14016 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:00:14.918868 [ 14016 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:00:14.920662 [ 14016 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:00:14.921104 [ 14016 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:00:14.921153 [ 14016 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:00:14.921314 [ 14016 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:00:14.921366 [ 14016 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:00:15.752041 [ 14016 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:00:15.754209 [ 14016 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:00:15.754285 [ 14016 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:00:15.813218 [ 14016 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:00:15.814054 [ 14016 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:00:16.055538 [ 14026 ] {} CancellationChecker: Started worker function 2025.04.02 04:00:16.055838 [ 14016 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:00:16.055900 [ 14016 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:00:16.055952 [ 14016 ] {} Application: Initializing DateLUT. 2025.04.02 04:00:16.056008 [ 14016 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:00:16.056286 [ 14016 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:00:16.056737 [ 14016 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:00:16.072134 [ 14016 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:00:16.072296 [ 14016 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:00:16.072687 [ 14016 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:00:16.073197 [ 14016 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:00:16.073292 [ 14016 ] {} Application: Initializing interserver credentials. 2025.04.02 04:00:16.074429 [ 14016 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:00:16.079933 [ 14016 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:00:16.080386 [ 14016 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:00:16.155315 [ 14016 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:00:16.155432 [ 14016 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:00:16.164711 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:00:16.165897 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:00:16.166336 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:00:16.166906 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:00:16.167405 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:00:16.172671 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:00:16.173229 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:00:16.173724 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:00:16.174122 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:00:16.174584 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:00:16.175128 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:00:16.175549 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:00:16.175981 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:00:16.176357 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:00:16.176984 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:00:16.177411 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:00:16.177870 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:00:16.178266 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:00:16.178729 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:00:16.179101 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:00:16.179494 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:00:16.179854 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:00:16.180579 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:00:16.181600 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:00:16.181935 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:00:16.182955 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:00:16.184166 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:00:16.184604 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:00:16.184933 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:00:16.185333 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:00:16.185721 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:00:16.186116 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:00:16.186609 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:00:16.186967 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:00:16.187434 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:00:16.187868 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:00:16.188349 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:00:16.188852 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:00:16.189270 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:00:16.190463 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:00:16.191067 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:00:16.191488 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:00:16.191910 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:00:16.192318 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:00:16.192887 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:00:16.193309 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:00:16.193767 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:00:16.194228 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:00:16.196697 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:00:16.197492 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:00:16.198444 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:00:16.199039 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:00:16.199458 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:00:16.199845 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:00:16.200537 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:00:16.200984 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:00:16.201558 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:00:16.201959 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:00:16.202428 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:00:16.202841 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:00:16.203493 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:00:16.203902 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:00:16.204437 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:00:16.205078 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:00:16.205572 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:00:16.207432 [ 14016 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:00:16.252443 [ 14016 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:00:16.254135 [ 14016 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:00:16.289279 [ 14016 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:00:16.289380 [ 14016 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:00:16.289433 [ 14016 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:00:16.304009 [ 14016 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:00:16.304081 [ 14016 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:00:16.304133 [ 14016 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:00:16.304253 [ 14016 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:16.309458 [ 14016 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:16.344677 [ 14016 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:16.355726 [ 14016 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:00:16.355883 [ 14016 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:16.358023 [ 14016 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:00:16.358882 [ 14016 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:00:16.359865 [ 14016 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:00:16.359928 [ 14016 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:00:16.361322 [ 14016 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:00:16.361357 [ 14016 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:00:16.361381 [ 14016 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:00:16.361441 [ 14016 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:00:16.361466 [ 14016 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:00:16.361631 [ 14016 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:16.361689 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.558950 [ 14016 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:16.631472 [ 14016 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:16.631578 [ 14016 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:16.632770 [ 14016 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/rfo/euiyrelbiauajitqcwuqikesoqznm 2025.04.02 04:00:16.633335 [ 14016 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/rfo/euiyrelbiauajitqcwuqikesoqznm. 2025.04.02 04:00:16.640530 [ 14598 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/rfo/euiyrelbiauajitqcwuqikesoqznm, size 4 2025.04.02 04:00:16.641307 [ 14016 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/rfo/euiyrelbiauajitqcwuqikesoqznm. 2025.04.02 04:00:16.650660 [ 14016 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/rfo/euiyrelbiauajitqcwuqikesoqznm 2025.04.02 04:00:16.650740 [ 14016 ] {} deleteFileFromS3: Object with path s3/rfo/euiyrelbiauajitqcwuqikesoqznm was removed from S3 2025.04.02 04:00:16.650804 [ 14016 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:00:16.650869 [ 14016 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:00:16.654585 [ 14016 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:16.706701 [ 14016 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:16.706792 [ 14016 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:16.728605 [ 14016 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:00:16.728955 [ 14016 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:00:16 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DDEADEE2294 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:00:16.729214 [ 14016 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:00:16.735995 [ 14016 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:00:16.736087 [ 14016 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:00:16.736179 [ 14016 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:00:16.736255 [ 14016 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:00:16.736448 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.736592 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.736709 [ 14016 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:16.736819 [ 14016 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:16.736928 [ 14016 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:00:16.737027 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.737203 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.737318 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.737427 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.737538 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.831262 [ 14016 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:16.881907 [ 14016 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:16.882032 [ 14016 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:16.939612 [ 14016 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ttx/geyomfiiqpxigsfdmlolkzvwbyxvc 2025.04.02 04:00:16.939727 [ 14016 ] {} deleteFileFromS3: Object with path special/ttx/geyomfiiqpxigsfdmlolkzvwbyxvc was removed from S3 2025.04.02 04:00:16.939843 [ 14016 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:00:16.939913 [ 14016 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:00:16.945364 [ 14016 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:16.963604 [ 14016 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:16.963755 [ 14016 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:16.983022 [ 14016 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/rwf/awiauqhznoxgvivfwzjiuoberoqlo 2025.04.02 04:00:16.983129 [ 14016 ] {} deleteFileFromS3: Object with path test_02944/rwf/awiauqhznoxgvivfwzjiuoberoqlo was removed from S3 2025.04.02 04:00:16.983221 [ 14016 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:00:16.983296 [ 14016 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:00:16.983538 [ 14016 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:16.988279 [ 14016 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:16.993629 [ 14016 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:00:16.993774 [ 14016 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:00:16.996224 [ 14016 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:00:16.996537 [ 14016 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:00:16.997583 [ 14016 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:00:16.997673 [ 14016 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:00:16.997749 [ 14016 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:00:16.997817 [ 14016 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:00:16.997889 [ 14016 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:00:16.998736 [ 14016 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 18 entries 2025.04.02 04:00:16.998849 [ 14016 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:00:16.999013 [ 14016 ] {} KeeperServer: Last local log idx 18 2025.04.02 04:00:16.999099 [ 14016 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 18 2025.04.02 04:00:17.001132 [ 14016 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:00:17.014486 [ 14016 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:00:17.014860 [ 14016 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:00:17.014954 [ 14016 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:00:17.015009 [ 14016 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:00:17.015077 [ 14016 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:00:17.015118 [ 14016 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:00:17.015201 [ 14016 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 18 election timer allowed log store start 1, end 18 config log idx 18, prev log idx 17 -- ASYNC REPLICATION -- 2025.04.02 04:00:17.015243 [ 14016 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:00:17.015310 [ 14016 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:00:17.015379 [ 14016 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:00:17.015929 [ 14016 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:00:17.016015 [ 14629 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:00:17.066500 [ 14612 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:00:17.066706 [ 14612 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:00:17.066798 [ 14612 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 18, state term 18, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:00:17.066868 [ 14612 ] {} RaftInstance: pre-vote term (0) is different, reset it to 18 2025.04.02 04:00:17.066998 [ 14016 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:00:17.067292 [ 14612 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:00:17.071083 [ 14612 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 19, log idx 18, log term 18, priority (target 1 / mine 1) 2025.04.02 04:00:17.071170 [ 14612 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:00:17.071223 [ 14612 ] {} RaftInstance: state machine commit index 0, precommit index 18, last log index 18 2025.04.02 04:00:17.071273 [ 14612 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:00:17.071629 [ 14612 ] {} RaftInstance: [BECOME LEADER] appended new config at 19 2025.04.02 04:00:17.071981 [ 14628 ] {} RaftInstance: config at index 1 is committed, prev config log idx 18 2025.04.02 04:00:17.072100 [ 14628 ] {} RaftInstance: skipped config 1, latest config 18 2025.04.02 04:00:17.072271 [ 14628 ] {} RaftInstance: config at index 2 is committed, prev config log idx 18 2025.04.02 04:00:17.072335 [ 14628 ] {} RaftInstance: skipped config 2, latest config 18 2025.04.02 04:00:17.072464 [ 14628 ] {} RaftInstance: config at index 3 is committed, prev config log idx 18 2025.04.02 04:00:17.072533 [ 14628 ] {} RaftInstance: skipped config 3, latest config 18 2025.04.02 04:00:17.072638 [ 14628 ] {} RaftInstance: config at index 4 is committed, prev config log idx 18 2025.04.02 04:00:17.072690 [ 14628 ] {} RaftInstance: skipped config 4, latest config 18 2025.04.02 04:00:17.072780 [ 14628 ] {} RaftInstance: config at index 5 is committed, prev config log idx 18 2025.04.02 04:00:17.072827 [ 14628 ] {} RaftInstance: skipped config 5, latest config 18 2025.04.02 04:00:17.072930 [ 14628 ] {} RaftInstance: config at index 6 is committed, prev config log idx 18 2025.04.02 04:00:17.072980 [ 14628 ] {} RaftInstance: skipped config 6, latest config 18 2025.04.02 04:00:17.073086 [ 14628 ] {} RaftInstance: config at index 7 is committed, prev config log idx 18 2025.04.02 04:00:17.073139 [ 14628 ] {} RaftInstance: skipped config 7, latest config 18 2025.04.02 04:00:17.073226 [ 14628 ] {} RaftInstance: config at index 8 is committed, prev config log idx 18 2025.04.02 04:00:17.073295 [ 14628 ] {} RaftInstance: skipped config 8, latest config 18 2025.04.02 04:00:17.073418 [ 14628 ] {} RaftInstance: config at index 9 is committed, prev config log idx 18 2025.04.02 04:00:17.073470 [ 14628 ] {} RaftInstance: skipped config 9, latest config 18 2025.04.02 04:00:17.073564 [ 14628 ] {} RaftInstance: config at index 10 is committed, prev config log idx 18 2025.04.02 04:00:17.073630 [ 14628 ] {} RaftInstance: skipped config 10, latest config 18 2025.04.02 04:00:17.073732 [ 14628 ] {} RaftInstance: config at index 11 is committed, prev config log idx 18 2025.04.02 04:00:17.073784 [ 14628 ] {} RaftInstance: skipped config 11, latest config 18 2025.04.02 04:00:17.073877 [ 14628 ] {} RaftInstance: config at index 12 is committed, prev config log idx 18 2025.04.02 04:00:17.073928 [ 14628 ] {} RaftInstance: skipped config 12, latest config 18 2025.04.02 04:00:17.074027 [ 14628 ] {} RaftInstance: config at index 13 is committed, prev config log idx 18 2025.04.02 04:00:17.074094 [ 14628 ] {} RaftInstance: skipped config 13, latest config 18 2025.04.02 04:00:17.074188 [ 14628 ] {} RaftInstance: config at index 14 is committed, prev config log idx 18 2025.04.02 04:00:17.074239 [ 14628 ] {} RaftInstance: skipped config 14, latest config 18 2025.04.02 04:00:17.074341 [ 14628 ] {} RaftInstance: config at index 15 is committed, prev config log idx 18 2025.04.02 04:00:17.101931 [ 14628 ] {} RaftInstance: skipped config 15, latest config 18 2025.04.02 04:00:17.102227 [ 14628 ] {} RaftInstance: config at index 16 is committed, prev config log idx 18 2025.04.02 04:00:17.102311 [ 14628 ] {} RaftInstance: skipped config 16, latest config 18 2025.04.02 04:00:17.102511 [ 14628 ] {} RaftInstance: config at index 17 is committed, prev config log idx 18 2025.04.02 04:00:17.102579 [ 14628 ] {} RaftInstance: skipped config 17, latest config 18 2025.04.02 04:00:17.102701 [ 14628 ] {} RaftInstance: config at index 18 is committed, prev config log idx 18 2025.04.02 04:00:17.102778 [ 14628 ] {} RaftInstance: skipped config 18, latest config 18 2025.04.02 04:00:17.102915 [ 14628 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:00:17.102997 [ 14628 ] {} KeeperServer: Preprocessing done 2025.04.02 04:00:17.103090 [ 14628 ] {} RaftInstance: config at index 19 is committed, prev config log idx 18 2025.04.02 04:00:17.103192 [ 14628 ] {} RaftInstance: new config log idx 19, prev log idx 18, cur config log idx 18, prev log idx 17 2025.04.02 04:00:17.103348 [ 14628 ] {} RaftInstance: new configuration: log idx 19, prev log idx 18 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 19 2025.04.02 04:00:17.103573 [ 14016 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:00:17.104365 [ 14016 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:00:17.105949 [ 14016 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:00:17.106359 [ 14016 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:00:17.118256 [ 14016 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:00:17.118364 [ 14016 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:00:17.119597 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:00:17.119977 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:00:17.120546 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:00:17.120819 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:00:17.121059 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:00:17.121305 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:00:17.121551 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:00:17.121892 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:00:17.125512 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:00:17.125835 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:00:17.126117 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:00:17.126483 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:00:17.126811 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:00:17.127194 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:00:17.127530 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:00:17.127889 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:00:17.128244 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:00:17.128689 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:00:17.129004 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:00:17.129337 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:00:17.129664 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:00:17.130089 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:00:17.130856 [ 14016 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:00:17.137949 [ 14016 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:00:17.138173 [ 14016 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:00:17.144777 [ 14016 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:00:17.144890 [ 14016 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:17.147938 [ 14016 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:00:17.149114 [ 14016 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:00:17.149657 [ 14016 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:00:17.149988 [ 14634 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:00:17.157132 [ 14016 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:00:17.159565 [ 14016 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:00:17.164856 [ 14016 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:00:17.167887 [ 14016 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:00:17.175198 [ 14016 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:00:17.176559 [ 14016 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:00:17.177612 [ 14016 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:00:17.177691 [ 14016 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:00:17.177818 [ 14027 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:00:17.178763 [ 14027 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:21.773233 [ 14016 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:21.773681 [ 14016 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:21.774031 [ 14016 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:21.774088 [ 14016 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:21.774251 [ 14026 ] {} CancellationChecker: Execution took 5718 ms. 2025.04.02 04:00:21.775104 [ 14016 ] {} Application: Shutting down storages. 2025.04.02 04:00:21.775178 [ 14016 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:21.776835 [ 14016 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:21.776888 [ 14016 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:21.776922 [ 14016 ] {} Context: Shutting down named sessions 2025.04.02 04:00:21.777007 [ 14016 ] {} Context: Shutting down database catalog 2025.04.02 04:00:21.777063 [ 14016 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:21.777128 [ 14016 ] {} Context: Shutting down merges executor 2025.04.02 04:00:21.777709 [ 14016 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:21.778245 [ 14016 ] {} Context: Shutting down moves executor 2025.04.02 04:00:21.778660 [ 14016 ] {} Context: Shutting down common executor 2025.04.02 04:00:21.779115 [ 14016 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:21.779173 [ 14016 ] {} Context: Shutting down caches 2025.04.02 04:00:21.779236 [ 14016 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:21.779616 [ 14016 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:21.782512 [ 14016 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:21.854766 [ 14016 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:21.855232 [ 14016 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:21.856002 [ 14016 ] {} Application: Shut down storages. 2025.04.02 04:00:21.856086 [ 14016 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:21.862766 [ 14016 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:21.862925 [ 14016 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:21.863015 [ 14016 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:22.106118 [ 14016 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:22.106246 [ 14016 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:22.106923 [ 14016 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:22.106977 [ 14016 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:22.107021 [ 14016 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:22.107062 [ 14016 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:22.107103 [ 14016 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:22.107201 [ 14016 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:22.107217 [ 14629 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:22.107347 [ 14016 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:22.107399 [ 14016 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:22.107456 [ 14016 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:22.107644 [ 14615 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:00:22.107806 [ 14612 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:00:22.107929 [ 14614 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:22.108035 [ 14618 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:22.108149 [ 14621 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:22.108292 [ 14627 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:22.108391 [ 14626 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:22.108444 [ 14615 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:22.108282 [ 14616 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:22.108590 [ 14613 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:22.108422 [ 14622 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:22.108601 [ 14620 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:22.108428 [ 14623 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:00:22.108665 [ 14617 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:00:22.108480 [ 14624 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:00:22.108488 [ 14625 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:22.108432 [ 14619 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:22.109320 [ 14016 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:22.109401 [ 14611 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:00:22.109970 [ 14016 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:22.110136 [ 14016 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:22.110181 [ 14016 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:22.110240 [ 14016 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:22.110284 [ 14016 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:22.110539 [ 14016 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:22.110591 [ 14016 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:22.113569 [ 14016 ] {} Application: Destroyed global context. 2025.04.02 04:00:22.114040 [ 14016 ] {} Application: Waiting for background threads 2025.04.02 04:00:22.177280 [ 14016 ] {} Application: Background threads finished in 63 ms 2025.04.02 04:00:22.177858 [ 14016 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:22.177920 [ 14016 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:22.240278 [ 14016 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:22.240570 [ 14016 ] {} Application: shutting down 2025.04.02 04:00:22.240610 [ 14016 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:00:22.247651 [ 14019 ] {} BaseDaemon: Received signal -2 2025.04.02 04:00:22.247807 [ 14019 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:00:22.414883 [ 14014 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:00:23.318795 [ 14746 ] {} Application: Will watch for the process with pid 14748 2025.04.02 04:00:23.320335 [ 14748 ] {} Application: Forked a child process to watch 2025.04.02 04:00:23.322284 [ 14748 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:00:23.959728 [ 14748 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 14748 2025.04.02 04:00:23.960977 [ 14748 ] {} Application: starting up 2025.04.02 04:00:23.961110 [ 14748 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:00:24.004654 [ 14748 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:00:24.004849 [ 14748 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:00:24.005061 [ 14748 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:00:24.005127 [ 14748 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:00:24.005174 [ 14748 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:00:24.005207 [ 14748 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:00:24.006675 [ 14748 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:00:24.007147 [ 14748 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:00:24.007221 [ 14748 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:00:24.007406 [ 14748 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:00:24.007476 [ 14748 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:00:24.891128 [ 14748 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:00:24.893383 [ 14748 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:00:24.893480 [ 14748 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:00:24.893665 [ 14748 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:00:24.894472 [ 14748 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:00:25.120793 [ 14761 ] {} CancellationChecker: Started worker function 2025.04.02 04:00:25.121196 [ 14748 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:00:25.121303 [ 14748 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:00:25.121385 [ 14748 ] {} Application: Initializing DateLUT. 2025.04.02 04:00:25.121476 [ 14748 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:00:25.121837 [ 14748 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:00:25.122469 [ 14748 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:00:25.243272 [ 14748 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:00:25.243496 [ 14748 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:00:25.244064 [ 14748 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:00:25.244849 [ 14748 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:00:25.244998 [ 14748 ] {} Application: Initializing interserver credentials. 2025.04.02 04:00:25.246599 [ 14748 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:00:25.255936 [ 14748 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:00:25.256659 [ 14748 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:00:25.274961 [ 14748 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:00:25.275091 [ 14748 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:00:25.284679 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:00:25.285681 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:00:25.286078 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:00:25.286579 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:00:25.286995 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:00:25.291330 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:00:25.291728 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:00:25.292106 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:00:25.292442 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:00:25.292769 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:00:25.293203 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:00:25.293536 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:00:25.293876 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:00:25.294181 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:00:25.352609 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:00:25.353293 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:00:25.353850 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:00:25.354352 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:00:25.354850 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:00:25.355246 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:00:25.355660 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:00:25.356027 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:00:25.356770 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:00:25.357819 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:00:25.358186 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:00:25.359197 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:00:25.360347 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:00:25.360777 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:00:25.361122 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:00:25.361512 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:00:25.361902 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:00:25.362294 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:00:25.362796 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:00:25.363157 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:00:25.363614 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:00:25.363972 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:00:25.364453 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:00:25.364942 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:00:25.365352 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:00:25.366494 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:00:25.367087 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:00:25.367508 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:00:25.367928 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:00:25.368334 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:00:25.368863 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:00:25.369273 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:00:25.369722 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:00:25.370176 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:00:25.372636 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:00:25.373433 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:00:25.374342 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:00:25.416821 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:00:25.417595 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:00:25.418123 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:00:25.419079 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:00:25.419677 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:00:25.420374 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:00:25.420872 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:00:25.421402 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:00:25.421917 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:00:25.422747 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:00:25.423395 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:00:25.424067 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:00:25.424895 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:00:25.425541 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:00:25.427779 [ 14748 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:00:25.640099 [ 14748 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:00:25.641800 [ 14748 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:00:25.825453 [ 14748 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:00:25.825556 [ 14748 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:00:25.825601 [ 14748 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:00:25.859001 [ 14748 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:00:25.859082 [ 14748 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:00:25.859143 [ 14748 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:00:25.859292 [ 14748 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:25.866338 [ 14748 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:25.872805 [ 14748 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:25.887094 [ 14748 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:00:25.887270 [ 14748 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:25.889472 [ 14748 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:00:25.890286 [ 14748 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:00:25.891329 [ 14748 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:00:25.891396 [ 14748 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:00:25.892808 [ 14748 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:00:25.892854 [ 14748 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:00:25.892878 [ 14748 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:00:25.892921 [ 14748 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:00:25.892943 [ 14748 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:00:25.893117 [ 14748 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:25.893176 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:25.961045 [ 14748 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:25.970665 [ 14748 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:25.970750 [ 14748 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:25.971759 [ 14748 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/fsm/ifzuhbxsfqrjubxttvqdaachfuyob 2025.04.02 04:00:25.972216 [ 14748 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/fsm/ifzuhbxsfqrjubxttvqdaachfuyob. 2025.04.02 04:00:25.977870 [ 15334 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/fsm/ifzuhbxsfqrjubxttvqdaachfuyob, size 4 2025.04.02 04:00:25.978546 [ 14748 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/fsm/ifzuhbxsfqrjubxttvqdaachfuyob. 2025.04.02 04:00:25.988308 [ 14748 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/fsm/ifzuhbxsfqrjubxttvqdaachfuyob 2025.04.02 04:00:25.988369 [ 14748 ] {} deleteFileFromS3: Object with path s3/fsm/ifzuhbxsfqrjubxttvqdaachfuyob was removed from S3 2025.04.02 04:00:25.988452 [ 14748 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:00:25.988513 [ 14748 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:00:25.992095 [ 14748 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:26.003939 [ 14748 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:26.003999 [ 14748 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:26.025498 [ 14748 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:00:26.025721 [ 14748 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:00:26 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DE0D8100F84 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:00:26.025898 [ 14748 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:00:26.030944 [ 14748 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:00:26.031001 [ 14748 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:00:26.031056 [ 14748 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:00:26.031104 [ 14748 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:00:26.031228 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.031308 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.031378 [ 14748 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:26.031463 [ 14748 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:26.031537 [ 14748 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:00:26.031600 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.031660 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.031726 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.031788 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.031856 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.035398 [ 14748 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:26.045554 [ 14748 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:26.045613 [ 14748 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:26.060531 [ 14748 ] {} deleteFileFromS3: No blob storage log, not writing blob special/yad/qynjizqqnarmeuwdwwlefrpqdeivd 2025.04.02 04:00:26.060596 [ 14748 ] {} deleteFileFromS3: Object with path special/yad/qynjizqqnarmeuwdwwlefrpqdeivd was removed from S3 2025.04.02 04:00:26.060643 [ 14748 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:00:26.060678 [ 14748 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:00:26.151840 [ 14748 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:26.164268 [ 14748 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:26.164354 [ 14748 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:26.180019 [ 14748 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/rmg/bshuphsltsozypdtmbtewanljyygk 2025.04.02 04:00:26.180094 [ 14748 ] {} deleteFileFromS3: Object with path test_02944/rmg/bshuphsltsozypdtmbtewanljyygk was removed from S3 2025.04.02 04:00:26.180147 [ 14748 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:00:26.180199 [ 14748 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:00:26.180349 [ 14748 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:26.183877 [ 14748 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:26.188194 [ 14748 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:00:26.188304 [ 14748 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:00:26.190209 [ 14748 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:00:26.190430 [ 14748 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:00:26.191557 [ 14748 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:00:26.191642 [ 14748 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:00:26.191692 [ 14748 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:00:26.191741 [ 14748 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:00:26.191782 [ 14748 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:00:26.192282 [ 14748 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 19 entries 2025.04.02 04:00:26.192350 [ 14748 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:00:26.192466 [ 14748 ] {} KeeperServer: Last local log idx 19 2025.04.02 04:00:26.192523 [ 14748 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 19 2025.04.02 04:00:26.193855 [ 14748 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:00:26.205588 [ 14748 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:00:26.205972 [ 14748 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:00:26.206088 [ 14748 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:00:26.206155 [ 14748 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:00:26.206235 [ 14748 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:00:26.206282 [ 14748 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:00:26.206432 [ 14748 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 19 election timer allowed log store start 1, end 19 config log idx 19, prev log idx 18 -- ASYNC REPLICATION -- 2025.04.02 04:00:26.206505 [ 14748 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:00:26.206586 [ 14748 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:00:26.206653 [ 14748 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:00:26.207562 [ 14748 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:00:26.207645 [ 15361 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:00:26.258078 [ 15344 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:00:26.258320 [ 15344 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:00:26.258676 [ 15344 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 19, state term 19, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:00:26.258734 [ 14748 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:00:26.258764 [ 15344 ] {} RaftInstance: pre-vote term (0) is different, reset it to 19 2025.04.02 04:00:26.259144 [ 15344 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:00:26.262253 [ 15344 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 20, log idx 19, log term 19, priority (target 1 / mine 1) 2025.04.02 04:00:26.262345 [ 15344 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:00:26.262461 [ 15344 ] {} RaftInstance: state machine commit index 0, precommit index 19, last log index 19 2025.04.02 04:00:26.262526 [ 15344 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:00:26.263024 [ 15344 ] {} RaftInstance: [BECOME LEADER] appended new config at 20 2025.04.02 04:00:26.263390 [ 15360 ] {} RaftInstance: config at index 1 is committed, prev config log idx 19 2025.04.02 04:00:26.263541 [ 15360 ] {} RaftInstance: skipped config 1, latest config 19 2025.04.02 04:00:26.263757 [ 15360 ] {} RaftInstance: config at index 2 is committed, prev config log idx 19 2025.04.02 04:00:26.263836 [ 15360 ] {} RaftInstance: skipped config 2, latest config 19 2025.04.02 04:00:26.263957 [ 15360 ] {} RaftInstance: config at index 3 is committed, prev config log idx 19 2025.04.02 04:00:26.264018 [ 15360 ] {} RaftInstance: skipped config 3, latest config 19 2025.04.02 04:00:26.264146 [ 15360 ] {} RaftInstance: config at index 4 is committed, prev config log idx 19 2025.04.02 04:00:26.264202 [ 15360 ] {} RaftInstance: skipped config 4, latest config 19 2025.04.02 04:00:26.264295 [ 15360 ] {} RaftInstance: config at index 5 is committed, prev config log idx 19 2025.04.02 04:00:26.264356 [ 15360 ] {} RaftInstance: skipped config 5, latest config 19 2025.04.02 04:00:26.264477 [ 15360 ] {} RaftInstance: config at index 6 is committed, prev config log idx 19 2025.04.02 04:00:26.264528 [ 15360 ] {} RaftInstance: skipped config 6, latest config 19 2025.04.02 04:00:26.264618 [ 15360 ] {} RaftInstance: config at index 7 is committed, prev config log idx 19 2025.04.02 04:00:26.264669 [ 15360 ] {} RaftInstance: skipped config 7, latest config 19 2025.04.02 04:00:26.264806 [ 15360 ] {} RaftInstance: config at index 8 is committed, prev config log idx 19 2025.04.02 04:00:26.264883 [ 15360 ] {} RaftInstance: skipped config 8, latest config 19 2025.04.02 04:00:26.264981 [ 15360 ] {} RaftInstance: config at index 9 is committed, prev config log idx 19 2025.04.02 04:00:26.265034 [ 15360 ] {} RaftInstance: skipped config 9, latest config 19 2025.04.02 04:00:26.265123 [ 15360 ] {} RaftInstance: config at index 10 is committed, prev config log idx 19 2025.04.02 04:00:26.265172 [ 15360 ] {} RaftInstance: skipped config 10, latest config 19 2025.04.02 04:00:26.265292 [ 15360 ] {} RaftInstance: config at index 11 is committed, prev config log idx 19 2025.04.02 04:00:26.265375 [ 15360 ] {} RaftInstance: skipped config 11, latest config 19 2025.04.02 04:00:26.265534 [ 15360 ] {} RaftInstance: config at index 12 is committed, prev config log idx 19 2025.04.02 04:00:26.265590 [ 15360 ] {} RaftInstance: skipped config 12, latest config 19 2025.04.02 04:00:26.265692 [ 15360 ] {} RaftInstance: config at index 13 is committed, prev config log idx 19 2025.04.02 04:00:26.265750 [ 15360 ] {} RaftInstance: skipped config 13, latest config 19 2025.04.02 04:00:26.265879 [ 15360 ] {} RaftInstance: config at index 14 is committed, prev config log idx 19 2025.04.02 04:00:26.265927 [ 15360 ] {} RaftInstance: skipped config 14, latest config 19 2025.04.02 04:00:26.266033 [ 15360 ] {} RaftInstance: config at index 15 is committed, prev config log idx 19 2025.04.02 04:00:26.266082 [ 15360 ] {} RaftInstance: skipped config 15, latest config 19 2025.04.02 04:00:26.266198 [ 15360 ] {} RaftInstance: config at index 16 is committed, prev config log idx 19 2025.04.02 04:00:26.266248 [ 15360 ] {} RaftInstance: skipped config 16, latest config 19 2025.04.02 04:00:26.266343 [ 15360 ] {} RaftInstance: config at index 17 is committed, prev config log idx 19 2025.04.02 04:00:26.313455 [ 15360 ] {} RaftInstance: skipped config 17, latest config 19 2025.04.02 04:00:26.313909 [ 15360 ] {} RaftInstance: config at index 18 is committed, prev config log idx 19 2025.04.02 04:00:26.314039 [ 15360 ] {} RaftInstance: skipped config 18, latest config 19 2025.04.02 04:00:26.314218 [ 15360 ] {} RaftInstance: config at index 19 is committed, prev config log idx 19 2025.04.02 04:00:26.314287 [ 15360 ] {} RaftInstance: skipped config 19, latest config 19 2025.04.02 04:00:26.314523 [ 15360 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:00:26.314606 [ 15360 ] {} KeeperServer: Preprocessing done 2025.04.02 04:00:26.314670 [ 15360 ] {} RaftInstance: config at index 20 is committed, prev config log idx 19 2025.04.02 04:00:26.314846 [ 15360 ] {} RaftInstance: new config log idx 20, prev log idx 19, cur config log idx 19, prev log idx 18 2025.04.02 04:00:26.315016 [ 15360 ] {} RaftInstance: new configuration: log idx 20, prev log idx 19 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 20 2025.04.02 04:00:26.315332 [ 14748 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:00:26.316193 [ 14748 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:00:26.318158 [ 14748 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:00:26.318720 [ 14748 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:00:26.331225 [ 14748 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:00:26.331295 [ 14748 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:00:26.332446 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:00:26.332863 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:00:26.333432 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:00:26.333715 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:00:26.333956 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:00:26.334202 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:00:26.334484 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:00:26.334823 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:00:26.339007 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:00:26.339406 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:00:26.339819 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:00:26.340205 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:00:26.340592 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:00:26.340974 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:00:26.341361 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:00:26.341843 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:00:26.342323 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:00:26.346376 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:00:26.346866 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:00:26.347284 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:00:26.347711 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:00:26.348228 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:00:26.349158 [ 14748 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:00:26.358332 [ 14748 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:00:26.358557 [ 14748 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:00:26.365570 [ 14748 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:00:26.365662 [ 14748 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:26.368821 [ 14748 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:00:26.370069 [ 14748 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:00:26.370634 [ 14748 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:00:26.371005 [ 15369 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:00:26.379264 [ 14748 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:00:26.382758 [ 14748 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:00:26.390792 [ 14748 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:00:26.394014 [ 14748 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:00:26.429008 [ 14748 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:00:26.430707 [ 14748 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:00:26.431923 [ 14748 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:00:26.432011 [ 14748 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:00:26.432159 [ 14762 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:00:26.433076 [ 14762 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:31.122846 [ 14748 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:31.123588 [ 14748 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:31.124058 [ 14748 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:31.124148 [ 14748 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:31.124366 [ 14761 ] {} CancellationChecker: Execution took 6003 ms. 2025.04.02 04:00:31.124666 [ 14748 ] {} Application: Shutting down storages. 2025.04.02 04:00:31.124734 [ 14748 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:31.126430 [ 14748 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:31.126507 [ 14748 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:31.126554 [ 14748 ] {} Context: Shutting down named sessions 2025.04.02 04:00:31.126628 [ 14748 ] {} Context: Shutting down database catalog 2025.04.02 04:00:31.126701 [ 14748 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:31.126776 [ 14748 ] {} Context: Shutting down merges executor 2025.04.02 04:00:31.127283 [ 14748 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:31.127951 [ 14748 ] {} Context: Shutting down moves executor 2025.04.02 04:00:31.128234 [ 14748 ] {} Context: Shutting down common executor 2025.04.02 04:00:31.128502 [ 14748 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:31.128544 [ 14748 ] {} Context: Shutting down caches 2025.04.02 04:00:31.128593 [ 14748 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:31.128948 [ 14748 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:31.131818 [ 14748 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:31.216334 [ 14748 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:31.216819 [ 14748 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:31.217640 [ 14748 ] {} Application: Shut down storages. 2025.04.02 04:00:31.217696 [ 14748 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:31.575242 [ 14748 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:31.575362 [ 14748 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:31.575421 [ 14748 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:31.818813 [ 14748 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:31.818997 [ 14748 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:31.819119 [ 14748 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:31.819200 [ 14748 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:31.819266 [ 14748 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:31.819352 [ 14748 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:31.819422 [ 14748 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:31.819729 [ 14748 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:31.819772 [ 15361 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:31.820002 [ 14748 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:31.820086 [ 14748 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:31.820146 [ 14748 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:31.820650 [ 15344 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:31.820679 [ 15349 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:31.820892 [ 15352 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:31.820552 [ 15347 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:00:31.821059 [ 15355 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:31.821307 [ 15345 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:31.821345 [ 15353 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:00:31.821363 [ 15354 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:00:31.821579 [ 15357 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:31.821592 [ 15348 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:31.821592 [ 15356 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:31.821494 [ 15346 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:31.821367 [ 15350 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:31.821644 [ 15347 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:31.821407 [ 15351 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:31.821581 [ 15359 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:31.821588 [ 15358 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:00:31.822252 [ 14748 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:31.822498 [ 15343 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:00:31.823203 [ 14748 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:31.823385 [ 14748 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:31.823455 [ 14748 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:31.823538 [ 14748 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:31.823593 [ 14748 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:31.823778 [ 14748 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:31.823819 [ 14748 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:31.827150 [ 14748 ] {} Application: Destroyed global context. 2025.04.02 04:00:31.827636 [ 14748 ] {} Application: Waiting for background threads 2025.04.02 04:00:31.929429 [ 14748 ] {} Application: Background threads finished in 101 ms 2025.04.02 04:00:31.930047 [ 14748 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:31.930095 [ 14748 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:31.943585 [ 14748 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:31.943848 [ 14748 ] {} Application: shutting down 2025.04.02 04:00:31.943895 [ 14748 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:00:31.950525 [ 14751 ] {} BaseDaemon: Received signal -2 2025.04.02 04:00:31.950670 [ 14751 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:00:32.132771 [ 14746 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:00:33.049020 [ 15483 ] {} Application: Will watch for the process with pid 15485 2025.04.02 04:00:33.050419 [ 15485 ] {} Application: Forked a child process to watch 2025.04.02 04:00:33.051987 [ 15485 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:00:33.562221 [ 15485 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 15485 2025.04.02 04:00:33.563317 [ 15485 ] {} Application: starting up 2025.04.02 04:00:33.563417 [ 15485 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:00:33.596791 [ 15485 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:00:33.596954 [ 15485 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:00:33.597164 [ 15485 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:00:33.597231 [ 15485 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:00:33.597267 [ 15485 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:00:33.597297 [ 15485 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:00:33.599158 [ 15485 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:00:33.599599 [ 15485 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:00:33.599647 [ 15485 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:00:33.599839 [ 15485 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:00:33.599894 [ 15485 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:00:34.489326 [ 15485 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:00:34.491490 [ 15485 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:00:34.491561 [ 15485 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:00:34.491733 [ 15485 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:00:34.492371 [ 15485 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:00:34.691240 [ 15495 ] {} CancellationChecker: Started worker function 2025.04.02 04:00:34.691365 [ 15485 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:00:34.691559 [ 15485 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:00:34.691617 [ 15485 ] {} Application: Initializing DateLUT. 2025.04.02 04:00:34.691656 [ 15485 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:00:34.691912 [ 15485 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:00:34.692321 [ 15485 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:00:34.782102 [ 15485 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:00:34.782273 [ 15485 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:00:34.782725 [ 15485 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:00:34.783318 [ 15485 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:00:34.783470 [ 15485 ] {} Application: Initializing interserver credentials. 2025.04.02 04:00:34.784597 [ 15485 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:00:34.790138 [ 15485 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:00:34.790710 [ 15485 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:00:34.802967 [ 15485 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:00:34.803110 [ 15485 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:00:34.811396 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:00:34.812557 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:00:34.813019 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:00:34.813559 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:00:34.814017 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:00:34.818605 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:00:34.819071 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:00:34.819514 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:00:34.819886 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:00:34.820255 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:00:34.820754 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:00:34.821106 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:00:34.821486 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:00:34.821806 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:00:34.822304 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:00:34.822672 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:00:34.823048 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:00:34.823426 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:00:34.823880 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:00:34.824249 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:00:34.824686 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:00:34.825068 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:00:34.825819 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:00:34.844736 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:00:34.845510 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:00:34.846872 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:00:34.848202 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:00:34.848663 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:00:34.849012 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:00:34.849388 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:00:34.849775 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:00:34.850170 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:00:34.850690 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:00:34.851078 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:00:34.851553 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:00:34.851945 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:00:34.852440 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:00:34.852969 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:00:34.853423 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:00:34.854658 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:00:34.855255 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:00:34.855686 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:00:34.856136 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:00:34.856568 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:00:34.857102 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:00:34.857551 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:00:34.857998 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:00:34.879876 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:00:34.883267 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:00:34.884273 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:00:34.885378 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:00:34.886145 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:00:34.886690 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:00:34.887128 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:00:34.887947 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:00:34.888489 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:00:34.889210 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:00:34.889670 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:00:34.890255 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:00:34.890761 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:00:34.891638 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:00:34.892106 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:00:34.892780 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:00:34.893500 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:00:34.894138 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:00:34.896227 [ 15485 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:00:34.964965 [ 15485 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:00:34.966823 [ 15485 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:00:35.093647 [ 15485 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:00:35.093745 [ 15485 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:00:35.093788 [ 15485 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:00:35.109209 [ 15485 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:00:35.109297 [ 15485 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:00:35.109360 [ 15485 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:00:35.109511 [ 15485 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:35.116197 [ 15485 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:35.121814 [ 15485 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:35.134277 [ 15485 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:00:35.134493 [ 15485 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:35.136967 [ 15485 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:00:35.137894 [ 15485 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:00:35.138974 [ 15485 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:00:35.139050 [ 15485 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:00:35.140571 [ 15485 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:00:35.140610 [ 15485 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:00:35.140646 [ 15485 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:00:35.140700 [ 15485 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:00:35.140726 [ 15485 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:00:35.140913 [ 15485 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:35.140976 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.211748 [ 15485 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:35.221979 [ 15485 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:35.222071 [ 15485 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:35.223209 [ 15485 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/hoc/tnbnafujzhtndydjbrepdyomqsviz 2025.04.02 04:00:35.223732 [ 15485 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/hoc/tnbnafujzhtndydjbrepdyomqsviz. 2025.04.02 04:00:35.231048 [ 16067 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/hoc/tnbnafujzhtndydjbrepdyomqsviz, size 4 2025.04.02 04:00:35.231782 [ 15485 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/hoc/tnbnafujzhtndydjbrepdyomqsviz. 2025.04.02 04:00:35.240718 [ 15485 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/hoc/tnbnafujzhtndydjbrepdyomqsviz 2025.04.02 04:00:35.240792 [ 15485 ] {} deleteFileFromS3: Object with path s3/hoc/tnbnafujzhtndydjbrepdyomqsviz was removed from S3 2025.04.02 04:00:35.240857 [ 15485 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:00:35.240917 [ 15485 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:00:35.244111 [ 15485 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:35.254254 [ 15485 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:35.254335 [ 15485 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:35.277310 [ 15485 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:00:35.277637 [ 15485 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:00:35 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DE2FF85FCA9 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:00:35.277850 [ 15485 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:00:35.283763 [ 15485 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:00:35.283853 [ 15485 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:00:35.283933 [ 15485 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:00:35.284001 [ 15485 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:00:35.284179 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.284312 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.284421 [ 15485 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:35.284541 [ 15485 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:35.284645 [ 15485 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:00:35.284733 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.284820 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.284913 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.285003 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.285111 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.288595 [ 15485 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:35.302787 [ 15485 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:35.302896 [ 15485 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:35.319272 [ 15485 ] {} deleteFileFromS3: No blob storage log, not writing blob special/bew/guhxnxpmjjruxnmiloxhcrelqdadq 2025.04.02 04:00:35.319359 [ 15485 ] {} deleteFileFromS3: Object with path special/bew/guhxnxpmjjruxnmiloxhcrelqdadq was removed from S3 2025.04.02 04:00:35.319409 [ 15485 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:00:35.319470 [ 15485 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:00:35.323340 [ 15485 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:35.337563 [ 15485 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:35.337678 [ 15485 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:35.355171 [ 15485 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/tcf/whppsonszgmdfkkztvxrtgdpusfsr 2025.04.02 04:00:35.355268 [ 15485 ] {} deleteFileFromS3: Object with path test_02944/tcf/whppsonszgmdfkkztvxrtgdpusfsr was removed from S3 2025.04.02 04:00:35.355341 [ 15485 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:00:35.355397 [ 15485 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:00:35.355603 [ 15485 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:35.359578 [ 15485 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:35.364426 [ 15485 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:00:35.364594 [ 15485 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:00:35.366915 [ 15485 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:00:35.367124 [ 15485 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:00:35.368084 [ 15485 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:00:35.368168 [ 15485 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:00:35.368228 [ 15485 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:00:35.368278 [ 15485 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:00:35.368331 [ 15485 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:00:35.368959 [ 15485 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 20 entries 2025.04.02 04:00:35.369038 [ 15485 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:00:35.369168 [ 15485 ] {} KeeperServer: Last local log idx 20 2025.04.02 04:00:35.369237 [ 15485 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 20 2025.04.02 04:00:35.370995 [ 15485 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:00:35.384091 [ 15485 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:00:35.384615 [ 15485 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:00:35.384752 [ 15485 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:00:35.384834 [ 15485 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:00:35.384938 [ 15485 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:00:35.385014 [ 15485 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:00:35.385130 [ 15485 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 20 election timer allowed log store start 1, end 20 config log idx 20, prev log idx 19 -- ASYNC REPLICATION -- 2025.04.02 04:00:35.385201 [ 15485 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:00:35.385314 [ 15485 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:00:35.385400 [ 15485 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:00:35.386066 [ 15485 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:00:35.386180 [ 16097 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:00:35.436585 [ 16080 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:00:35.436823 [ 16080 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:00:35.436955 [ 16080 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 20, state term 20, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:00:35.437024 [ 16080 ] {} RaftInstance: pre-vote term (0) is different, reset it to 20 2025.04.02 04:00:35.437222 [ 15485 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:00:35.437324 [ 16080 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:00:35.440631 [ 16080 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 21, log idx 20, log term 20, priority (target 1 / mine 1) 2025.04.02 04:00:35.440700 [ 16080 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:00:35.440750 [ 16080 ] {} RaftInstance: state machine commit index 0, precommit index 20, last log index 20 2025.04.02 04:00:35.440801 [ 16080 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:00:35.441213 [ 16080 ] {} RaftInstance: [BECOME LEADER] appended new config at 21 2025.04.02 04:00:35.441472 [ 16096 ] {} RaftInstance: config at index 1 is committed, prev config log idx 20 2025.04.02 04:00:35.441549 [ 16096 ] {} RaftInstance: skipped config 1, latest config 20 2025.04.02 04:00:35.441662 [ 16096 ] {} RaftInstance: config at index 2 is committed, prev config log idx 20 2025.04.02 04:00:35.441709 [ 16096 ] {} RaftInstance: skipped config 2, latest config 20 2025.04.02 04:00:35.441789 [ 16096 ] {} RaftInstance: config at index 3 is committed, prev config log idx 20 2025.04.02 04:00:35.441837 [ 16096 ] {} RaftInstance: skipped config 3, latest config 20 2025.04.02 04:00:35.441925 [ 16096 ] {} RaftInstance: config at index 4 is committed, prev config log idx 20 2025.04.02 04:00:35.441965 [ 16096 ] {} RaftInstance: skipped config 4, latest config 20 2025.04.02 04:00:35.442041 [ 16096 ] {} RaftInstance: config at index 5 is committed, prev config log idx 20 2025.04.02 04:00:35.442079 [ 16096 ] {} RaftInstance: skipped config 5, latest config 20 2025.04.02 04:00:35.442156 [ 16096 ] {} RaftInstance: config at index 6 is committed, prev config log idx 20 2025.04.02 04:00:35.442194 [ 16096 ] {} RaftInstance: skipped config 6, latest config 20 2025.04.02 04:00:35.442278 [ 16096 ] {} RaftInstance: config at index 7 is committed, prev config log idx 20 2025.04.02 04:00:35.442317 [ 16096 ] {} RaftInstance: skipped config 7, latest config 20 2025.04.02 04:00:35.442438 [ 16096 ] {} RaftInstance: config at index 8 is committed, prev config log idx 20 2025.04.02 04:00:35.442510 [ 16096 ] {} RaftInstance: skipped config 8, latest config 20 2025.04.02 04:00:35.442590 [ 16096 ] {} RaftInstance: config at index 9 is committed, prev config log idx 20 2025.04.02 04:00:35.442628 [ 16096 ] {} RaftInstance: skipped config 9, latest config 20 2025.04.02 04:00:35.442699 [ 16096 ] {} RaftInstance: config at index 10 is committed, prev config log idx 20 2025.04.02 04:00:35.442734 [ 16096 ] {} RaftInstance: skipped config 10, latest config 20 2025.04.02 04:00:35.442800 [ 16096 ] {} RaftInstance: config at index 11 is committed, prev config log idx 20 2025.04.02 04:00:35.442834 [ 16096 ] {} RaftInstance: skipped config 11, latest config 20 2025.04.02 04:00:35.442899 [ 16096 ] {} RaftInstance: config at index 12 is committed, prev config log idx 20 2025.04.02 04:00:35.442933 [ 16096 ] {} RaftInstance: skipped config 12, latest config 20 2025.04.02 04:00:35.443006 [ 16096 ] {} RaftInstance: config at index 13 is committed, prev config log idx 20 2025.04.02 04:00:35.443046 [ 16096 ] {} RaftInstance: skipped config 13, latest config 20 2025.04.02 04:00:35.443115 [ 16096 ] {} RaftInstance: config at index 14 is committed, prev config log idx 20 2025.04.02 04:00:35.443153 [ 16096 ] {} RaftInstance: skipped config 14, latest config 20 2025.04.02 04:00:35.443232 [ 16096 ] {} RaftInstance: config at index 15 is committed, prev config log idx 20 2025.04.02 04:00:35.443272 [ 16096 ] {} RaftInstance: skipped config 15, latest config 20 2025.04.02 04:00:35.443352 [ 16096 ] {} RaftInstance: config at index 16 is committed, prev config log idx 20 2025.04.02 04:00:35.443391 [ 16096 ] {} RaftInstance: skipped config 16, latest config 20 2025.04.02 04:00:35.443469 [ 16096 ] {} RaftInstance: config at index 17 is committed, prev config log idx 20 2025.04.02 04:00:35.443505 [ 16096 ] {} RaftInstance: skipped config 17, latest config 20 2025.04.02 04:00:35.443570 [ 16096 ] {} RaftInstance: config at index 18 is committed, prev config log idx 20 2025.04.02 04:00:35.443608 [ 16096 ] {} RaftInstance: skipped config 18, latest config 20 2025.04.02 04:00:35.443668 [ 16096 ] {} RaftInstance: config at index 19 is committed, prev config log idx 20 2025.04.02 04:00:35.443699 [ 16096 ] {} RaftInstance: skipped config 19, latest config 20 2025.04.02 04:00:35.443762 [ 16096 ] {} RaftInstance: config at index 20 is committed, prev config log idx 20 2025.04.02 04:00:35.443793 [ 16096 ] {} RaftInstance: skipped config 20, latest config 20 2025.04.02 04:00:35.443873 [ 16096 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:00:35.443918 [ 16096 ] {} KeeperServer: Preprocessing done 2025.04.02 04:00:35.443972 [ 16096 ] {} RaftInstance: config at index 21 is committed, prev config log idx 20 2025.04.02 04:00:35.444030 [ 16096 ] {} RaftInstance: new config log idx 21, prev log idx 20, cur config log idx 20, prev log idx 19 2025.04.02 04:00:35.444126 [ 16096 ] {} RaftInstance: new configuration: log idx 21, prev log idx 20 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 21 2025.04.02 04:00:35.444338 [ 15485 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:00:35.445371 [ 15485 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:00:35.447292 [ 15485 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:00:35.447734 [ 15485 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:00:35.477391 [ 15485 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:00:35.477523 [ 15485 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:00:35.478862 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:00:35.479339 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:00:35.479994 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:00:35.480322 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:00:35.480656 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:00:35.480947 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:00:35.481235 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:00:35.481648 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:00:35.487280 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:00:35.487814 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:00:35.488264 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:00:35.488757 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:00:35.489246 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:00:35.489751 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:00:35.490237 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:00:35.490879 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:00:35.491430 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:00:35.492096 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:00:35.492645 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:00:35.493203 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:00:35.493737 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:00:35.494435 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:00:35.495623 [ 15485 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:00:35.507669 [ 15485 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:00:35.508086 [ 15485 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:00:35.518589 [ 15485 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:00:35.518712 [ 15485 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:35.521982 [ 15485 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:00:35.523220 [ 15485 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:00:35.523799 [ 15485 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:00:35.524225 [ 16103 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:00:35.531976 [ 15485 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:00:35.534904 [ 15485 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:00:35.541122 [ 15485 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:00:35.544289 [ 15485 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:00:35.552032 [ 15485 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:00:35.553520 [ 15485 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:00:35.554671 [ 15485 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:00:35.554777 [ 15485 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:00:35.554891 [ 15496 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:00:35.555660 [ 15496 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:40.696350 [ 15485 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:40.697568 [ 15485 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:40.698069 [ 15485 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:40.698146 [ 15485 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:40.698346 [ 15495 ] {} CancellationChecker: Execution took 6007 ms. 2025.04.02 04:00:40.698771 [ 15485 ] {} Application: Shutting down storages. 2025.04.02 04:00:40.698846 [ 15485 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:40.700846 [ 15485 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:40.700916 [ 15485 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:40.700969 [ 15485 ] {} Context: Shutting down named sessions 2025.04.02 04:00:40.701075 [ 15485 ] {} Context: Shutting down database catalog 2025.04.02 04:00:40.701141 [ 15485 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:40.701258 [ 15485 ] {} Context: Shutting down merges executor 2025.04.02 04:00:40.702022 [ 15485 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:40.702629 [ 15485 ] {} Context: Shutting down moves executor 2025.04.02 04:00:40.702898 [ 15485 ] {} Context: Shutting down common executor 2025.04.02 04:00:40.703172 [ 15485 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:40.703268 [ 15485 ] {} Context: Shutting down caches 2025.04.02 04:00:40.703322 [ 15485 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:40.703703 [ 15485 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:40.706348 [ 15485 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:40.718794 [ 15485 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:40.719108 [ 15485 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:40.719943 [ 15485 ] {} Application: Shut down storages. 2025.04.02 04:00:40.719994 [ 15485 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:41.205411 [ 15485 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:41.205597 [ 15485 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:41.205682 [ 15485 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:41.448315 [ 15485 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:41.448483 [ 15485 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:41.448564 [ 15485 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:41.448697 [ 15485 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:41.448755 [ 15485 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:41.448811 [ 15485 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:41.448908 [ 15485 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:41.449051 [ 15485 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:41.449113 [ 16097 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:41.449343 [ 15485 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:41.449421 [ 15485 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:41.449495 [ 15485 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:41.449708 [ 16083 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:00:41.449992 [ 16080 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:00:41.450089 [ 16083 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:41.450101 [ 16082 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:41.450190 [ 16086 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:41.450346 [ 16093 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:41.450190 [ 16088 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:41.450631 [ 16081 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:41.450586 [ 16091 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:41.450353 [ 16089 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:00:41.450803 [ 16087 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:41.450865 [ 16084 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:00:41.450941 [ 16095 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:41.450904 [ 16092 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:41.450940 [ 16085 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:41.450882 [ 16090 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:00:41.450880 [ 16094 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:41.451703 [ 15485 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:41.451865 [ 16079 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:00:41.452528 [ 15485 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:41.452694 [ 15485 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:41.452752 [ 15485 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:41.452822 [ 15485 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:41.452870 [ 15485 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:41.453027 [ 15485 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:41.453070 [ 15485 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:41.456456 [ 15485 ] {} Application: Destroyed global context. 2025.04.02 04:00:41.457026 [ 15485 ] {} Application: Waiting for background threads 2025.04.02 04:00:41.536722 [ 15485 ] {} Application: Background threads finished in 79 ms 2025.04.02 04:00:41.537502 [ 15485 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:41.537593 [ 15485 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:41.561822 [ 15485 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:41.562323 [ 15485 ] {} Application: shutting down 2025.04.02 04:00:41.562489 [ 15485 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:00:41.575681 [ 15488 ] {} BaseDaemon: Received signal -2 2025.04.02 04:00:41.575906 [ 15488 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:00:41.715352 [ 15483 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:00:42.274635 [ 16215 ] {} Application: Will watch for the process with pid 16217 2025.04.02 04:00:42.276011 [ 16217 ] {} Application: Forked a child process to watch 2025.04.02 04:00:42.277326 [ 16217 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:00:42.769946 [ 16217 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 16217 2025.04.02 04:00:42.770937 [ 16217 ] {} Application: starting up 2025.04.02 04:00:42.771053 [ 16217 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:00:42.802661 [ 16217 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:00:42.802792 [ 16217 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:00:42.802966 [ 16217 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:00:42.803032 [ 16217 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:00:42.803065 [ 16217 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:00:42.803096 [ 16217 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:00:42.804656 [ 16217 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:00:42.805112 [ 16217 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:00:42.805161 [ 16217 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:00:42.805326 [ 16217 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:00:42.805385 [ 16217 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:00:43.698267 [ 16217 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:00:43.700408 [ 16217 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:00:43.700497 [ 16217 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:00:43.700684 [ 16217 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:00:43.701454 [ 16217 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:00:43.891161 [ 16227 ] {} CancellationChecker: Started worker function 2025.04.02 04:00:43.891547 [ 16217 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:00:43.891723 [ 16217 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:00:43.891824 [ 16217 ] {} Application: Initializing DateLUT. 2025.04.02 04:00:43.891875 [ 16217 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:00:43.892199 [ 16217 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:00:43.892728 [ 16217 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:00:43.913058 [ 16217 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:00:43.913244 [ 16217 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:00:43.913713 [ 16217 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:00:43.914367 [ 16217 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:00:43.914560 [ 16217 ] {} Application: Initializing interserver credentials. 2025.04.02 04:00:43.915741 [ 16217 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:00:43.921421 [ 16217 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:00:43.922029 [ 16217 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:00:43.934126 [ 16217 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:00:43.934236 [ 16217 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:00:43.942858 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:00:43.944105 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:00:43.944601 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:00:43.945123 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:00:43.945591 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:00:43.950504 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:00:43.951088 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:00:43.951666 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:00:43.952098 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:00:43.952526 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:00:43.953048 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:00:43.953409 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:00:43.953825 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:00:43.954167 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:00:43.954761 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:00:43.955098 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:00:43.955465 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:00:43.955874 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:00:43.956319 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:00:43.956724 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:00:43.957138 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:00:43.957555 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:00:43.958310 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:00:43.959564 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:00:43.959922 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:00:43.961108 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:00:43.962309 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:00:43.962874 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:00:43.963265 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:00:43.963666 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:00:43.964084 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:00:43.964522 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:00:43.965024 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:00:43.965403 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:00:43.965919 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:00:43.966303 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:00:43.966884 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:00:43.967504 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:00:43.967968 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:00:43.969248 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:00:43.970030 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:00:43.970520 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:00:43.970980 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:00:43.971415 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:00:43.972042 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:00:43.972521 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:00:43.973029 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:00:43.973552 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:00:43.982075 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:00:43.983285 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:00:43.984587 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:00:43.985364 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:00:43.985921 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:00:43.986486 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:00:43.987343 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:00:43.987909 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:00:43.988622 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:00:43.989081 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:00:43.989587 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:00:43.990115 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:00:43.990921 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:00:43.991513 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:00:43.992327 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:00:43.993383 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:00:43.994152 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:00:44.036221 [ 16217 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:00:44.086545 [ 16217 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:00:44.088914 [ 16217 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:00:44.178128 [ 16217 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:00:44.178238 [ 16217 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:00:44.178281 [ 16217 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:00:44.194819 [ 16217 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:00:44.194915 [ 16217 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:00:44.194982 [ 16217 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:00:44.195136 [ 16217 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:44.210464 [ 16217 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:44.218586 [ 16217 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:44.231494 [ 16217 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:00:44.231681 [ 16217 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:44.233884 [ 16217 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:00:44.235045 [ 16217 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:00:44.236236 [ 16217 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:00:44.236333 [ 16217 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:00:44.237889 [ 16217 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:00:44.237931 [ 16217 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:00:44.237955 [ 16217 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:00:44.237998 [ 16217 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:00:44.238022 [ 16217 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:00:44.238239 [ 16217 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:44.238302 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.463726 [ 16217 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:44.499423 [ 16217 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:44.499582 [ 16217 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:44.501294 [ 16217 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/wru/fgiquxnpmijbrsmbvogutqsguvyhw 2025.04.02 04:00:44.502055 [ 16217 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/wru/fgiquxnpmijbrsmbvogutqsguvyhw. 2025.04.02 04:00:44.509879 [ 16799 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/wru/fgiquxnpmijbrsmbvogutqsguvyhw, size 4 2025.04.02 04:00:44.511315 [ 16217 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/wru/fgiquxnpmijbrsmbvogutqsguvyhw. 2025.04.02 04:00:44.524338 [ 16217 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/wru/fgiquxnpmijbrsmbvogutqsguvyhw 2025.04.02 04:00:44.524449 [ 16217 ] {} deleteFileFromS3: Object with path s3/wru/fgiquxnpmijbrsmbvogutqsguvyhw was removed from S3 2025.04.02 04:00:44.524546 [ 16217 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:00:44.524655 [ 16217 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:00:44.530102 [ 16217 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:44.547559 [ 16217 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:44.547681 [ 16217 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:44.571823 [ 16217 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:00:44.572183 [ 16217 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:00:44 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DE529804EE4 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:00:44.572420 [ 16217 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:00:44.578283 [ 16217 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:00:44.578372 [ 16217 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:00:44.578537 [ 16217 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:00:44.578598 [ 16217 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:00:44.578731 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.578805 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.578890 [ 16217 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:44.578996 [ 16217 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:44.579072 [ 16217 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:00:44.579127 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.579181 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.579249 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.579304 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.579367 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.582776 [ 16217 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:44.593758 [ 16217 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:44.593853 [ 16217 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:44.715421 [ 16217 ] {} deleteFileFromS3: No blob storage log, not writing blob special/zxx/rwigevufuhweubardsjkncgswmgwj 2025.04.02 04:00:44.715549 [ 16217 ] {} deleteFileFromS3: Object with path special/zxx/rwigevufuhweubardsjkncgswmgwj was removed from S3 2025.04.02 04:00:44.715613 [ 16217 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:00:44.715659 [ 16217 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:00:44.719834 [ 16217 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:44.809801 [ 16217 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:44.809991 [ 16217 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:44.828621 [ 16217 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/lkn/uqnzrvnlbvbxrahoqgdmdapsawpec 2025.04.02 04:00:44.828827 [ 16217 ] {} deleteFileFromS3: Object with path test_02944/lkn/uqnzrvnlbvbxrahoqgdmdapsawpec was removed from S3 2025.04.02 04:00:44.828938 [ 16217 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:00:44.829041 [ 16217 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:00:44.829277 [ 16217 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:44.835156 [ 16217 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:44.842233 [ 16217 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:00:44.842453 [ 16217 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:00:44.844578 [ 16217 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:00:44.844807 [ 16217 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:00:44.845894 [ 16217 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:00:44.845962 [ 16217 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:00:44.846014 [ 16217 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:00:44.846052 [ 16217 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:00:44.846090 [ 16217 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:00:44.846883 [ 16217 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 21 entries 2025.04.02 04:00:44.846966 [ 16217 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:00:44.847082 [ 16217 ] {} KeeperServer: Last local log idx 21 2025.04.02 04:00:44.847135 [ 16217 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 21 2025.04.02 04:00:44.848436 [ 16217 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:00:44.861162 [ 16217 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:00:44.861658 [ 16217 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:00:44.861783 [ 16217 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:00:44.861846 [ 16217 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:00:44.861920 [ 16217 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:00:44.861966 [ 16217 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:00:44.862053 [ 16217 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 21 election timer allowed log store start 1, end 21 config log idx 21, prev log idx 20 -- ASYNC REPLICATION -- 2025.04.02 04:00:44.862102 [ 16217 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:00:44.862170 [ 16217 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:00:44.862234 [ 16217 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:00:44.863155 [ 16217 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:00:44.863279 [ 16830 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:00:44.913878 [ 16813 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:00:44.914137 [ 16813 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:00:44.914297 [ 16813 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 21, state term 21, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:00:44.914373 [ 16217 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:00:44.945639 [ 16813 ] {} RaftInstance: pre-vote term (0) is different, reset it to 21 2025.04.02 04:00:44.946183 [ 16813 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:00:44.953910 [ 16813 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 22, log idx 21, log term 21, priority (target 1 / mine 1) 2025.04.02 04:00:44.954069 [ 16813 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:00:44.954153 [ 16813 ] {} RaftInstance: state machine commit index 0, precommit index 21, last log index 21 2025.04.02 04:00:44.954247 [ 16813 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:00:44.954720 [ 16813 ] {} RaftInstance: [BECOME LEADER] appended new config at 22 2025.04.02 04:00:44.955107 [ 16829 ] {} RaftInstance: config at index 1 is committed, prev config log idx 21 2025.04.02 04:00:44.955243 [ 16829 ] {} RaftInstance: skipped config 1, latest config 21 2025.04.02 04:00:44.955458 [ 16829 ] {} RaftInstance: config at index 2 is committed, prev config log idx 21 2025.04.02 04:00:44.955528 [ 16829 ] {} RaftInstance: skipped config 2, latest config 21 2025.04.02 04:00:44.955613 [ 16829 ] {} RaftInstance: config at index 3 is committed, prev config log idx 21 2025.04.02 04:00:44.955661 [ 16829 ] {} RaftInstance: skipped config 3, latest config 21 2025.04.02 04:00:44.955734 [ 16829 ] {} RaftInstance: config at index 4 is committed, prev config log idx 21 2025.04.02 04:00:44.955771 [ 16829 ] {} RaftInstance: skipped config 4, latest config 21 2025.04.02 04:00:44.955867 [ 16829 ] {} RaftInstance: config at index 5 is committed, prev config log idx 21 2025.04.02 04:00:44.955929 [ 16829 ] {} RaftInstance: skipped config 5, latest config 21 2025.04.02 04:00:44.956049 [ 16829 ] {} RaftInstance: config at index 6 is committed, prev config log idx 21 2025.04.02 04:00:44.956087 [ 16829 ] {} RaftInstance: skipped config 6, latest config 21 2025.04.02 04:00:44.956154 [ 16829 ] {} RaftInstance: config at index 7 is committed, prev config log idx 21 2025.04.02 04:00:44.956189 [ 16829 ] {} RaftInstance: skipped config 7, latest config 21 2025.04.02 04:00:44.956262 [ 16829 ] {} RaftInstance: config at index 8 is committed, prev config log idx 21 2025.04.02 04:00:44.956362 [ 16829 ] {} RaftInstance: skipped config 8, latest config 21 2025.04.02 04:00:44.956470 [ 16829 ] {} RaftInstance: config at index 9 is committed, prev config log idx 21 2025.04.02 04:00:44.956519 [ 16829 ] {} RaftInstance: skipped config 9, latest config 21 2025.04.02 04:00:44.956576 [ 16829 ] {} RaftInstance: config at index 10 is committed, prev config log idx 21 2025.04.02 04:00:44.956605 [ 16829 ] {} RaftInstance: skipped config 10, latest config 21 2025.04.02 04:00:44.956689 [ 16829 ] {} RaftInstance: config at index 11 is committed, prev config log idx 21 2025.04.02 04:00:44.956739 [ 16829 ] {} RaftInstance: skipped config 11, latest config 21 2025.04.02 04:00:44.956819 [ 16829 ] {} RaftInstance: config at index 12 is committed, prev config log idx 21 2025.04.02 04:00:44.956865 [ 16829 ] {} RaftInstance: skipped config 12, latest config 21 2025.04.02 04:00:44.956924 [ 16829 ] {} RaftInstance: config at index 13 is committed, prev config log idx 21 2025.04.02 04:00:44.956980 [ 16829 ] {} RaftInstance: skipped config 13, latest config 21 2025.04.02 04:00:44.957040 [ 16829 ] {} RaftInstance: config at index 14 is committed, prev config log idx 21 2025.04.02 04:00:44.957071 [ 16829 ] {} RaftInstance: skipped config 14, latest config 21 2025.04.02 04:00:44.957129 [ 16829 ] {} RaftInstance: config at index 15 is committed, prev config log idx 21 2025.04.02 04:00:44.957162 [ 16829 ] {} RaftInstance: skipped config 15, latest config 21 2025.04.02 04:00:44.957228 [ 16829 ] {} RaftInstance: config at index 16 is committed, prev config log idx 21 2025.04.02 04:00:44.957257 [ 16829 ] {} RaftInstance: skipped config 16, latest config 21 2025.04.02 04:00:44.957309 [ 16829 ] {} RaftInstance: config at index 17 is committed, prev config log idx 21 2025.04.02 04:00:44.957338 [ 16829 ] {} RaftInstance: skipped config 17, latest config 21 2025.04.02 04:00:44.957391 [ 16829 ] {} RaftInstance: config at index 18 is committed, prev config log idx 21 2025.04.02 04:00:44.957425 [ 16829 ] {} RaftInstance: skipped config 18, latest config 21 2025.04.02 04:00:44.957494 [ 16829 ] {} RaftInstance: config at index 19 is committed, prev config log idx 21 2025.04.02 04:00:44.957524 [ 16829 ] {} RaftInstance: skipped config 19, latest config 21 2025.04.02 04:00:44.957576 [ 16829 ] {} RaftInstance: config at index 20 is committed, prev config log idx 21 2025.04.02 04:00:44.957604 [ 16829 ] {} RaftInstance: skipped config 20, latest config 21 2025.04.02 04:00:44.957662 [ 16829 ] {} RaftInstance: config at index 21 is committed, prev config log idx 21 2025.04.02 04:00:44.957701 [ 16829 ] {} RaftInstance: skipped config 21, latest config 21 2025.04.02 04:00:44.957790 [ 16829 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:00:44.957835 [ 16829 ] {} KeeperServer: Preprocessing done 2025.04.02 04:00:44.957883 [ 16829 ] {} RaftInstance: config at index 22 is committed, prev config log idx 21 2025.04.02 04:00:44.957950 [ 16829 ] {} RaftInstance: new config log idx 22, prev log idx 21, cur config log idx 21, prev log idx 20 2025.04.02 04:00:44.958065 [ 16829 ] {} RaftInstance: new configuration: log idx 22, prev log idx 21 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 22 2025.04.02 04:00:44.958511 [ 16217 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:00:44.959701 [ 16217 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:00:44.961910 [ 16217 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:00:44.962450 [ 16217 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:00:44.975656 [ 16217 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:00:44.975779 [ 16217 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:00:44.977052 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:00:44.977513 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:00:44.978109 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:00:44.978452 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:00:44.978732 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:00:44.979016 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:00:44.979314 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:00:44.979664 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:00:44.984096 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:00:44.984654 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:00:44.985070 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:00:44.985503 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:00:44.986061 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:00:44.986543 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:00:44.986957 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:00:44.987409 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:00:44.987930 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:00:44.988445 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:00:44.988925 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:00:44.989377 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:00:44.989831 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:00:44.990375 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:00:44.991286 [ 16217 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:00:44.998874 [ 16217 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:00:44.999106 [ 16217 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:00:45.006206 [ 16217 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:00:45.006349 [ 16217 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:45.009809 [ 16217 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:00:45.011199 [ 16217 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:00:45.011918 [ 16217 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:00:45.012462 [ 16835 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:00:45.021371 [ 16217 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:00:45.024681 [ 16217 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:00:45.031998 [ 16217 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:00:45.035336 [ 16217 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:00:45.043881 [ 16217 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:00:45.045496 [ 16217 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:00:45.046795 [ 16217 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:00:45.046900 [ 16217 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:00:45.047023 [ 16228 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:00:45.048059 [ 16228 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:50.023867 [ 16217 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:50.024343 [ 16217 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:50.024785 [ 16217 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:50.024859 [ 16217 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:50.025035 [ 16227 ] {} CancellationChecker: Execution took 6133 ms. 2025.04.02 04:00:50.025474 [ 16217 ] {} Application: Shutting down storages. 2025.04.02 04:00:50.025550 [ 16217 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:50.027650 [ 16217 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:50.027708 [ 16217 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:50.027743 [ 16217 ] {} Context: Shutting down named sessions 2025.04.02 04:00:50.027811 [ 16217 ] {} Context: Shutting down database catalog 2025.04.02 04:00:50.027849 [ 16217 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:50.027911 [ 16217 ] {} Context: Shutting down merges executor 2025.04.02 04:00:50.028434 [ 16217 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:50.028909 [ 16217 ] {} Context: Shutting down moves executor 2025.04.02 04:00:50.029130 [ 16217 ] {} Context: Shutting down common executor 2025.04.02 04:00:50.029408 [ 16217 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:50.029438 [ 16217 ] {} Context: Shutting down caches 2025.04.02 04:00:50.029468 [ 16217 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:50.029750 [ 16217 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:50.115464 [ 16217 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:50.116999 [ 16217 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:50.117666 [ 16217 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:50.118357 [ 16217 ] {} Application: Shut down storages. 2025.04.02 04:00:50.118459 [ 16217 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:50.219179 [ 16217 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:50.219279 [ 16217 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:50.219339 [ 16217 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:50.462064 [ 16217 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:50.462231 [ 16217 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:50.462305 [ 16217 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:50.538143 [ 16217 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:50.538294 [ 16217 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:50.538438 [ 16217 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:50.538544 [ 16217 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:50.538708 [ 16217 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:50.538753 [ 16830 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:50.538977 [ 16217 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:50.539047 [ 16217 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:50.539102 [ 16217 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:50.539583 [ 16817 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:50.539577 [ 16814 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:00:50.539761 [ 16816 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:50.539778 [ 16819 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:50.540326 [ 16813 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:50.540159 [ 16822 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:00:50.540143 [ 16823 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:50.540257 [ 16828 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:50.540267 [ 16827 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:50.540264 [ 16825 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:00:50.540461 [ 16818 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:50.540522 [ 16820 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:50.540336 [ 16821 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:50.540581 [ 16815 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:50.540302 [ 16824 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:50.540274 [ 16826 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:50.541188 [ 16217 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:50.541976 [ 16217 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:50.542131 [ 16217 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:50.542219 [ 16217 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:50.542297 [ 16217 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:50.542369 [ 16217 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:50.542583 [ 16217 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:50.542638 [ 16217 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:50.546568 [ 16217 ] {} Application: Destroyed global context. 2025.04.02 04:00:50.547134 [ 16217 ] {} Application: Waiting for background threads 2025.04.02 04:00:50.662597 [ 16217 ] {} Application: Background threads finished in 115 ms 2025.04.02 04:00:50.663540 [ 16217 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:50.663639 [ 16217 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:50.683476 [ 16217 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:50.683951 [ 16217 ] {} Application: shutting down 2025.04.02 04:00:50.684010 [ 16217 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:00:50.716768 [ 16220 ] {} BaseDaemon: Received signal -2 2025.04.02 04:00:50.717028 [ 16220 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:00:50.970560 [ 16215 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:00:51.418849 [ 16947 ] {} Application: Will watch for the process with pid 16949 2025.04.02 04:00:51.420118 [ 16949 ] {} Application: Forked a child process to watch 2025.04.02 04:00:51.421591 [ 16949 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:00:51.919738 [ 16949 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 16949 2025.04.02 04:00:51.920723 [ 16949 ] {} Application: starting up 2025.04.02 04:00:51.920809 [ 16949 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:00:51.954398 [ 16949 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:00:51.954554 [ 16949 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:00:51.954751 [ 16949 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:00:51.954817 [ 16949 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:00:51.954864 [ 16949 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:00:51.954893 [ 16949 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:00:51.956725 [ 16949 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:00:51.957175 [ 16949 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:00:51.957227 [ 16949 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:00:51.957418 [ 16949 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:00:51.957471 [ 16949 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:00:52.829345 [ 16949 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:00:52.831496 [ 16949 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:00:52.831580 [ 16949 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:00:52.831755 [ 16949 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:00:52.832608 [ 16949 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:00:53.086076 [ 16959 ] {} CancellationChecker: Started worker function 2025.04.02 04:00:53.086534 [ 16949 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:00:53.086649 [ 16949 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:00:53.086736 [ 16949 ] {} Application: Initializing DateLUT. 2025.04.02 04:00:53.086804 [ 16949 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:00:53.087161 [ 16949 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:00:53.087745 [ 16949 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:00:53.112026 [ 16949 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:00:53.112274 [ 16949 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:00:53.112865 [ 16949 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:00:53.113683 [ 16949 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:00:53.113873 [ 16949 ] {} Application: Initializing interserver credentials. 2025.04.02 04:00:53.115611 [ 16949 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:00:53.294727 [ 16949 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:00:53.295567 [ 16949 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:00:53.315063 [ 16949 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:00:53.315230 [ 16949 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:00:53.326926 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:00:53.328652 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:00:53.329329 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:00:53.330109 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:00:53.330836 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:00:53.338555 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:00:53.339423 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:00:53.340241 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:00:53.340818 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:00:53.341471 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:00:53.342298 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:00:53.437634 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:00:53.438654 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:00:53.439337 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:00:53.440350 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:00:53.441051 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:00:53.441770 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:00:53.442496 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:00:53.443217 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:00:53.443999 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:00:53.444847 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:00:53.445549 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:00:53.446840 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:00:53.448863 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:00:53.449522 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:00:53.451211 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:00:53.453236 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:00:53.453981 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:00:53.454681 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:00:53.455369 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:00:53.456051 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:00:53.456794 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:00:53.457614 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:00:53.458357 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:00:53.459302 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:00:53.459997 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:00:53.460893 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:00:53.461881 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:00:53.510548 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:00:53.513089 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:00:53.514283 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:00:53.515235 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:00:53.516098 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:00:53.516927 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:00:53.517963 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:00:53.518802 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:00:53.519712 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:00:53.520587 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:00:53.525128 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:00:53.526744 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:00:53.528558 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:00:53.529707 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:00:53.530450 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:00:53.531165 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:00:53.532560 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:00:53.533373 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:00:53.534475 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:00:53.535224 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:00:53.536065 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:00:53.536867 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:00:53.537971 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:00:53.538738 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:00:53.539636 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:00:53.540783 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:00:53.541796 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:00:53.545431 [ 16949 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:00:53.746658 [ 16949 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:00:53.749822 [ 16949 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:00:53.811257 [ 16949 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:00:53.811384 [ 16949 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:00:53.811450 [ 16949 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:00:53.834017 [ 16949 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:00:53.834116 [ 16949 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:00:53.834175 [ 16949 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:00:53.834307 [ 16949 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:53.842285 [ 16949 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:53.848969 [ 16949 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:00:53.865680 [ 16949 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:00:53.865909 [ 16949 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:53.869791 [ 16949 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:00:53.871217 [ 16949 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:00:53.872795 [ 16949 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:00:53.872882 [ 16949 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:00:53.875180 [ 16949 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:00:53.875235 [ 16949 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:00:53.875290 [ 16949 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:00:53.875354 [ 16949 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:00:53.875392 [ 16949 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:00:53.875658 [ 16949 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:53.875749 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:53.998531 [ 16949 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:54.008964 [ 16949 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:54.009079 [ 16949 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:54.010335 [ 16949 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/cus/shtpuqpcinrwyjwjtofgvpqjetxke 2025.04.02 04:00:54.064832 [ 16949 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/cus/shtpuqpcinrwyjwjtofgvpqjetxke. 2025.04.02 04:00:54.071539 [ 17535 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/cus/shtpuqpcinrwyjwjtofgvpqjetxke, size 4 2025.04.02 04:00:54.072351 [ 16949 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/cus/shtpuqpcinrwyjwjtofgvpqjetxke. 2025.04.02 04:00:54.082340 [ 16949 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/cus/shtpuqpcinrwyjwjtofgvpqjetxke 2025.04.02 04:00:54.082469 [ 16949 ] {} deleteFileFromS3: Object with path s3/cus/shtpuqpcinrwyjwjtofgvpqjetxke was removed from S3 2025.04.02 04:00:54.082553 [ 16949 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:00:54.082612 [ 16949 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:00:54.085786 [ 16949 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:54.096002 [ 16949 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:54.096101 [ 16949 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:54.117868 [ 16949 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:00:54.118087 [ 16949 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:00:54 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DE7628005DB x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:00:54.118241 [ 16949 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:00:54.123255 [ 16949 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:00:54.123315 [ 16949 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:00:54.123371 [ 16949 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:00:54.123417 [ 16949 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:00:54.123570 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.123662 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.123758 [ 16949 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:54.123815 [ 16949 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:54.123878 [ 16949 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:00:54.123934 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.123986 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.124053 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.124108 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.124170 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.127339 [ 16949 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:54.170199 [ 16949 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:54.170287 [ 16949 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:54.188286 [ 16949 ] {} deleteFileFromS3: No blob storage log, not writing blob special/uaj/dlffpmhgxwaokagkjeahdrtarpcur 2025.04.02 04:00:54.188367 [ 16949 ] {} deleteFileFromS3: Object with path special/uaj/dlffpmhgxwaokagkjeahdrtarpcur was removed from S3 2025.04.02 04:00:54.188417 [ 16949 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:00:54.188453 [ 16949 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:00:54.191788 [ 16949 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:00:54.201996 [ 16949 ] {} S3Client: Provider type: Unknown 2025.04.02 04:00:54.202082 [ 16949 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:00:54.218912 [ 16949 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/aik/swbktcfzycfqxyloxybtqrecgctoq 2025.04.02 04:00:54.218981 [ 16949 ] {} deleteFileFromS3: Object with path test_02944/aik/swbktcfzycfqxyloxybtqrecgctoq was removed from S3 2025.04.02 04:00:54.219027 [ 16949 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:00:54.219063 [ 16949 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:00:54.219208 [ 16949 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:00:54.223008 [ 16949 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:00:54.227632 [ 16949 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:00:54.227747 [ 16949 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:00:54.229573 [ 16949 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:00:54.229760 [ 16949 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:00:54.231121 [ 16949 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:00:54.231183 [ 16949 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:00:54.231223 [ 16949 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:00:54.231258 [ 16949 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:00:54.231294 [ 16949 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:00:54.231977 [ 16949 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 22 entries 2025.04.02 04:00:54.232053 [ 16949 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:00:54.232154 [ 16949 ] {} KeeperServer: Last local log idx 22 2025.04.02 04:00:54.232203 [ 16949 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 22 2025.04.02 04:00:54.233368 [ 16949 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:00:54.246043 [ 16949 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:00:54.246663 [ 16949 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:00:54.246802 [ 16949 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:00:54.246865 [ 16949 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:00:54.246936 [ 16949 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:00:54.246984 [ 16949 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:00:54.247073 [ 16949 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 22 election timer allowed log store start 1, end 22 config log idx 22, prev log idx 21 -- ASYNC REPLICATION -- 2025.04.02 04:00:54.247118 [ 16949 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:00:54.247186 [ 16949 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:00:54.247272 [ 16949 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:00:54.248028 [ 16949 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:00:54.248123 [ 17562 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:00:54.298638 [ 17545 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:00:54.298844 [ 17545 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:00:54.298968 [ 17545 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 22, state term 22, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:00:54.299032 [ 17545 ] {} RaftInstance: pre-vote term (0) is different, reset it to 22 2025.04.02 04:00:54.299157 [ 16949 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:00:54.299420 [ 17545 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:00:54.304274 [ 17545 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 23, log idx 22, log term 22, priority (target 1 / mine 1) 2025.04.02 04:00:54.304397 [ 17545 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:00:54.304492 [ 17545 ] {} RaftInstance: state machine commit index 0, precommit index 22, last log index 22 2025.04.02 04:00:54.304601 [ 17545 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:00:54.304998 [ 17545 ] {} RaftInstance: [BECOME LEADER] appended new config at 23 2025.04.02 04:00:54.305333 [ 17561 ] {} RaftInstance: config at index 1 is committed, prev config log idx 22 2025.04.02 04:00:54.305441 [ 17561 ] {} RaftInstance: skipped config 1, latest config 22 2025.04.02 04:00:54.305574 [ 17561 ] {} RaftInstance: config at index 2 is committed, prev config log idx 22 2025.04.02 04:00:54.305617 [ 17561 ] {} RaftInstance: skipped config 2, latest config 22 2025.04.02 04:00:54.305697 [ 17561 ] {} RaftInstance: config at index 3 is committed, prev config log idx 22 2025.04.02 04:00:54.305741 [ 17561 ] {} RaftInstance: skipped config 3, latest config 22 2025.04.02 04:00:54.305814 [ 17561 ] {} RaftInstance: config at index 4 is committed, prev config log idx 22 2025.04.02 04:00:54.305854 [ 17561 ] {} RaftInstance: skipped config 4, latest config 22 2025.04.02 04:00:54.305924 [ 17561 ] {} RaftInstance: config at index 5 is committed, prev config log idx 22 2025.04.02 04:00:54.305958 [ 17561 ] {} RaftInstance: skipped config 5, latest config 22 2025.04.02 04:00:54.306027 [ 17561 ] {} RaftInstance: config at index 6 is committed, prev config log idx 22 2025.04.02 04:00:54.306084 [ 17561 ] {} RaftInstance: skipped config 6, latest config 22 2025.04.02 04:00:54.306158 [ 17561 ] {} RaftInstance: config at index 7 is committed, prev config log idx 22 2025.04.02 04:00:54.306214 [ 17561 ] {} RaftInstance: skipped config 7, latest config 22 2025.04.02 04:00:54.306309 [ 17561 ] {} RaftInstance: config at index 8 is committed, prev config log idx 22 2025.04.02 04:00:54.306360 [ 17561 ] {} RaftInstance: skipped config 8, latest config 22 2025.04.02 04:00:54.306493 [ 17561 ] {} RaftInstance: config at index 9 is committed, prev config log idx 22 2025.04.02 04:00:54.306548 [ 17561 ] {} RaftInstance: skipped config 9, latest config 22 2025.04.02 04:00:54.306645 [ 17561 ] {} RaftInstance: config at index 10 is committed, prev config log idx 22 2025.04.02 04:00:54.306682 [ 17561 ] {} RaftInstance: skipped config 10, latest config 22 2025.04.02 04:00:54.306757 [ 17561 ] {} RaftInstance: config at index 11 is committed, prev config log idx 22 2025.04.02 04:00:54.306791 [ 17561 ] {} RaftInstance: skipped config 11, latest config 22 2025.04.02 04:00:54.306869 [ 17561 ] {} RaftInstance: config at index 12 is committed, prev config log idx 22 2025.04.02 04:00:54.306900 [ 17561 ] {} RaftInstance: skipped config 12, latest config 22 2025.04.02 04:00:54.306955 [ 17561 ] {} RaftInstance: config at index 13 is committed, prev config log idx 22 2025.04.02 04:00:54.306986 [ 17561 ] {} RaftInstance: skipped config 13, latest config 22 2025.04.02 04:00:54.307038 [ 17561 ] {} RaftInstance: config at index 14 is committed, prev config log idx 22 2025.04.02 04:00:54.307067 [ 17561 ] {} RaftInstance: skipped config 14, latest config 22 2025.04.02 04:00:54.307125 [ 17561 ] {} RaftInstance: config at index 15 is committed, prev config log idx 22 2025.04.02 04:00:54.307154 [ 17561 ] {} RaftInstance: skipped config 15, latest config 22 2025.04.02 04:00:54.307216 [ 17561 ] {} RaftInstance: config at index 16 is committed, prev config log idx 22 2025.04.02 04:00:54.307245 [ 17561 ] {} RaftInstance: skipped config 16, latest config 22 2025.04.02 04:00:54.307296 [ 17561 ] {} RaftInstance: config at index 17 is committed, prev config log idx 22 2025.04.02 04:00:54.307325 [ 17561 ] {} RaftInstance: skipped config 17, latest config 22 2025.04.02 04:00:54.307381 [ 17561 ] {} RaftInstance: config at index 18 is committed, prev config log idx 22 2025.04.02 04:00:54.307420 [ 17561 ] {} RaftInstance: skipped config 18, latest config 22 2025.04.02 04:00:54.307474 [ 17561 ] {} RaftInstance: config at index 19 is committed, prev config log idx 22 2025.04.02 04:00:54.307503 [ 17561 ] {} RaftInstance: skipped config 19, latest config 22 2025.04.02 04:00:54.307579 [ 17561 ] {} RaftInstance: config at index 20 is committed, prev config log idx 22 2025.04.02 04:00:54.307605 [ 17561 ] {} RaftInstance: skipped config 20, latest config 22 2025.04.02 04:00:54.307663 [ 17561 ] {} RaftInstance: config at index 21 is committed, prev config log idx 22 2025.04.02 04:00:54.307691 [ 17561 ] {} RaftInstance: skipped config 21, latest config 22 2025.04.02 04:00:54.307744 [ 17561 ] {} RaftInstance: config at index 22 is committed, prev config log idx 22 2025.04.02 04:00:54.307773 [ 17561 ] {} RaftInstance: skipped config 22, latest config 22 2025.04.02 04:00:54.307842 [ 17561 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:00:54.307885 [ 17561 ] {} KeeperServer: Preprocessing done 2025.04.02 04:00:54.307937 [ 17561 ] {} RaftInstance: config at index 23 is committed, prev config log idx 22 2025.04.02 04:00:54.307992 [ 17561 ] {} RaftInstance: new config log idx 23, prev log idx 22, cur config log idx 22, prev log idx 21 2025.04.02 04:00:54.308080 [ 17561 ] {} RaftInstance: new configuration: log idx 23, prev log idx 22 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 23 2025.04.02 04:00:54.308304 [ 16949 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:00:54.309181 [ 16949 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:00:54.311252 [ 16949 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:00:54.311721 [ 16949 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:00:54.324461 [ 16949 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:00:54.324596 [ 16949 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:00:54.325793 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:00:54.326247 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:00:54.326932 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:00:54.327263 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:00:54.327566 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:00:54.327812 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:00:54.328052 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:00:54.328403 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:00:54.332849 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:00:54.333296 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:00:54.333686 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:00:54.334072 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:00:54.334562 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:00:54.334943 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:00:54.335329 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:00:54.335800 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:00:54.336274 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:00:54.336878 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:00:54.337329 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:00:54.337868 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:00:54.338286 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:00:54.338877 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:00:54.339784 [ 16949 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:00:54.367597 [ 16949 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:00:54.368080 [ 16949 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:00:54.375232 [ 16949 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:00:54.375390 [ 16949 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:00:54.378801 [ 16949 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:00:54.380077 [ 16949 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:00:54.380895 [ 16949 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:00:54.381362 [ 17567 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:00:54.429286 [ 16949 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:00:54.432970 [ 16949 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:00:54.439763 [ 16949 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:00:54.443398 [ 16949 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:00:54.453186 [ 16949 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:00:54.455036 [ 16949 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:00:54.456490 [ 16949 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:00:54.456626 [ 16949 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:00:54.456712 [ 16960 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:00:54.457584 [ 16960 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:00:59.111075 [ 16949 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:00:59.111559 [ 16949 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:00:59.111991 [ 16949 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:00:59.112061 [ 16949 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:00:59.112225 [ 16959 ] {} CancellationChecker: Execution took 6026 ms. 2025.04.02 04:00:59.112520 [ 16949 ] {} Application: Shutting down storages. 2025.04.02 04:00:59.112588 [ 16949 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:00:59.119688 [ 16949 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:00:59.119762 [ 16949 ] {} Context: Shutting down workload entity storage 2025.04.02 04:00:59.119791 [ 16949 ] {} Context: Shutting down named sessions 2025.04.02 04:00:59.119850 [ 16949 ] {} Context: Shutting down database catalog 2025.04.02 04:00:59.119885 [ 16949 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:00:59.119942 [ 16949 ] {} Context: Shutting down merges executor 2025.04.02 04:00:59.120432 [ 16949 ] {} Context: Shutting down fetches executor 2025.04.02 04:00:59.121046 [ 16949 ] {} Context: Shutting down moves executor 2025.04.02 04:00:59.121235 [ 16949 ] {} Context: Shutting down common executor 2025.04.02 04:00:59.121483 [ 16949 ] {} Context: Shutting down DDLWorker 2025.04.02 04:00:59.121519 [ 16949 ] {} Context: Shutting down caches 2025.04.02 04:00:59.121571 [ 16949 ] {} Context: Shutting down AccessControl 2025.04.02 04:00:59.121805 [ 16949 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:00:59.123941 [ 16949 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:00:59.204847 [ 16949 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:00:59.205399 [ 16949 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:00:59.206163 [ 16949 ] {} Application: Shut down storages. 2025.04.02 04:00:59.206247 [ 16949 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:00:59.318717 [ 16949 ] {} Application: Closed all listening sockets. 2025.04.02 04:00:59.318861 [ 16949 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:00:59.318966 [ 16949 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:00:59.811666 [ 16949 ] {} RaftInstance: shutting down raft core 2025.04.02 04:00:59.811816 [ 16949 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:00:59.811917 [ 16949 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:00:59.812002 [ 16949 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:00:59.812058 [ 16949 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:00:59.812104 [ 16949 ] {} RaftInstance: reset all pointers. 2025.04.02 04:00:59.812146 [ 16949 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:00:59.812359 [ 16949 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:00:59.812424 [ 17562 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:00:59.812696 [ 16949 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:00:59.812763 [ 16949 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:00:59.812805 [ 16949 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:00:59.813054 [ 17548 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:00:59.813337 [ 17547 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:00:59.813340 [ 17552 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:00:59.813516 [ 17548 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:00:59.813674 [ 17551 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:00:59.813550 [ 17549 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:00:59.813892 [ 17555 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:00:59.813923 [ 17554 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:00:59.813869 [ 17546 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:00:59.814051 [ 17557 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:00:59.813897 [ 17560 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:00:59.814150 [ 17545 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:00:59.814144 [ 17556 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:00:59.814283 [ 17558 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:00:59.813892 [ 17553 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:00:59.814143 [ 17559 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:00:59.814550 [ 17550 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:00:59.814841 [ 16949 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:00:59.814966 [ 17544 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:00:59.815549 [ 16949 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:00:59.815694 [ 16949 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:00:59.815738 [ 16949 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:00:59.815805 [ 16949 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:00:59.815851 [ 16949 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:59.816015 [ 16949 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:00:59.816083 [ 16949 ] {} Context: Destructing threadpool writer 2025.04.02 04:00:59.819974 [ 16949 ] {} Application: Destroyed global context. 2025.04.02 04:00:59.820560 [ 16949 ] {} Application: Waiting for background threads 2025.04.02 04:00:59.993662 [ 16949 ] {} Application: Background threads finished in 173 ms 2025.04.02 04:00:59.994482 [ 16949 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:00:59.994575 [ 16949 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:01:00.107782 [ 16949 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:01:00.108200 [ 16949 ] {} Application: shutting down 2025.04.02 04:01:00.108252 [ 16949 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:01:00.119491 [ 16952 ] {} BaseDaemon: Received signal -2 2025.04.02 04:01:00.119644 [ 16952 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:01:00.357658 [ 16947 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:01:00.594136 [ 17679 ] {} Application: Will watch for the process with pid 17681 2025.04.02 04:01:00.595309 [ 17681 ] {} Application: Forked a child process to watch 2025.04.02 04:01:00.596567 [ 17681 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:01:01.095075 [ 17681 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 17681 2025.04.02 04:01:01.096096 [ 17681 ] {} Application: starting up 2025.04.02 04:01:01.096201 [ 17681 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:01:01.130314 [ 17681 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:01:01.130482 [ 17681 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:01:01.130716 [ 17681 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:01:01.130788 [ 17681 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:01:01.130825 [ 17681 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:01:01.130860 [ 17681 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:01:01.132853 [ 17681 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:01:01.133303 [ 17681 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:01:01.133355 [ 17681 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:01:01.133551 [ 17681 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:01:01.133605 [ 17681 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:01:02.019014 [ 17681 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:01:02.021316 [ 17681 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:01:02.021412 [ 17681 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:01:02.021601 [ 17681 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:01:02.022363 [ 17681 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:01:02.199766 [ 17691 ] {} CancellationChecker: Started worker function 2025.04.02 04:01:02.200151 [ 17681 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:01:02.200267 [ 17681 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:01:02.200378 [ 17681 ] {} Application: Initializing DateLUT. 2025.04.02 04:01:02.200458 [ 17681 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:01:02.200848 [ 17681 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:01:02.201382 [ 17681 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:01:02.297084 [ 17681 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:01:02.297557 [ 17681 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:01:02.298359 [ 17681 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:01:02.299462 [ 17681 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:01:02.299688 [ 17681 ] {} Application: Initializing interserver credentials. 2025.04.02 04:01:02.301603 [ 17681 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:01:02.312203 [ 17681 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:01:02.313091 [ 17681 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:01:02.334128 [ 17681 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:01:02.334314 [ 17681 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:01:02.349199 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:01:02.351321 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:01:02.352164 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:01:02.353164 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:01:02.354131 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:01:02.430569 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:01:02.431890 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:01:02.432850 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:01:02.433742 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:01:02.434577 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:01:02.435654 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:01:02.436357 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:01:02.437218 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:01:02.437951 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:01:02.439031 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:01:02.439687 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:01:02.440383 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:01:02.441188 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:01:02.442072 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:01:02.442955 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:01:02.443802 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:01:02.444598 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:01:02.446115 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:01:02.448424 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:01:02.449187 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:01:02.451012 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:01:02.453340 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:01:02.454156 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:01:02.454969 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:01:02.455690 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:01:02.456484 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:01:02.457214 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:01:02.458060 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:01:02.458829 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:01:02.459770 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:01:02.460483 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:01:02.461422 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:01:02.462549 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:01:02.463430 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:01:02.465471 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:01:02.466740 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:01:02.467645 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:01:02.468604 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:01:02.469430 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:01:02.470615 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:01:02.471439 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:01:02.472308 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:01:02.473192 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:01:02.479040 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:01:02.480967 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:01:02.483067 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:01:02.484509 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:01:02.485413 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:01:02.486259 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:01:02.487677 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:01:02.488759 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:01:02.490032 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:01:02.490946 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:01:02.491989 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:01:02.492918 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:01:02.494287 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:01:02.495196 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:01:02.496194 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:01:02.497100 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:01:02.497751 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:01:02.499813 [ 17681 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:01:02.579246 [ 17681 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:01:02.580905 [ 17681 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:01:02.616739 [ 17681 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:01:02.616807 [ 17681 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:01:02.616843 [ 17681 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:01:02.632016 [ 17681 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:01:02.632073 [ 17681 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:01:02.632131 [ 17681 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:01:02.632260 [ 17681 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:01:02.639971 [ 17681 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:01:02.648302 [ 17681 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:01:02.748941 [ 17681 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:01:02.749177 [ 17681 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:01:02.753239 [ 17681 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:01:02.754663 [ 17681 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:01:02.756476 [ 17681 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:01:02.756599 [ 17681 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:01:02.759392 [ 17681 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:01:02.759459 [ 17681 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:01:02.759509 [ 17681 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:01:02.759610 [ 17681 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 04:01:02.759663 [ 17681 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:01:02.759950 [ 17681 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:01:02.760064 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:02.929225 [ 17681 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:01:02.939481 [ 17681 ] {} S3Client: Provider type: Unknown 2025.04.02 04:01:02.939580 [ 17681 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:01:02.940613 [ 17681 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/gzf/xgqtqazqiympmdvvybnzgnozxkkjs 2025.04.02 04:01:02.941093 [ 17681 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/gzf/xgqtqazqiympmdvvybnzgnozxkkjs. 2025.04.02 04:01:02.948736 [ 18263 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/gzf/xgqtqazqiympmdvvybnzgnozxkkjs, size 4 2025.04.02 04:01:02.949434 [ 17681 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/gzf/xgqtqazqiympmdvvybnzgnozxkkjs. 2025.04.02 04:01:03.056760 [ 17681 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/gzf/xgqtqazqiympmdvvybnzgnozxkkjs 2025.04.02 04:01:03.056857 [ 17681 ] {} deleteFileFromS3: Object with path s3/gzf/xgqtqazqiympmdvvybnzgnozxkkjs was removed from S3 2025.04.02 04:01:03.056973 [ 17681 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:01:03.057040 [ 17681 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:01:03.122419 [ 17681 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:01:03.418027 [ 17681 ] {} S3Client: Provider type: Unknown 2025.04.02 04:01:03.418120 [ 17681 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:01:03.443193 [ 17681 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:01:03.443456 [ 17681 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:01:03 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325DE98E52678A x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:01:03.443644 [ 17681 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:01:03.448958 [ 17681 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:01:03.449015 [ 17681 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:01:03.449094 [ 17681 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:01:03.449146 [ 17681 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:01:03.449271 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.449350 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.449422 [ 17681 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:01:03.449493 [ 17681 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:01:03.449591 [ 17681 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:01:03.449675 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.449791 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.449869 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.449950 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.450026 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.553042 [ 17681 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:01:03.565147 [ 17681 ] {} S3Client: Provider type: Unknown 2025.04.02 04:01:03.565244 [ 17681 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:01:03.583412 [ 17681 ] {} deleteFileFromS3: No blob storage log, not writing blob special/leq/lknkreziwzomadqsgzlmommfyuasj 2025.04.02 04:01:03.583479 [ 17681 ] {} deleteFileFromS3: Object with path special/leq/lknkreziwzomadqsgzlmommfyuasj was removed from S3 2025.04.02 04:01:03.583529 [ 17681 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:01:03.583584 [ 17681 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:01:03.587723 [ 17681 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:01:03.598352 [ 17681 ] {} S3Client: Provider type: Unknown 2025.04.02 04:01:03.598455 [ 17681 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:01:03.614120 [ 17681 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/rof/lkcxwvyctbkneavotlwnkvgjeezul 2025.04.02 04:01:03.614180 [ 17681 ] {} deleteFileFromS3: Object with path test_02944/rof/lkcxwvyctbkneavotlwnkvgjeezul was removed from S3 2025.04.02 04:01:03.614219 [ 17681 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:01:03.614252 [ 17681 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:01:03.614356 [ 17681 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:01:03.617709 [ 17681 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:01:03.621897 [ 17681 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:01:03.622011 [ 17681 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:01:03.623827 [ 17681 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:01:03.623986 [ 17681 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:01:03.625189 [ 17681 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:01:03.625241 [ 17681 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:01:03.625307 [ 17681 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:01:03.625347 [ 17681 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:01:03.625381 [ 17681 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:01:03.625950 [ 17681 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 23 entries 2025.04.02 04:01:03.626011 [ 17681 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:01:03.626106 [ 17681 ] {} KeeperServer: Last local log idx 23 2025.04.02 04:01:03.626153 [ 17681 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 23 2025.04.02 04:01:03.627399 [ 17681 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:01:03.638681 [ 17681 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:01:03.639040 [ 17681 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:01:03.639138 [ 17681 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:01:03.639191 [ 17681 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:01:03.639257 [ 17681 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:01:03.639296 [ 17681 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:01:03.639396 [ 17681 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 23 election timer allowed log store start 1, end 23 config log idx 23, prev log idx 22 -- ASYNC REPLICATION -- 2025.04.02 04:01:03.639437 [ 17681 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:01:03.639499 [ 17681 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:01:03.639570 [ 17681 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:01:03.640309 [ 17681 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:01:03.640477 [ 18294 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:01:03.690724 [ 18277 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:01:03.690929 [ 18277 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:01:03.691049 [ 18277 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 23, state term 23, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:01:03.691137 [ 18277 ] {} RaftInstance: pre-vote term (0) is different, reset it to 23 2025.04.02 04:01:03.691312 [ 17681 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:01:03.691404 [ 18277 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:01:03.694947 [ 18277 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 24, log idx 23, log term 23, priority (target 1 / mine 1) 2025.04.02 04:01:03.695016 [ 18277 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:01:03.695082 [ 18277 ] {} RaftInstance: state machine commit index 0, precommit index 23, last log index 23 2025.04.02 04:01:03.695139 [ 18277 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:01:03.695664 [ 18277 ] {} RaftInstance: [BECOME LEADER] appended new config at 24 2025.04.02 04:01:03.696002 [ 18293 ] {} RaftInstance: config at index 1 is committed, prev config log idx 23 2025.04.02 04:01:03.696103 [ 18293 ] {} RaftInstance: skipped config 1, latest config 23 2025.04.02 04:01:03.696224 [ 18293 ] {} RaftInstance: config at index 2 is committed, prev config log idx 23 2025.04.02 04:01:03.696267 [ 18293 ] {} RaftInstance: skipped config 2, latest config 23 2025.04.02 04:01:03.696345 [ 18293 ] {} RaftInstance: config at index 3 is committed, prev config log idx 23 2025.04.02 04:01:03.696389 [ 18293 ] {} RaftInstance: skipped config 3, latest config 23 2025.04.02 04:01:03.696464 [ 18293 ] {} RaftInstance: config at index 4 is committed, prev config log idx 23 2025.04.02 04:01:03.696510 [ 18293 ] {} RaftInstance: skipped config 4, latest config 23 2025.04.02 04:01:03.696598 [ 18293 ] {} RaftInstance: config at index 5 is committed, prev config log idx 23 2025.04.02 04:01:03.696634 [ 18293 ] {} RaftInstance: skipped config 5, latest config 23 2025.04.02 04:01:03.696707 [ 18293 ] {} RaftInstance: config at index 6 is committed, prev config log idx 23 2025.04.02 04:01:03.696743 [ 18293 ] {} RaftInstance: skipped config 6, latest config 23 2025.04.02 04:01:03.696813 [ 18293 ] {} RaftInstance: config at index 7 is committed, prev config log idx 23 2025.04.02 04:01:03.696850 [ 18293 ] {} RaftInstance: skipped config 7, latest config 23 2025.04.02 04:01:03.696919 [ 18293 ] {} RaftInstance: config at index 8 is committed, prev config log idx 23 2025.04.02 04:01:03.696975 [ 18293 ] {} RaftInstance: skipped config 8, latest config 23 2025.04.02 04:01:03.697058 [ 18293 ] {} RaftInstance: config at index 9 is committed, prev config log idx 23 2025.04.02 04:01:03.697091 [ 18293 ] {} RaftInstance: skipped config 9, latest config 23 2025.04.02 04:01:03.697159 [ 18293 ] {} RaftInstance: config at index 10 is committed, prev config log idx 23 2025.04.02 04:01:03.697195 [ 18293 ] {} RaftInstance: skipped config 10, latest config 23 2025.04.02 04:01:03.697266 [ 18293 ] {} RaftInstance: config at index 11 is committed, prev config log idx 23 2025.04.02 04:01:03.697301 [ 18293 ] {} RaftInstance: skipped config 11, latest config 23 2025.04.02 04:01:03.697370 [ 18293 ] {} RaftInstance: config at index 12 is committed, prev config log idx 23 2025.04.02 04:01:03.697403 [ 18293 ] {} RaftInstance: skipped config 12, latest config 23 2025.04.02 04:01:03.697471 [ 18293 ] {} RaftInstance: config at index 13 is committed, prev config log idx 23 2025.04.02 04:01:03.697510 [ 18293 ] {} RaftInstance: skipped config 13, latest config 23 2025.04.02 04:01:03.697592 [ 18293 ] {} RaftInstance: config at index 14 is committed, prev config log idx 23 2025.04.02 04:01:03.697622 [ 18293 ] {} RaftInstance: skipped config 14, latest config 23 2025.04.02 04:01:03.697680 [ 18293 ] {} RaftInstance: config at index 15 is committed, prev config log idx 23 2025.04.02 04:01:03.697709 [ 18293 ] {} RaftInstance: skipped config 15, latest config 23 2025.04.02 04:01:03.697775 [ 18293 ] {} RaftInstance: config at index 16 is committed, prev config log idx 23 2025.04.02 04:01:03.697805 [ 18293 ] {} RaftInstance: skipped config 16, latest config 23 2025.04.02 04:01:03.697863 [ 18293 ] {} RaftInstance: config at index 17 is committed, prev config log idx 23 2025.04.02 04:01:03.697896 [ 18293 ] {} RaftInstance: skipped config 17, latest config 23 2025.04.02 04:01:03.697953 [ 18293 ] {} RaftInstance: config at index 18 is committed, prev config log idx 23 2025.04.02 04:01:03.697992 [ 18293 ] {} RaftInstance: skipped config 18, latest config 23 2025.04.02 04:01:03.698045 [ 18293 ] {} RaftInstance: config at index 19 is committed, prev config log idx 23 2025.04.02 04:01:03.698074 [ 18293 ] {} RaftInstance: skipped config 19, latest config 23 2025.04.02 04:01:03.698126 [ 18293 ] {} RaftInstance: config at index 20 is committed, prev config log idx 23 2025.04.02 04:01:03.698156 [ 18293 ] {} RaftInstance: skipped config 20, latest config 23 2025.04.02 04:01:03.698216 [ 18293 ] {} RaftInstance: config at index 21 is committed, prev config log idx 23 2025.04.02 04:01:03.698244 [ 18293 ] {} RaftInstance: skipped config 21, latest config 23 2025.04.02 04:01:03.698301 [ 18293 ] {} RaftInstance: config at index 22 is committed, prev config log idx 23 2025.04.02 04:01:03.698340 [ 18293 ] {} RaftInstance: skipped config 22, latest config 23 2025.04.02 04:01:03.698473 [ 18293 ] {} RaftInstance: config at index 23 is committed, prev config log idx 23 2025.04.02 04:01:03.698512 [ 18293 ] {} RaftInstance: skipped config 23, latest config 23 2025.04.02 04:01:03.698611 [ 18293 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:01:03.698653 [ 18293 ] {} KeeperServer: Preprocessing done 2025.04.02 04:01:03.698704 [ 18293 ] {} RaftInstance: config at index 24 is committed, prev config log idx 23 2025.04.02 04:01:03.698760 [ 18293 ] {} RaftInstance: new config log idx 24, prev log idx 23, cur config log idx 23, prev log idx 22 2025.04.02 04:01:03.698851 [ 18293 ] {} RaftInstance: new configuration: log idx 24, prev log idx 23 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 24 2025.04.02 04:01:03.698987 [ 17681 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:01:03.700001 [ 17681 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:01:03.701891 [ 17681 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:01:03.702256 [ 17681 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:01:03.738696 [ 17681 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:01:03.738786 [ 17681 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:01:03.740005 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:01:03.740442 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:01:03.741123 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:01:03.741402 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:01:03.741659 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:01:03.741911 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:01:03.742185 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:01:03.742601 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:01:03.746871 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:01:03.747284 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:01:03.747707 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:01:03.748117 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:01:03.748568 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:01:03.748950 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:01:03.749353 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:01:03.749853 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:01:03.750272 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:01:03.750867 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:01:03.751324 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:01:03.751772 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:01:03.752214 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:01:03.752819 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:01:03.753812 [ 17681 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:01:03.774175 [ 17681 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:01:03.774372 [ 17681 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:01:03.788260 [ 17681 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:01:03.788345 [ 17681 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:01:03.791693 [ 17681 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:01:03.793001 [ 17681 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:01:03.793594 [ 17681 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:01:03.794117 [ 18300 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:01:03.803426 [ 17681 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:01:03.806990 [ 17681 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:01:03.813877 [ 17681 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:01:03.817731 [ 17681 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:01:03.827651 [ 17681 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:01:03.830344 [ 17681 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:01:03.832803 [ 17681 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:01:03.832977 [ 17681 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:01:03.833091 [ 17692 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:01:03.833953 [ 17692 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:01:08.591282 [ 17681 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:01:08.591756 [ 17681 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:01:08.592139 [ 17681 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:01:08.592207 [ 17681 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:01:08.592422 [ 17691 ] {} CancellationChecker: Execution took 6392 ms. 2025.04.02 04:01:08.592706 [ 17681 ] {} Application: Shutting down storages. 2025.04.02 04:01:08.592772 [ 17681 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:01:08.594185 [ 17681 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:01:08.594233 [ 17681 ] {} Context: Shutting down workload entity storage 2025.04.02 04:01:08.594260 [ 17681 ] {} Context: Shutting down named sessions 2025.04.02 04:01:08.594317 [ 17681 ] {} Context: Shutting down database catalog 2025.04.02 04:01:08.594357 [ 17681 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:01:08.594462 [ 17681 ] {} Context: Shutting down merges executor 2025.04.02 04:01:08.594872 [ 17681 ] {} Context: Shutting down fetches executor 2025.04.02 04:01:08.595205 [ 17681 ] {} Context: Shutting down moves executor 2025.04.02 04:01:08.595634 [ 17681 ] {} Context: Shutting down common executor 2025.04.02 04:01:08.595874 [ 17681 ] {} Context: Shutting down DDLWorker 2025.04.02 04:01:08.595922 [ 17681 ] {} Context: Shutting down caches 2025.04.02 04:01:08.595976 [ 17681 ] {} Context: Shutting down AccessControl 2025.04.02 04:01:08.596351 [ 17681 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:01:08.653192 [ 17681 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:01:08.693977 [ 17681 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:01:08.694735 [ 17681 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:01:08.695426 [ 17681 ] {} Application: Shut down storages. 2025.04.02 04:01:08.695711 [ 17681 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:01:08.708709 [ 17681 ] {} Application: Closed all listening sockets. 2025.04.02 04:01:08.708813 [ 17681 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:01:08.708872 [ 17681 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:01:09.202369 [ 17681 ] {} RaftInstance: shutting down raft core 2025.04.02 04:01:09.202538 [ 17681 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:01:09.202652 [ 17681 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:01:09.202706 [ 17681 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:01:09.202750 [ 17681 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:01:09.202791 [ 17681 ] {} RaftInstance: reset all pointers. 2025.04.02 04:01:09.202840 [ 17681 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:01:09.203030 [ 17681 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:01:09.203077 [ 18294 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:01:09.203279 [ 17681 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:01:09.203334 [ 17681 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:01:09.203374 [ 17681 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:01:09.203651 [ 18280 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:01:09.203818 [ 18277 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:01:09.203936 [ 18282 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:01:09.204076 [ 18286 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:01:09.204159 [ 18278 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:01:09.204475 [ 18292 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:01:09.204606 [ 18291 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:01:09.204488 [ 18290 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:01:09.204622 [ 18279 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:01:09.204889 [ 18285 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:01:09.204661 [ 18280 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:01:09.204629 [ 18288 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:01:09.204891 [ 18281 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:01:09.204918 [ 18283 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:01:09.204683 [ 18287 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:01:09.204802 [ 18289 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:01:09.204714 [ 18284 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:01:09.205632 [ 17681 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:01:09.205745 [ 18276 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:01:09.206380 [ 17681 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:01:09.206592 [ 17681 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:01:09.206641 [ 17681 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:01:09.206709 [ 17681 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:01:09.206756 [ 17681 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:01:09.206915 [ 17681 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:01:09.206969 [ 17681 ] {} Context: Destructing threadpool writer 2025.04.02 04:01:09.211058 [ 17681 ] {} Application: Destroyed global context. 2025.04.02 04:01:09.211853 [ 17681 ] {} Application: Waiting for background threads 2025.04.02 04:01:09.290964 [ 17681 ] {} Application: Background threads finished in 79 ms 2025.04.02 04:01:09.291681 [ 17681 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:01:09.291778 [ 17681 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:01:09.472030 [ 17681 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:01:09.472545 [ 17681 ] {} Application: shutting down 2025.04.02 04:01:09.472634 [ 17681 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:01:09.483811 [ 17684 ] {} BaseDaemon: Received signal -2 2025.04.02 04:01:09.483930 [ 17684 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:01:09.642762 [ 17679 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:06:30.813085 [ 18974 ] {} Application: Will watch for the process with pid 18976 2025.04.02 04:06:30.814277 [ 18976 ] {} Application: Forked a child process to watch 2025.04.02 04:06:30.815719 [ 18976 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:06:31.322851 [ 18976 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 18976 2025.04.02 04:06:31.323788 [ 18976 ] {} Application: starting up 2025.04.02 04:06:31.323891 [ 18976 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:06:31.356640 [ 18976 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:06:31.356782 [ 18976 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:06:31.357001 [ 18976 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:06:31.357065 [ 18976 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:06:31.357105 [ 18976 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:06:31.357131 [ 18976 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:06:31.358624 [ 18976 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:06:31.359110 [ 18976 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:06:31.359162 [ 18976 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:06:31.359333 [ 18976 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:06:31.359383 [ 18976 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:06:32.320817 [ 18976 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:06:32.323358 [ 18976 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:06:32.323436 [ 18976 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:06:32.323608 [ 18976 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:06:32.324348 [ 18976 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:06:32.508178 [ 18986 ] {} CancellationChecker: Started worker function 2025.04.02 04:06:32.508464 [ 18976 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:06:32.508515 [ 18976 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:06:32.508567 [ 18976 ] {} Application: Initializing DateLUT. 2025.04.02 04:06:32.508606 [ 18976 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:06:32.508901 [ 18976 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:06:32.509325 [ 18976 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:06:32.523219 [ 18976 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:06:32.523307 [ 18976 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:06:32.523618 [ 18976 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:06:32.524083 [ 18976 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:06:32.524192 [ 18976 ] {} Application: Initializing interserver credentials. 2025.04.02 04:06:32.525224 [ 18976 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:06:32.530943 [ 18976 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:06:32.531040 [ 18976 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:06:32.531135 [ 18976 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:06:32.531628 [ 18976 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:06:32.543715 [ 18976 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:06:32.543831 [ 18976 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:06:32.552369 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:06:32.553536 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:06:32.553974 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:06:32.554504 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:06:32.554956 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:06:32.555301 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:06:32.560072 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:06:32.560521 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:06:32.560981 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:06:32.561315 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:06:32.561680 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:06:32.562305 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:06:32.562725 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:06:32.563143 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:06:32.563470 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:06:32.563997 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:06:32.564350 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:06:32.564714 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:06:32.565098 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:06:32.565512 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:06:32.565910 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:06:32.566337 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:06:32.566749 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:06:32.567782 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:06:32.569282 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:06:32.569718 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:06:32.570790 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:06:32.571962 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:06:32.572442 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:06:32.572788 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:06:32.573172 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:06:32.573574 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:06:32.574047 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:06:32.574622 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:06:32.575031 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:06:32.575553 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:06:32.575969 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:06:32.576474 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:06:32.577010 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:06:32.577447 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:06:32.578675 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:06:32.579320 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:06:32.579722 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:06:32.580224 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:06:32.580743 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:06:32.581210 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:06:32.581763 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:06:32.582249 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:06:32.582823 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:06:32.583324 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:06:32.585929 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:06:32.586772 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:06:32.587764 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:06:32.588522 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:06:32.588980 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:06:32.589397 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:06:32.590120 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:06:32.590674 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:06:32.591299 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:06:32.591725 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:06:32.592188 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:06:32.592668 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:06:32.593339 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:06:32.593771 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:06:32.594341 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:06:32.595098 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:06:32.595588 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:06:32.597602 [ 18976 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:06:32.783334 [ 18976 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:06:32.785089 [ 18976 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:06:32.956948 [ 18976 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:06:32.957043 [ 18976 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:06:32.957081 [ 18976 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:06:33.172171 [ 18976 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:06:33.172264 [ 18976 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:06:33.172334 [ 18976 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:06:33.172490 [ 18976 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:33.178566 [ 18976 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:33.184534 [ 18976 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:33.277290 [ 18976 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:06:33.277728 [ 18976 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:06:33.277876 [ 18976 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:06:33.280262 [ 18976 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:06:33.280976 [ 18976 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:06:33.281248 [ 18976 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:06:33.282359 [ 18976 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:06:33.282469 [ 18976 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:06:33.284175 [ 18976 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:06:33.284223 [ 18976 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:06:33.284252 [ 18976 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:06:33.284298 [ 18976 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:06:33.284327 [ 18976 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:06:33.284510 [ 18976 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:33.284585 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.442284 [ 18976 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:33.453191 [ 18976 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:33.453256 [ 18976 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:33.454107 [ 18976 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:33.454222 [ 18976 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw 2025.04.02 04:06:33.454282 [ 18976 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw 2025.04.02 04:06:33.454332 [ 18976 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw, size 4 2025.04.02 04:06:33.454809 [ 18976 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw. 2025.04.02 04:06:33.454995 [ 19562 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw 2025.04.02 04:06:33.460246 [ 19562 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw, size 4 2025.04.02 04:06:33.460873 [ 18976 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw. 2025.04.02 04:06:33.461097 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.463704 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.463787 [ 18976 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw, Version: Latest, Offset: 2 2025.04.02 04:06:33.468758 [ 18976 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw 2025.04.02 04:06:33.468815 [ 18976 ] {} deleteFileFromS3: Object with path s3/dxt/qcmbmitnebpurdiisqaqpszxqjdfw was removed from S3 2025.04.02 04:06:33.468875 [ 18976 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:06:33.468919 [ 18976 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:06:33.471761 [ 18976 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:33.482524 [ 18976 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:33.482577 [ 18976 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:33.483087 [ 18976 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:33.490741 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.494543 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.494613 [ 18976 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:06:33.499975 [ 18976 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:06:33.500148 [ 18976 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:06:33 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E3667429D1E x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:06:33.500293 [ 18976 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:06:33.504279 [ 18976 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:33.504330 [ 18976 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:06:33.504373 [ 18976 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:06:33.504407 [ 18976 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:06:33.504484 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.504548 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.504612 [ 18976 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:33.504669 [ 18976 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:33.504724 [ 18976 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:06:33.504779 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.504845 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.504910 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.504964 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.505018 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.534933 [ 18976 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:33.563026 [ 18976 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:33.563086 [ 18976 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:33.563696 [ 18976 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:33.569723 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/hpt/iwzechyxkxgndlnxbeawinhqgjfsj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.572590 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/hpt/iwzechyxkxgndlnxbeawinhqgjfsj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.572663 [ 18976 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/hpt/iwzechyxkxgndlnxbeawinhqgjfsj, Version: Latest, Offset: 2 2025.04.02 04:06:33.577192 [ 18976 ] {} deleteFileFromS3: No blob storage log, not writing blob special/hpt/iwzechyxkxgndlnxbeawinhqgjfsj 2025.04.02 04:06:33.577244 [ 18976 ] {} deleteFileFromS3: Object with path special/hpt/iwzechyxkxgndlnxbeawinhqgjfsj was removed from S3 2025.04.02 04:06:33.577290 [ 18976 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:06:33.577329 [ 18976 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:06:33.580822 [ 18976 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:33.590414 [ 18976 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:33.590456 [ 18976 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:33.591045 [ 18976 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:33.596222 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/wom/emyuhezfcskirgvubkdrjnvkrasqw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.678955 [ 18976 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/wom/emyuhezfcskirgvubkdrjnvkrasqw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:33.679103 [ 18976 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/wom/emyuhezfcskirgvubkdrjnvkrasqw, Version: Latest, Offset: 2 2025.04.02 04:06:33.686593 [ 18976 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/wom/emyuhezfcskirgvubkdrjnvkrasqw 2025.04.02 04:06:33.686675 [ 18976 ] {} deleteFileFromS3: Object with path test_02944/wom/emyuhezfcskirgvubkdrjnvkrasqw was removed from S3 2025.04.02 04:06:33.686760 [ 18976 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:06:33.686821 [ 18976 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:06:33.686987 [ 18976 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:33.692209 [ 18976 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:33.698439 [ 18976 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:06:33.698694 [ 18976 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:06:33.701815 [ 18976 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:06:33.702145 [ 18976 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:06:33.703571 [ 18976 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:06:33.703695 [ 18976 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:06:33.703782 [ 18976 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:06:33.703875 [ 18976 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:06:33.703941 [ 18976 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:06:33.704788 [ 18976 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 24 entries 2025.04.02 04:06:33.704942 [ 18976 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:06:33.705142 [ 18976 ] {} KeeperServer: Last local log idx 24 2025.04.02 04:06:33.705240 [ 18976 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 24 2025.04.02 04:06:33.707517 [ 18976 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:06:33.723886 [ 18976 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:06:33.724433 [ 18976 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:06:33.724612 [ 18976 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:06:33.724729 [ 18976 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:06:33.724877 [ 18976 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:06:33.724971 [ 18976 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:06:33.725126 [ 18976 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 24 election timer allowed log store start 1, end 24 config log idx 24, prev log idx 23 -- ASYNC REPLICATION -- 2025.04.02 04:06:33.725205 [ 18976 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:06:33.725316 [ 18976 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:06:33.725415 [ 18976 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:06:33.726375 [ 18976 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:06:33.726591 [ 19589 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:06:33.776932 [ 19572 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:06:33.777158 [ 19572 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:06:33.777317 [ 19572 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 24, state term 24, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:06:33.777409 [ 19572 ] {} RaftInstance: pre-vote term (0) is different, reset it to 24 2025.04.02 04:06:33.777787 [ 19572 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:06:33.777937 [ 18976 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:06:33.781578 [ 19572 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 25, log idx 24, log term 24, priority (target 1 / mine 1) 2025.04.02 04:06:33.781692 [ 19572 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:06:33.781785 [ 19572 ] {} RaftInstance: state machine commit index 0, precommit index 24, last log index 24 2025.04.02 04:06:33.781906 [ 19572 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:06:33.782262 [ 19570 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:06:33.782484 [ 19572 ] {} RaftInstance: [BECOME LEADER] appended new config at 25 2025.04.02 04:06:33.783003 [ 19588 ] {} RaftInstance: config at index 1 is committed, prev config log idx 24 2025.04.02 04:06:33.783152 [ 19588 ] {} RaftInstance: skipped config 1, latest config 24 2025.04.02 04:06:33.783318 [ 19588 ] {} RaftInstance: config at index 2 is committed, prev config log idx 24 2025.04.02 04:06:33.783399 [ 19588 ] {} RaftInstance: skipped config 2, latest config 24 2025.04.02 04:06:33.783528 [ 19588 ] {} RaftInstance: config at index 3 is committed, prev config log idx 24 2025.04.02 04:06:33.783593 [ 19588 ] {} RaftInstance: skipped config 3, latest config 24 2025.04.02 04:06:33.783717 [ 19588 ] {} RaftInstance: config at index 4 is committed, prev config log idx 24 2025.04.02 04:06:33.783779 [ 19588 ] {} RaftInstance: skipped config 4, latest config 24 2025.04.02 04:06:33.783933 [ 19588 ] {} RaftInstance: config at index 5 is committed, prev config log idx 24 2025.04.02 04:06:33.783995 [ 19588 ] {} RaftInstance: skipped config 5, latest config 24 2025.04.02 04:06:33.784109 [ 19588 ] {} RaftInstance: config at index 6 is committed, prev config log idx 24 2025.04.02 04:06:33.784180 [ 19588 ] {} RaftInstance: skipped config 6, latest config 24 2025.04.02 04:06:33.784301 [ 19588 ] {} RaftInstance: config at index 7 is committed, prev config log idx 24 2025.04.02 04:06:33.784372 [ 19588 ] {} RaftInstance: skipped config 7, latest config 24 2025.04.02 04:06:33.784478 [ 19588 ] {} RaftInstance: config at index 8 is committed, prev config log idx 24 2025.04.02 04:06:33.784536 [ 19588 ] {} RaftInstance: skipped config 8, latest config 24 2025.04.02 04:06:33.784631 [ 19588 ] {} RaftInstance: config at index 9 is committed, prev config log idx 24 2025.04.02 04:06:33.784676 [ 19588 ] {} RaftInstance: skipped config 9, latest config 24 2025.04.02 04:06:33.784774 [ 19588 ] {} RaftInstance: config at index 10 is committed, prev config log idx 24 2025.04.02 04:06:33.784822 [ 19588 ] {} RaftInstance: skipped config 10, latest config 24 2025.04.02 04:06:33.784934 [ 19588 ] {} RaftInstance: config at index 11 is committed, prev config log idx 24 2025.04.02 04:06:33.784984 [ 19588 ] {} RaftInstance: skipped config 11, latest config 24 2025.04.02 04:06:33.785074 [ 19588 ] {} RaftInstance: config at index 12 is committed, prev config log idx 24 2025.04.02 04:06:33.785130 [ 19588 ] {} RaftInstance: skipped config 12, latest config 24 2025.04.02 04:06:33.785223 [ 19588 ] {} RaftInstance: config at index 13 is committed, prev config log idx 24 2025.04.02 04:06:33.785273 [ 19588 ] {} RaftInstance: skipped config 13, latest config 24 2025.04.02 04:06:33.785360 [ 19588 ] {} RaftInstance: config at index 14 is committed, prev config log idx 24 2025.04.02 04:06:33.785407 [ 19588 ] {} RaftInstance: skipped config 14, latest config 24 2025.04.02 04:06:33.785507 [ 19588 ] {} RaftInstance: config at index 15 is committed, prev config log idx 24 2025.04.02 04:06:33.785555 [ 19588 ] {} RaftInstance: skipped config 15, latest config 24 2025.04.02 04:06:33.785652 [ 19588 ] {} RaftInstance: config at index 16 is committed, prev config log idx 24 2025.04.02 04:06:33.785700 [ 19588 ] {} RaftInstance: skipped config 16, latest config 24 2025.04.02 04:06:33.785786 [ 19588 ] {} RaftInstance: config at index 17 is committed, prev config log idx 24 2025.04.02 04:06:33.785871 [ 19588 ] {} RaftInstance: skipped config 17, latest config 24 2025.04.02 04:06:33.785991 [ 19588 ] {} RaftInstance: config at index 18 is committed, prev config log idx 24 2025.04.02 04:06:33.786125 [ 19588 ] {} RaftInstance: skipped config 18, latest config 24 2025.04.02 04:06:33.786289 [ 19588 ] {} RaftInstance: config at index 19 is committed, prev config log idx 24 2025.04.02 04:06:33.786349 [ 19588 ] {} RaftInstance: skipped config 19, latest config 24 2025.04.02 04:06:33.786549 [ 19588 ] {} RaftInstance: config at index 20 is committed, prev config log idx 24 2025.04.02 04:06:33.786607 [ 19588 ] {} RaftInstance: skipped config 20, latest config 24 2025.04.02 04:06:33.786702 [ 19588 ] {} RaftInstance: config at index 21 is committed, prev config log idx 24 2025.04.02 04:06:33.786750 [ 19588 ] {} RaftInstance: skipped config 21, latest config 24 2025.04.02 04:06:33.786862 [ 19588 ] {} RaftInstance: config at index 22 is committed, prev config log idx 24 2025.04.02 04:06:33.786923 [ 19588 ] {} RaftInstance: skipped config 22, latest config 24 2025.04.02 04:06:33.787016 [ 19588 ] {} RaftInstance: config at index 23 is committed, prev config log idx 24 2025.04.02 04:06:33.787067 [ 19588 ] {} RaftInstance: skipped config 23, latest config 24 2025.04.02 04:06:33.787199 [ 19588 ] {} RaftInstance: config at index 24 is committed, prev config log idx 24 2025.04.02 04:06:33.787269 [ 19588 ] {} RaftInstance: skipped config 24, latest config 24 2025.04.02 04:06:33.787379 [ 19588 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:06:33.787441 [ 19588 ] {} KeeperServer: Preprocessing done 2025.04.02 04:06:33.787512 [ 19588 ] {} RaftInstance: config at index 25 is committed, prev config log idx 24 2025.04.02 04:06:33.787593 [ 19588 ] {} RaftInstance: new config log idx 25, prev log idx 24, cur config log idx 24, prev log idx 23 2025.04.02 04:06:33.787735 [ 19588 ] {} RaftInstance: new configuration: log idx 25, prev log idx 24 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 25 2025.04.02 04:06:33.787979 [ 18976 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:06:33.788913 [ 18976 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:06:33.791360 [ 18976 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:06:33.791944 [ 18976 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:06:33.890132 [ 18976 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:06:33.890225 [ 18976 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:06:33.891376 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:06:33.891770 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:06:33.892329 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:06:33.892619 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:06:33.892876 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:06:33.893108 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:06:33.893340 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:06:33.893666 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:06:33.897685 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:06:33.898084 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:06:33.898471 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:06:33.898864 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:06:33.899234 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:06:33.899598 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:06:33.899966 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:06:33.900390 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:06:33.900798 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:06:33.901296 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:06:33.901688 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:06:33.902105 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:06:33.902510 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:06:33.903022 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:06:33.903907 [ 18976 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:06:33.912397 [ 18976 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:06:33.912603 [ 18976 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:06:33.918972 [ 18976 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:06:33.919049 [ 18976 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:06:33.922008 [ 18976 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:06:33.923142 [ 18976 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:06:33.923769 [ 18976 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:06:33.924328 [ 19595 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:06:33.931622 [ 18976 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:06:33.934659 [ 18976 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:06:33.940539 [ 18976 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:06:33.943503 [ 18976 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:06:33.949140 [ 18976 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:06:33.951463 [ 18976 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:06:33.953172 [ 18976 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:06:33.954614 [ 18976 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:06:33.954713 [ 18976 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:06:33.954806 [ 18987 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:06:33.955513 [ 18987 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:06:38.760337 [ 18976 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:06:38.760794 [ 18976 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:06:38.761109 [ 18976 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:06:38.761171 [ 18976 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:06:38.761318 [ 18986 ] {} CancellationChecker: Execution took 6253 ms. 2025.04.02 04:06:38.761567 [ 18976 ] {} Application: Shutting down storages. 2025.04.02 04:06:38.761622 [ 18976 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:06:38.762873 [ 18976 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:06:38.762925 [ 18976 ] {} Context: Shutting down workload entity storage 2025.04.02 04:06:38.762965 [ 18976 ] {} Context: Shutting down named sessions 2025.04.02 04:06:38.763045 [ 18976 ] {} Context: Shutting down database catalog 2025.04.02 04:06:38.763094 [ 18976 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:06:38.763174 [ 18976 ] {} Context: Shutting down merges executor 2025.04.02 04:06:38.763636 [ 18976 ] {} Context: Shutting down fetches executor 2025.04.02 04:06:38.764231 [ 18976 ] {} Context: Shutting down moves executor 2025.04.02 04:06:38.764545 [ 18976 ] {} Context: Shutting down common executor 2025.04.02 04:06:38.764880 [ 18976 ] {} Context: Shutting down DDLWorker 2025.04.02 04:06:38.764929 [ 18976 ] {} Context: Shutting down caches 2025.04.02 04:06:38.764973 [ 18976 ] {} Context: Shutting down AccessControl 2025.04.02 04:06:38.765292 [ 18976 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:06:38.767704 [ 18976 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:06:38.850456 [ 18976 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:06:38.950665 [ 18976 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:06:38.951417 [ 18976 ] {} Application: Shut down storages. 2025.04.02 04:06:38.951495 [ 18976 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:06:39.048467 [ 18976 ] {} Application: Closed all listening sockets. 2025.04.02 04:06:39.048596 [ 18976 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:06:39.048698 [ 18976 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:06:39.290970 [ 18976 ] {} RaftInstance: shutting down raft core 2025.04.02 04:06:39.291128 [ 18976 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:06:39.291246 [ 18976 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:06:39.291318 [ 18976 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:06:39.291385 [ 18976 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:06:39.291442 [ 18976 ] {} RaftInstance: reset all pointers. 2025.04.02 04:06:39.291502 [ 18976 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:06:39.291645 [ 18976 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:06:39.291651 [ 19589 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:06:39.291905 [ 18976 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:06:39.291994 [ 18976 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:06:39.292054 [ 18976 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:06:39.292307 [ 19575 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:06:39.292608 [ 19572 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:06:39.292554 [ 19574 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:06:39.292651 [ 19573 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:06:39.292716 [ 19577 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:06:39.292882 [ 19575 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:06:39.292943 [ 19578 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:06:39.292984 [ 19586 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:06:39.293259 [ 19587 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:06:39.292990 [ 19583 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:06:39.293273 [ 19579 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:06:39.292992 [ 19585 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:06:39.293301 [ 19576 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:06:39.293009 [ 19581 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:06:39.293211 [ 19582 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:06:39.293280 [ 19580 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:06:39.293290 [ 19584 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:06:39.294058 [ 18976 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:06:39.294104 [ 19570 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:06:39.294224 [ 19571 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:06:39.294811 [ 18976 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:06:39.295013 [ 18976 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:06:39.295061 [ 18976 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:06:39.295125 [ 18976 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:06:39.295175 [ 18976 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:06:39.295323 [ 18976 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:06:39.295366 [ 18976 ] {} Context: Destructing threadpool writer 2025.04.02 04:06:39.298710 [ 18976 ] {} Application: Destroyed global context. 2025.04.02 04:06:39.299364 [ 18976 ] {} Application: Waiting for background threads 2025.04.02 04:06:39.366796 [ 18976 ] {} Application: Background threads finished in 67 ms 2025.04.02 04:06:39.367372 [ 18976 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:06:39.367433 [ 18976 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:06:39.382164 [ 18976 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:06:39.382608 [ 18976 ] {} Application: shutting down 2025.04.02 04:06:39.382672 [ 18976 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:06:39.389231 [ 18979 ] {} BaseDaemon: Received signal -2 2025.04.02 04:06:39.389329 [ 18979 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:06:39.520789 [ 18974 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:06:40.340789 [ 19711 ] {} Application: Will watch for the process with pid 19713 2025.04.02 04:06:40.341989 [ 19713 ] {} Application: Forked a child process to watch 2025.04.02 04:06:40.343408 [ 19713 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:06:40.941792 [ 19713 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 19713 2025.04.02 04:06:40.943064 [ 19713 ] {} Application: starting up 2025.04.02 04:06:40.943238 [ 19713 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:06:40.987358 [ 19713 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:06:40.987543 [ 19713 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:06:40.987802 [ 19713 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:06:40.987896 [ 19713 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:06:40.987948 [ 19713 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:06:40.987986 [ 19713 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:06:40.989281 [ 19713 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:06:40.989860 [ 19713 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:06:40.989920 [ 19713 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:06:40.990133 [ 19713 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:06:40.990202 [ 19713 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:06:42.078883 [ 19713 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:06:42.080951 [ 19713 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:06:42.081027 [ 19713 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:06:42.081198 [ 19713 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:06:42.081843 [ 19713 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:06:42.388014 [ 19727 ] {} CancellationChecker: Started worker function 2025.04.02 04:06:42.388340 [ 19713 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:06:42.388398 [ 19713 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:06:42.388450 [ 19713 ] {} Application: Initializing DateLUT. 2025.04.02 04:06:42.388494 [ 19713 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:06:42.388796 [ 19713 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:06:42.389256 [ 19713 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:06:42.406250 [ 19713 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:06:42.406455 [ 19713 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:06:42.406884 [ 19713 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:06:42.407472 [ 19713 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:06:42.407601 [ 19713 ] {} Application: Initializing interserver credentials. 2025.04.02 04:06:42.408783 [ 19713 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:06:42.414670 [ 19713 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:06:42.414748 [ 19713 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:06:42.414860 [ 19713 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:06:42.415290 [ 19713 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:06:42.426232 [ 19713 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:06:42.426323 [ 19713 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:06:42.433981 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:06:42.435077 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:06:42.435490 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:06:42.435969 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:06:42.436394 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:06:42.436716 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:06:42.441052 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:06:42.441458 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:06:42.441872 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:06:42.442208 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:06:42.442580 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:06:42.443046 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:06:42.443386 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:06:42.443726 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:06:42.444060 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:06:42.444562 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:06:42.444915 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:06:42.445272 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:06:42.445617 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:06:42.446031 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:06:42.446380 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:06:42.446794 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:06:42.447185 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:06:42.447897 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:06:42.448929 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:06:42.449271 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:06:42.450242 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:06:42.451414 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:06:42.451845 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:06:42.452191 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:06:42.452559 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:06:42.452971 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:06:42.453376 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:06:42.453855 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:06:42.454217 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:06:42.454707 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:06:42.455127 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:06:42.455616 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:06:42.456139 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:06:42.456569 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:06:42.457727 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:06:42.458348 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:06:42.458786 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:06:42.459226 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:06:42.459649 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:06:42.460123 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:06:42.460670 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:06:42.461125 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:06:42.461623 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:06:42.462130 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:06:42.464631 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:06:42.465454 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:06:42.466446 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:06:42.467084 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:06:42.467515 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:06:42.467935 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:06:42.468646 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:06:42.469115 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:06:42.469666 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:06:42.470074 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:06:42.470534 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:06:42.470976 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:06:42.471639 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:06:42.472058 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:06:42.472580 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:06:42.473278 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:06:42.473778 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:06:42.475612 [ 19713 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:06:42.602782 [ 19713 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:06:42.605072 [ 19713 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:06:42.748687 [ 19713 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:06:42.748850 [ 19713 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:06:42.748920 [ 19713 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:06:42.767097 [ 19713 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:06:42.767172 [ 19713 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:06:42.767229 [ 19713 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:06:42.767352 [ 19713 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:42.773285 [ 19713 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:42.779062 [ 19713 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:42.816988 [ 19713 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:06:42.817664 [ 19713 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:06:42.817893 [ 19713 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:06:42.821044 [ 19713 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:06:42.821804 [ 19713 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:06:42.822175 [ 19713 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:06:42.899731 [ 19713 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:06:42.899895 [ 19713 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:06:42.902345 [ 19713 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:06:42.920688 [ 19713 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:06:42.920793 [ 19713 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:06:42.920899 [ 19713 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:06:42.920950 [ 19713 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:06:42.921348 [ 19713 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:42.921483 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.392271 [ 19713 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:43.407626 [ 19713 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:43.407747 [ 19713 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:43.409127 [ 19713 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:43.409295 [ 19713 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid 2025.04.02 04:06:43.409380 [ 19713 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid 2025.04.02 04:06:43.409459 [ 19713 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid, size 4 2025.04.02 04:06:43.410080 [ 19713 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid. 2025.04.02 04:06:43.410265 [ 20302 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid 2025.04.02 04:06:43.419196 [ 20302 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid, size 4 2025.04.02 04:06:43.420135 [ 19713 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid. 2025.04.02 04:06:43.420533 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.424723 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.424875 [ 19713 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid, Version: Latest, Offset: 2 2025.04.02 04:06:43.432700 [ 19713 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid 2025.04.02 04:06:43.432840 [ 19713 ] {} deleteFileFromS3: Object with path s3/rud/xlbzfcojvrwjkndjhfznwyxgiqgid was removed from S3 2025.04.02 04:06:43.432926 [ 19713 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:06:43.433001 [ 19713 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:06:43.496766 [ 19713 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:43.511833 [ 19713 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:43.511964 [ 19713 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:43.512883 [ 19713 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:43.523648 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.529604 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.529767 [ 19713 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:06:43.537866 [ 19713 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:06:43.538154 [ 19713 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:06:43 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E38BD898DAD x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:06:43.538445 [ 19713 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:06:43.544459 [ 19713 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:43.544581 [ 19713 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:06:43.544662 [ 19713 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:06:43.544706 [ 19713 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:06:43.544862 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.544989 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.545108 [ 19713 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:43.545193 [ 19713 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:43.545253 [ 19713 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:06:43.545312 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.545404 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.545518 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.545617 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.545707 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.549782 [ 19713 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:43.565238 [ 19713 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:43.565369 [ 19713 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:43.566475 [ 19713 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:43.572693 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/bea/zcpuansldrarobjtvdouatziohxav (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.576282 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/bea/zcpuansldrarobjtvdouatziohxav (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.576403 [ 19713 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/bea/zcpuansldrarobjtvdouatziohxav, Version: Latest, Offset: 2 2025.04.02 04:06:43.582322 [ 19713 ] {} deleteFileFromS3: No blob storage log, not writing blob special/bea/zcpuansldrarobjtvdouatziohxav 2025.04.02 04:06:43.582422 [ 19713 ] {} deleteFileFromS3: Object with path special/bea/zcpuansldrarobjtvdouatziohxav was removed from S3 2025.04.02 04:06:43.582475 [ 19713 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:06:43.582513 [ 19713 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:06:43.587345 [ 19713 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:43.703611 [ 19713 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:43.703699 [ 19713 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:43.704452 [ 19713 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:43.713142 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/tnr/yauqloveuoawloobwwzachodoegxz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.716556 [ 19713 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/tnr/yauqloveuoawloobwwzachodoegxz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:43.716657 [ 19713 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/tnr/yauqloveuoawloobwwzachodoegxz, Version: Latest, Offset: 2 2025.04.02 04:06:43.723110 [ 19713 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/tnr/yauqloveuoawloobwwzachodoegxz 2025.04.02 04:06:43.723186 [ 19713 ] {} deleteFileFromS3: Object with path test_02944/tnr/yauqloveuoawloobwwzachodoegxz was removed from S3 2025.04.02 04:06:43.723257 [ 19713 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:06:43.723301 [ 19713 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:06:43.723446 [ 19713 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:43.727541 [ 19713 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:43.732569 [ 19713 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:06:43.732722 [ 19713 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:06:43.734863 [ 19713 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:06:43.735090 [ 19713 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:06:43.736242 [ 19713 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:06:43.736314 [ 19713 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:06:43.736412 [ 19713 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:06:43.736460 [ 19713 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:06:43.736499 [ 19713 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:06:43.737218 [ 19713 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 25 entries 2025.04.02 04:06:43.737307 [ 19713 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:06:43.737453 [ 19713 ] {} KeeperServer: Last local log idx 25 2025.04.02 04:06:43.737517 [ 19713 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 25 2025.04.02 04:06:43.738951 [ 19713 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:06:43.840222 [ 19713 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:06:43.840748 [ 19713 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:06:43.840908 [ 19713 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:06:43.840991 [ 19713 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:06:43.841083 [ 19713 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:06:43.841154 [ 19713 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:06:43.841272 [ 19713 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 25 election timer allowed log store start 1, end 25 config log idx 25, prev log idx 24 -- ASYNC REPLICATION -- 2025.04.02 04:06:43.841331 [ 19713 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:06:43.841410 [ 19713 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:06:43.841496 [ 19713 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:06:43.842343 [ 19713 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:06:43.842574 [ 20331 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:06:43.992950 [ 20314 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:06:43.993235 [ 20314 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:06:43.993390 [ 20314 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 25, state term 25, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:06:43.993489 [ 20314 ] {} RaftInstance: pre-vote term (0) is different, reset it to 25 2025.04.02 04:06:43.993565 [ 19713 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:06:43.993886 [ 20314 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:06:43.998139 [ 20314 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 26, log idx 25, log term 25, priority (target 1 / mine 1) 2025.04.02 04:06:43.998293 [ 20314 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:06:43.998463 [ 20314 ] {} RaftInstance: state machine commit index 0, precommit index 25, last log index 25 2025.04.02 04:06:43.998582 [ 20314 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:06:43.999033 [ 20312 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:06:43.999239 [ 20314 ] {} RaftInstance: [BECOME LEADER] appended new config at 26 2025.04.02 04:06:43.999547 [ 20330 ] {} RaftInstance: config at index 1 is committed, prev config log idx 25 2025.04.02 04:06:43.999696 [ 20330 ] {} RaftInstance: skipped config 1, latest config 25 2025.04.02 04:06:43.999842 [ 20330 ] {} RaftInstance: config at index 2 is committed, prev config log idx 25 2025.04.02 04:06:43.999900 [ 20330 ] {} RaftInstance: skipped config 2, latest config 25 2025.04.02 04:06:44.000021 [ 20330 ] {} RaftInstance: config at index 3 is committed, prev config log idx 25 2025.04.02 04:06:44.000069 [ 20330 ] {} RaftInstance: skipped config 3, latest config 25 2025.04.02 04:06:44.000157 [ 20330 ] {} RaftInstance: config at index 4 is committed, prev config log idx 25 2025.04.02 04:06:44.000201 [ 20330 ] {} RaftInstance: skipped config 4, latest config 25 2025.04.02 04:06:44.000287 [ 20330 ] {} RaftInstance: config at index 5 is committed, prev config log idx 25 2025.04.02 04:06:44.000328 [ 20330 ] {} RaftInstance: skipped config 5, latest config 25 2025.04.02 04:06:44.000406 [ 20330 ] {} RaftInstance: config at index 6 is committed, prev config log idx 25 2025.04.02 04:06:44.000456 [ 20330 ] {} RaftInstance: skipped config 6, latest config 25 2025.04.02 04:06:44.000538 [ 20330 ] {} RaftInstance: config at index 7 is committed, prev config log idx 25 2025.04.02 04:06:44.000585 [ 20330 ] {} RaftInstance: skipped config 7, latest config 25 2025.04.02 04:06:44.000654 [ 20330 ] {} RaftInstance: config at index 8 is committed, prev config log idx 25 2025.04.02 04:06:44.000698 [ 20330 ] {} RaftInstance: skipped config 8, latest config 25 2025.04.02 04:06:44.000761 [ 20330 ] {} RaftInstance: config at index 9 is committed, prev config log idx 25 2025.04.02 04:06:44.000791 [ 20330 ] {} RaftInstance: skipped config 9, latest config 25 2025.04.02 04:06:44.000867 [ 20330 ] {} RaftInstance: config at index 10 is committed, prev config log idx 25 2025.04.02 04:06:44.000900 [ 20330 ] {} RaftInstance: skipped config 10, latest config 25 2025.04.02 04:06:44.000961 [ 20330 ] {} RaftInstance: config at index 11 is committed, prev config log idx 25 2025.04.02 04:06:44.000992 [ 20330 ] {} RaftInstance: skipped config 11, latest config 25 2025.04.02 04:06:44.001054 [ 20330 ] {} RaftInstance: config at index 12 is committed, prev config log idx 25 2025.04.02 04:06:44.001090 [ 20330 ] {} RaftInstance: skipped config 12, latest config 25 2025.04.02 04:06:44.001154 [ 20330 ] {} RaftInstance: config at index 13 is committed, prev config log idx 25 2025.04.02 04:06:44.001185 [ 20330 ] {} RaftInstance: skipped config 13, latest config 25 2025.04.02 04:06:44.001243 [ 20330 ] {} RaftInstance: config at index 14 is committed, prev config log idx 25 2025.04.02 04:06:44.001274 [ 20330 ] {} RaftInstance: skipped config 14, latest config 25 2025.04.02 04:06:44.001339 [ 20330 ] {} RaftInstance: config at index 15 is committed, prev config log idx 25 2025.04.02 04:06:44.001369 [ 20330 ] {} RaftInstance: skipped config 15, latest config 25 2025.04.02 04:06:44.001433 [ 20330 ] {} RaftInstance: config at index 16 is committed, prev config log idx 25 2025.04.02 04:06:44.001465 [ 20330 ] {} RaftInstance: skipped config 16, latest config 25 2025.04.02 04:06:44.001548 [ 20330 ] {} RaftInstance: config at index 17 is committed, prev config log idx 25 2025.04.02 04:06:44.001589 [ 20330 ] {} RaftInstance: skipped config 17, latest config 25 2025.04.02 04:06:44.001647 [ 20330 ] {} RaftInstance: config at index 18 is committed, prev config log idx 25 2025.04.02 04:06:44.001677 [ 20330 ] {} RaftInstance: skipped config 18, latest config 25 2025.04.02 04:06:44.001736 [ 20330 ] {} RaftInstance: config at index 19 is committed, prev config log idx 25 2025.04.02 04:06:44.001767 [ 20330 ] {} RaftInstance: skipped config 19, latest config 25 2025.04.02 04:06:44.001835 [ 20330 ] {} RaftInstance: config at index 20 is committed, prev config log idx 25 2025.04.02 04:06:44.001868 [ 20330 ] {} RaftInstance: skipped config 20, latest config 25 2025.04.02 04:06:44.001924 [ 20330 ] {} RaftInstance: config at index 21 is committed, prev config log idx 25 2025.04.02 04:06:44.001952 [ 20330 ] {} RaftInstance: skipped config 21, latest config 25 2025.04.02 04:06:44.002007 [ 20330 ] {} RaftInstance: config at index 22 is committed, prev config log idx 25 2025.04.02 04:06:44.002040 [ 20330 ] {} RaftInstance: skipped config 22, latest config 25 2025.04.02 04:06:44.002108 [ 20330 ] {} RaftInstance: config at index 23 is committed, prev config log idx 25 2025.04.02 04:06:44.002137 [ 20330 ] {} RaftInstance: skipped config 23, latest config 25 2025.04.02 04:06:44.002197 [ 20330 ] {} RaftInstance: config at index 24 is committed, prev config log idx 25 2025.04.02 04:06:44.002237 [ 20330 ] {} RaftInstance: skipped config 24, latest config 25 2025.04.02 04:06:44.002304 [ 20330 ] {} RaftInstance: config at index 25 is committed, prev config log idx 25 2025.04.02 04:06:44.002336 [ 20330 ] {} RaftInstance: skipped config 25, latest config 25 2025.04.02 04:06:44.002483 [ 20330 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:06:44.002531 [ 20330 ] {} KeeperServer: Preprocessing done 2025.04.02 04:06:44.002584 [ 20330 ] {} RaftInstance: config at index 26 is committed, prev config log idx 25 2025.04.02 04:06:44.002638 [ 20330 ] {} RaftInstance: new config log idx 26, prev log idx 25, cur config log idx 25, prev log idx 24 2025.04.02 04:06:44.002731 [ 20330 ] {} RaftInstance: new configuration: log idx 26, prev log idx 25 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 26 2025.04.02 04:06:44.002915 [ 19713 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:06:44.003951 [ 19713 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:06:44.005979 [ 19713 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:06:44.006637 [ 19713 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:06:44.192881 [ 19713 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:06:44.192992 [ 19713 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:06:44.194306 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:06:44.194866 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:06:44.195541 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:06:44.195898 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:06:44.196190 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:06:44.196470 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:06:44.196758 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:06:44.197166 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:06:44.202501 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:06:44.203107 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:06:44.203623 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:06:44.204165 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:06:44.204657 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:06:44.205184 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:06:44.205725 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:06:44.206359 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:06:44.207047 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:06:44.207785 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:06:44.208363 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:06:44.208974 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:06:44.209542 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:06:44.210211 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:06:44.211404 [ 19713 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:06:44.269377 [ 19713 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:06:44.269824 [ 19713 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:06:44.355298 [ 19713 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:06:44.355489 [ 19713 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:06:44.359970 [ 19713 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:06:44.362066 [ 19713 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:06:44.362791 [ 19713 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:06:44.363330 [ 20341 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:06:44.374602 [ 19713 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:06:44.378682 [ 19713 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:06:44.387248 [ 19713 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:06:44.391956 [ 19713 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:06:44.399823 [ 19713 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:06:44.402850 [ 19713 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:06:44.405080 [ 19713 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:06:44.407041 [ 19713 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:06:44.407186 [ 19713 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:06:44.407308 [ 19728 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:06:44.408599 [ 19728 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:06:49.068026 [ 19713 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:06:49.069402 [ 19713 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:06:49.069905 [ 19713 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:06:49.069988 [ 19713 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:06:49.070149 [ 19727 ] {} CancellationChecker: Execution took 6682 ms. 2025.04.02 04:06:49.070455 [ 19713 ] {} Application: Shutting down storages. 2025.04.02 04:06:49.070525 [ 19713 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:06:49.072187 [ 19713 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:06:49.072259 [ 19713 ] {} Context: Shutting down workload entity storage 2025.04.02 04:06:49.072303 [ 19713 ] {} Context: Shutting down named sessions 2025.04.02 04:06:49.072408 [ 19713 ] {} Context: Shutting down database catalog 2025.04.02 04:06:49.072462 [ 19713 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:06:49.072542 [ 19713 ] {} Context: Shutting down merges executor 2025.04.02 04:06:49.073020 [ 19713 ] {} Context: Shutting down fetches executor 2025.04.02 04:06:49.073442 [ 19713 ] {} Context: Shutting down moves executor 2025.04.02 04:06:49.073665 [ 19713 ] {} Context: Shutting down common executor 2025.04.02 04:06:49.073968 [ 19713 ] {} Context: Shutting down DDLWorker 2025.04.02 04:06:49.074056 [ 19713 ] {} Context: Shutting down caches 2025.04.02 04:06:49.074109 [ 19713 ] {} Context: Shutting down AccessControl 2025.04.02 04:06:49.074414 [ 19713 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:06:49.077322 [ 19713 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:06:49.088720 [ 19713 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:06:49.089030 [ 19713 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:06:49.089550 [ 19713 ] {} Application: Shut down storages. 2025.04.02 04:06:49.089603 [ 19713 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:06:49.263289 [ 19713 ] {} Application: Closed all listening sockets. 2025.04.02 04:06:49.263386 [ 19713 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:06:49.263452 [ 19713 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:06:49.505723 [ 19713 ] {} RaftInstance: shutting down raft core 2025.04.02 04:06:49.505876 [ 19713 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:06:49.505957 [ 19713 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:06:49.506014 [ 19713 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:06:49.506060 [ 19713 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:06:49.506105 [ 19713 ] {} RaftInstance: reset all pointers. 2025.04.02 04:06:49.506160 [ 19713 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:06:49.506293 [ 19713 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:06:49.506312 [ 20331 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:06:49.506540 [ 19713 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:06:49.506617 [ 19713 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:06:49.506661 [ 19713 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:06:49.507123 [ 20318 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:06:49.507402 [ 20315 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:06:49.507232 [ 20322 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:06:49.507384 [ 20314 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:06:49.507348 [ 20320 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:06:49.507698 [ 20316 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:06:49.507699 [ 20326 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:06:49.507756 [ 20323 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:06:49.507809 [ 20317 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:06:49.507764 [ 20321 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:06:49.507966 [ 20329 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:06:49.508008 [ 20324 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:06:49.507816 [ 20325 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:06:49.507983 [ 20328 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:06:49.507752 [ 20319 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:06:49.507889 [ 20327 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:06:49.508836 [ 19713 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:06:49.508881 [ 20312 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:06:49.509612 [ 19713 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:06:49.509823 [ 19713 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:06:49.509876 [ 19713 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:06:49.509945 [ 19713 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:06:49.509996 [ 19713 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:06:49.510224 [ 19713 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:06:49.510269 [ 19713 ] {} Context: Destructing threadpool writer 2025.04.02 04:06:49.513709 [ 19713 ] {} Application: Destroyed global context. 2025.04.02 04:06:49.514317 [ 19713 ] {} Application: Waiting for background threads 2025.04.02 04:06:49.588824 [ 19713 ] {} Application: Background threads finished in 74 ms 2025.04.02 04:06:49.589553 [ 19713 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:06:49.589629 [ 19713 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:06:49.603055 [ 19713 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:06:49.603451 [ 19713 ] {} Application: shutting down 2025.04.02 04:06:49.603501 [ 19713 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:06:49.619029 [ 19716 ] {} BaseDaemon: Received signal -2 2025.04.02 04:06:49.619313 [ 19716 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:06:49.758760 [ 19711 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:06:50.299017 [ 20448 ] {} Application: Will watch for the process with pid 20450 2025.04.02 04:06:50.300414 [ 20450 ] {} Application: Forked a child process to watch 2025.04.02 04:06:50.302238 [ 20450 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:06:50.869397 [ 20450 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 20450 2025.04.02 04:06:50.870325 [ 20450 ] {} Application: starting up 2025.04.02 04:06:50.870459 [ 20450 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:06:50.904448 [ 20450 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:06:50.904603 [ 20450 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:06:50.904845 [ 20450 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:06:50.904912 [ 20450 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:06:50.904955 [ 20450 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:06:50.904983 [ 20450 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:06:50.906776 [ 20450 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:06:50.907234 [ 20450 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:06:50.907285 [ 20450 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:06:50.907458 [ 20450 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:06:50.907512 [ 20450 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:06:51.845588 [ 20450 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:06:51.847784 [ 20450 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:06:51.847895 [ 20450 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:06:51.848075 [ 20450 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:06:51.849027 [ 20450 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:06:52.128336 [ 20976 ] {} CancellationChecker: Started worker function 2025.04.02 04:06:52.128753 [ 20450 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:06:52.128853 [ 20450 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:06:52.128914 [ 20450 ] {} Application: Initializing DateLUT. 2025.04.02 04:06:52.128956 [ 20450 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:06:52.129220 [ 20450 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:06:52.129642 [ 20450 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:06:52.148383 [ 20450 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:06:52.148544 [ 20450 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:06:52.148949 [ 20450 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:06:52.149581 [ 20450 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:06:52.149715 [ 20450 ] {} Application: Initializing interserver credentials. 2025.04.02 04:06:52.150995 [ 20450 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:06:52.156359 [ 20450 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:06:52.156477 [ 20450 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:06:52.156594 [ 20450 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:06:52.157102 [ 20450 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:06:52.168683 [ 20450 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:06:52.168783 [ 20450 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:06:52.177713 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:06:52.179194 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:06:52.179690 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:06:52.180295 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:06:52.180808 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:06:52.181167 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:06:52.186030 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:06:52.186622 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:06:52.187106 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:06:52.187512 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:06:52.188050 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:06:52.188668 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:06:52.189261 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:06:52.189703 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:06:52.190060 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:06:52.190689 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:06:52.191081 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:06:52.191509 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:06:52.191921 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:06:52.192331 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:06:52.192689 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:06:52.193145 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:06:52.193553 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:06:52.194305 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:06:52.195432 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:06:52.195877 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:06:52.197277 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:06:52.199349 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:06:52.200026 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:06:52.200574 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:06:52.201040 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:06:52.201557 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:06:52.202084 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:06:52.202654 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:06:52.203113 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:06:52.203604 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:06:52.204061 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:06:52.204589 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:06:52.205112 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:06:52.205535 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:06:52.206776 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:06:52.207411 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:06:52.207827 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:06:52.208280 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:06:52.208710 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:06:52.209158 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:06:52.209725 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:06:52.210217 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:06:52.210743 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:06:52.211272 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:06:52.213883 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:06:52.214941 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:06:52.216040 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:06:52.216680 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:06:52.217132 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:06:52.217551 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:06:52.218357 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:06:52.218895 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:06:52.219492 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:06:52.219919 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:06:52.220377 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:06:52.220817 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:06:52.221575 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:06:52.222012 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:06:52.222611 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:06:52.223335 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:06:52.223879 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:06:52.225747 [ 20450 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:06:52.345462 [ 20450 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:06:52.347428 [ 20450 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:06:52.519649 [ 20450 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:06:52.519779 [ 20450 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:06:52.519869 [ 20450 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:06:52.535941 [ 20450 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:06:52.536020 [ 20450 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:06:52.536079 [ 20450 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:06:52.536220 [ 20450 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:52.542899 [ 20450 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:52.548749 [ 20450 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:06:52.580801 [ 20450 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:06:52.581522 [ 20450 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:06:52.581753 [ 20450 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:06:52.585500 [ 20450 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:06:52.599464 [ 20450 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:06:52.599998 [ 20450 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:06:52.601747 [ 20450 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:06:52.601878 [ 20450 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:06:52.604542 [ 20450 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:06:52.604624 [ 20450 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:06:52.604666 [ 20450 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:06:52.604732 [ 20450 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:06:52.604782 [ 20450 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:06:52.605086 [ 20450 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:52.605195 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.097427 [ 20450 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:53.107496 [ 20450 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:53.107583 [ 20450 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:53.108663 [ 20450 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:53.108817 [ 20450 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw 2025.04.02 04:06:53.108886 [ 20450 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw 2025.04.02 04:06:53.108942 [ 20450 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw, size 4 2025.04.02 04:06:53.109522 [ 20450 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw. 2025.04.02 04:06:53.109668 [ 21036 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw 2025.04.02 04:06:53.172852 [ 21036 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw, size 4 2025.04.02 04:06:53.173597 [ 20450 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw. 2025.04.02 04:06:53.173949 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.177604 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.177717 [ 20450 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw, Version: Latest, Offset: 2 2025.04.02 04:06:53.184641 [ 20450 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw 2025.04.02 04:06:53.184735 [ 20450 ] {} deleteFileFromS3: Object with path s3/ssw/zsswmofhmjbvtvdftqwlxbgganqdw was removed from S3 2025.04.02 04:06:53.184822 [ 20450 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:06:53.184884 [ 20450 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:06:53.188830 [ 20450 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:53.201239 [ 20450 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:53.201359 [ 20450 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:53.202053 [ 20450 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:53.291697 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.298344 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.298508 [ 20450 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:06:53.307435 [ 20450 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:06:53.307752 [ 20450 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:06:53 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E3B03DAF878 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:06:53.308025 [ 20450 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:06:53.315094 [ 20450 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:53.315197 [ 20450 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:06:53.315279 [ 20450 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:06:53.315339 [ 20450 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:06:53.315504 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.315622 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.315727 [ 20450 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:53.315840 [ 20450 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:53.315938 [ 20450 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:06:53.316030 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.316120 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.316222 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.316308 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.316395 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.321034 [ 20450 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:53.337049 [ 20450 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:53.337183 [ 20450 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:53.338264 [ 20450 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:53.346015 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/eak/scudpohwiawnmkfzoshnfonudcdom (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.349565 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/eak/scudpohwiawnmkfzoshnfonudcdom (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.349684 [ 20450 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/eak/scudpohwiawnmkfzoshnfonudcdom, Version: Latest, Offset: 2 2025.04.02 04:06:53.422003 [ 20450 ] {} deleteFileFromS3: No blob storage log, not writing blob special/eak/scudpohwiawnmkfzoshnfonudcdom 2025.04.02 04:06:53.422086 [ 20450 ] {} deleteFileFromS3: Object with path special/eak/scudpohwiawnmkfzoshnfonudcdom was removed from S3 2025.04.02 04:06:53.422145 [ 20450 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:06:53.422188 [ 20450 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:06:53.425937 [ 20450 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:06:53.436133 [ 20450 ] {} S3Client: Provider type: Unknown 2025.04.02 04:06:53.436214 [ 20450 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:06:53.436972 [ 20450 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:06:53.444779 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gaj/feylmmxvdaewdkvmoceeoijkwehsa (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.447903 [ 20450 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gaj/feylmmxvdaewdkvmoceeoijkwehsa (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:06:53.447989 [ 20450 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/gaj/feylmmxvdaewdkvmoceeoijkwehsa, Version: Latest, Offset: 2 2025.04.02 04:06:53.454285 [ 20450 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/gaj/feylmmxvdaewdkvmoceeoijkwehsa 2025.04.02 04:06:53.454360 [ 20450 ] {} deleteFileFromS3: Object with path test_02944/gaj/feylmmxvdaewdkvmoceeoijkwehsa was removed from S3 2025.04.02 04:06:53.454469 [ 20450 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:06:53.454514 [ 20450 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:06:53.454665 [ 20450 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:06:53.458191 [ 20450 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:06:53.462549 [ 20450 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:06:53.462676 [ 20450 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:06:53.464503 [ 20450 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:06:53.464692 [ 20450 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:06:53.465759 [ 20450 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:06:53.465833 [ 20450 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:06:53.465910 [ 20450 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:06:53.465948 [ 20450 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:06:53.465979 [ 20450 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:06:53.466544 [ 20450 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 26 entries 2025.04.02 04:06:53.466612 [ 20450 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:06:53.466738 [ 20450 ] {} KeeperServer: Last local log idx 26 2025.04.02 04:06:53.466816 [ 20450 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 26 2025.04.02 04:06:53.467949 [ 20450 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:06:53.485101 [ 20450 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:06:53.485554 [ 20450 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:06:53.485672 [ 20450 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:06:53.485733 [ 20450 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:06:53.485819 [ 20450 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:06:53.485880 [ 20450 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:06:53.485975 [ 20450 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 26 election timer allowed log store start 1, end 26 config log idx 26, prev log idx 25 -- ASYNC REPLICATION -- 2025.04.02 04:06:53.486019 [ 20450 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:06:53.486083 [ 20450 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:06:53.486149 [ 20450 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:06:53.486943 [ 20450 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:06:53.487082 [ 21067 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:06:53.537596 [ 21050 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:06:53.537862 [ 21050 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:06:53.538070 [ 21050 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 26, state term 26, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:06:53.538095 [ 20450 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:06:53.538164 [ 21050 ] {} RaftInstance: pre-vote term (0) is different, reset it to 26 2025.04.02 04:06:53.538681 [ 21050 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:06:53.543600 [ 21050 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 27, log idx 26, log term 26, priority (target 1 / mine 1) 2025.04.02 04:06:53.543780 [ 21050 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:06:53.543938 [ 21050 ] {} RaftInstance: state machine commit index 0, precommit index 26, last log index 26 2025.04.02 04:06:53.544058 [ 21050 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:06:53.544360 [ 21048 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:06:53.544600 [ 21050 ] {} RaftInstance: [BECOME LEADER] appended new config at 27 2025.04.02 04:06:53.545111 [ 21066 ] {} RaftInstance: config at index 1 is committed, prev config log idx 26 2025.04.02 04:06:53.545264 [ 21066 ] {} RaftInstance: skipped config 1, latest config 26 2025.04.02 04:06:53.545406 [ 21066 ] {} RaftInstance: config at index 2 is committed, prev config log idx 26 2025.04.02 04:06:53.545464 [ 21066 ] {} RaftInstance: skipped config 2, latest config 26 2025.04.02 04:06:53.545547 [ 21066 ] {} RaftInstance: config at index 3 is committed, prev config log idx 26 2025.04.02 04:06:53.545589 [ 21066 ] {} RaftInstance: skipped config 3, latest config 26 2025.04.02 04:06:53.545669 [ 21066 ] {} RaftInstance: config at index 4 is committed, prev config log idx 26 2025.04.02 04:06:53.545711 [ 21066 ] {} RaftInstance: skipped config 4, latest config 26 2025.04.02 04:06:53.545805 [ 21066 ] {} RaftInstance: config at index 5 is committed, prev config log idx 26 2025.04.02 04:06:53.545848 [ 21066 ] {} RaftInstance: skipped config 5, latest config 26 2025.04.02 04:06:53.545923 [ 21066 ] {} RaftInstance: config at index 6 is committed, prev config log idx 26 2025.04.02 04:06:53.545980 [ 21066 ] {} RaftInstance: skipped config 6, latest config 26 2025.04.02 04:06:53.546057 [ 21066 ] {} RaftInstance: config at index 7 is committed, prev config log idx 26 2025.04.02 04:06:53.546104 [ 21066 ] {} RaftInstance: skipped config 7, latest config 26 2025.04.02 04:06:53.546182 [ 21066 ] {} RaftInstance: config at index 8 is committed, prev config log idx 26 2025.04.02 04:06:53.546242 [ 21066 ] {} RaftInstance: skipped config 8, latest config 26 2025.04.02 04:06:53.546328 [ 21066 ] {} RaftInstance: config at index 9 is committed, prev config log idx 26 2025.04.02 04:06:53.546376 [ 21066 ] {} RaftInstance: skipped config 9, latest config 26 2025.04.02 04:06:53.546522 [ 21066 ] {} RaftInstance: config at index 10 is committed, prev config log idx 26 2025.04.02 04:06:53.546568 [ 21066 ] {} RaftInstance: skipped config 10, latest config 26 2025.04.02 04:06:53.546648 [ 21066 ] {} RaftInstance: config at index 11 is committed, prev config log idx 26 2025.04.02 04:06:53.546689 [ 21066 ] {} RaftInstance: skipped config 11, latest config 26 2025.04.02 04:06:53.546810 [ 21066 ] {} RaftInstance: config at index 12 is committed, prev config log idx 26 2025.04.02 04:06:53.546862 [ 21066 ] {} RaftInstance: skipped config 12, latest config 26 2025.04.02 04:06:53.546942 [ 21066 ] {} RaftInstance: config at index 13 is committed, prev config log idx 26 2025.04.02 04:06:53.546982 [ 21066 ] {} RaftInstance: skipped config 13, latest config 26 2025.04.02 04:06:53.547057 [ 21066 ] {} RaftInstance: config at index 14 is committed, prev config log idx 26 2025.04.02 04:06:53.547115 [ 21066 ] {} RaftInstance: skipped config 14, latest config 26 2025.04.02 04:06:53.547216 [ 21066 ] {} RaftInstance: config at index 15 is committed, prev config log idx 26 2025.04.02 04:06:53.547263 [ 21066 ] {} RaftInstance: skipped config 15, latest config 26 2025.04.02 04:06:53.547344 [ 21066 ] {} RaftInstance: config at index 16 is committed, prev config log idx 26 2025.04.02 04:06:53.547387 [ 21066 ] {} RaftInstance: skipped config 16, latest config 26 2025.04.02 04:06:53.547467 [ 21066 ] {} RaftInstance: config at index 17 is committed, prev config log idx 26 2025.04.02 04:06:53.547514 [ 21066 ] {} RaftInstance: skipped config 17, latest config 26 2025.04.02 04:06:53.547587 [ 21066 ] {} RaftInstance: config at index 18 is committed, prev config log idx 26 2025.04.02 04:06:53.547629 [ 21066 ] {} RaftInstance: skipped config 18, latest config 26 2025.04.02 04:06:53.547705 [ 21066 ] {} RaftInstance: config at index 19 is committed, prev config log idx 26 2025.04.02 04:06:53.547756 [ 21066 ] {} RaftInstance: skipped config 19, latest config 26 2025.04.02 04:06:53.547856 [ 21066 ] {} RaftInstance: config at index 20 is committed, prev config log idx 26 2025.04.02 04:06:53.547891 [ 21066 ] {} RaftInstance: skipped config 20, latest config 26 2025.04.02 04:06:53.547956 [ 21066 ] {} RaftInstance: config at index 21 is committed, prev config log idx 26 2025.04.02 04:06:53.547990 [ 21066 ] {} RaftInstance: skipped config 21, latest config 26 2025.04.02 04:06:53.548055 [ 21066 ] {} RaftInstance: config at index 22 is committed, prev config log idx 26 2025.04.02 04:06:53.548098 [ 21066 ] {} RaftInstance: skipped config 22, latest config 26 2025.04.02 04:06:53.548163 [ 21066 ] {} RaftInstance: config at index 23 is committed, prev config log idx 26 2025.04.02 04:06:53.548210 [ 21066 ] {} RaftInstance: skipped config 23, latest config 26 2025.04.02 04:06:53.548282 [ 21066 ] {} RaftInstance: config at index 24 is committed, prev config log idx 26 2025.04.02 04:06:53.548327 [ 21066 ] {} RaftInstance: skipped config 24, latest config 26 2025.04.02 04:06:53.548396 [ 21066 ] {} RaftInstance: config at index 25 is committed, prev config log idx 26 2025.04.02 04:06:53.548434 [ 21066 ] {} RaftInstance: skipped config 25, latest config 26 2025.04.02 04:06:53.548503 [ 21066 ] {} RaftInstance: config at index 26 is committed, prev config log idx 26 2025.04.02 04:06:53.548537 [ 21066 ] {} RaftInstance: skipped config 26, latest config 26 2025.04.02 04:06:53.548627 [ 21066 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:06:53.548670 [ 21066 ] {} KeeperServer: Preprocessing done 2025.04.02 04:06:53.548720 [ 21066 ] {} RaftInstance: config at index 27 is committed, prev config log idx 26 2025.04.02 04:06:53.548800 [ 21066 ] {} RaftInstance: new config log idx 27, prev log idx 26, cur config log idx 26, prev log idx 25 2025.04.02 04:06:53.548910 [ 21066 ] {} RaftInstance: new configuration: log idx 27, prev log idx 26 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 27 2025.04.02 04:06:53.549152 [ 20450 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:06:53.550371 [ 20450 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:06:53.552512 [ 20450 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:06:53.552949 [ 20450 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:06:53.571492 [ 20450 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:06:53.571611 [ 20450 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:06:53.572881 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:06:53.573331 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:06:53.573976 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:06:53.574300 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:06:53.574678 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:06:53.574968 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:06:53.575214 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:06:53.575547 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:06:53.579757 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:06:53.580260 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:06:53.580643 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:06:53.581041 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:06:53.581414 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:06:53.581769 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:06:53.582179 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:06:53.582666 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:06:53.583139 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:06:53.583679 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:06:53.584099 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:06:53.584526 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:06:53.584906 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:06:53.585352 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:06:53.586135 [ 20450 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:06:53.593523 [ 20450 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:06:53.593779 [ 20450 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:06:53.600802 [ 20450 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:06:53.600935 [ 20450 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:06:53.604503 [ 20450 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:06:53.605770 [ 20450 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:06:53.606565 [ 20450 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:06:53.607122 [ 21073 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:06:53.615529 [ 20450 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:06:53.618615 [ 20450 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:06:53.624837 [ 20450 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:06:53.628056 [ 20450 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:06:53.634513 [ 20450 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:06:53.636896 [ 20450 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:06:53.638435 [ 20450 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:06:53.639628 [ 20450 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:06:53.639754 [ 20450 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:06:53.639813 [ 20464 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:06:53.640851 [ 20464 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:06:58.294891 [ 20450 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:06:58.295570 [ 20450 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:06:58.296149 [ 20450 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:06:58.296220 [ 20450 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:06:58.296406 [ 20976 ] {} CancellationChecker: Execution took 6168 ms. 2025.04.02 04:06:58.296659 [ 20450 ] {} Application: Shutting down storages. 2025.04.02 04:06:58.296726 [ 20450 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:06:58.298350 [ 20450 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:06:58.331207 [ 20450 ] {} Context: Shutting down workload entity storage 2025.04.02 04:06:58.331302 [ 20450 ] {} Context: Shutting down named sessions 2025.04.02 04:06:58.331401 [ 20450 ] {} Context: Shutting down database catalog 2025.04.02 04:06:58.331461 [ 20450 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:06:58.331545 [ 20450 ] {} Context: Shutting down merges executor 2025.04.02 04:06:58.332236 [ 20450 ] {} Context: Shutting down fetches executor 2025.04.02 04:06:58.332907 [ 20450 ] {} Context: Shutting down moves executor 2025.04.02 04:06:58.333166 [ 20450 ] {} Context: Shutting down common executor 2025.04.02 04:06:58.333418 [ 20450 ] {} Context: Shutting down DDLWorker 2025.04.02 04:06:58.333471 [ 20450 ] {} Context: Shutting down caches 2025.04.02 04:06:58.333521 [ 20450 ] {} Context: Shutting down AccessControl 2025.04.02 04:06:58.333921 [ 20450 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:06:58.399960 [ 20450 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:06:58.401522 [ 20450 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:06:58.401945 [ 20450 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:06:58.402598 [ 20450 ] {} Application: Shut down storages. 2025.04.02 04:06:58.402647 [ 20450 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:06:58.809620 [ 20450 ] {} Application: Closed all listening sockets. 2025.04.02 04:06:58.809887 [ 20450 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:06:58.809980 [ 20450 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:06:59.052355 [ 20450 ] {} RaftInstance: shutting down raft core 2025.04.02 04:06:59.052655 [ 20450 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:06:59.052797 [ 20450 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:06:59.052905 [ 20450 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:06:59.052976 [ 20450 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:06:59.053032 [ 20450 ] {} RaftInstance: reset all pointers. 2025.04.02 04:06:59.053091 [ 20450 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:06:59.053365 [ 20450 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:06:59.053353 [ 21067 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:06:59.053674 [ 20450 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:06:59.053803 [ 20450 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:06:59.053866 [ 20450 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:06:59.054344 [ 21050 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:06:59.054268 [ 21053 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:06:59.054521 [ 21055 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:06:59.054507 [ 21052 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:06:59.054726 [ 21056 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:06:59.054745 [ 21057 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:06:59.054786 [ 21059 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:06:59.054797 [ 21051 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:06:59.055253 [ 21064 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:06:59.054876 [ 21060 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:06:59.055239 [ 21061 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:06:59.055427 [ 21053 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:06:59.054872 [ 21058 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:06:59.055132 [ 21063 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:06:59.055101 [ 21054 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:06:59.055151 [ 21062 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:06:59.055207 [ 21065 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:06:59.055929 [ 20450 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:06:59.055953 [ 21048 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:06:59.056107 [ 21049 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:06:59.056766 [ 20450 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:06:59.056942 [ 20450 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:06:59.056995 [ 20450 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:06:59.057058 [ 20450 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:06:59.057107 [ 20450 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:06:59.057292 [ 20450 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:06:59.057329 [ 20450 ] {} Context: Destructing threadpool writer 2025.04.02 04:06:59.061290 [ 20450 ] {} Application: Destroyed global context. 2025.04.02 04:06:59.061907 [ 20450 ] {} Application: Waiting for background threads 2025.04.02 04:06:59.139009 [ 20450 ] {} Application: Background threads finished in 77 ms 2025.04.02 04:06:59.139682 [ 20450 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:06:59.139747 [ 20450 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:06:59.156889 [ 20450 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:06:59.157188 [ 20450 ] {} Application: shutting down 2025.04.02 04:06:59.157224 [ 20450 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:06:59.165743 [ 20453 ] {} BaseDaemon: Received signal -2 2025.04.02 04:06:59.165897 [ 20453 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:06:59.327804 [ 20448 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:00.293350 [ 21185 ] {} Application: Will watch for the process with pid 21187 2025.04.02 04:07:00.294673 [ 21187 ] {} Application: Forked a child process to watch 2025.04.02 04:07:00.296008 [ 21187 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:00.997905 [ 21187 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 21187 2025.04.02 04:07:00.998905 [ 21187 ] {} Application: starting up 2025.04.02 04:07:00.998996 [ 21187 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:01.032136 [ 21187 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:01.032283 [ 21187 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:01.032501 [ 21187 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:01.032569 [ 21187 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:01.032609 [ 21187 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:01.032636 [ 21187 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:01.033901 [ 21187 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:01.034366 [ 21187 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:01.034439 [ 21187 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:01.034610 [ 21187 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:01.034661 [ 21187 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:02.049863 [ 21187 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:02.052106 [ 21187 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:02.052192 [ 21187 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:02.052376 [ 21187 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:02.053241 [ 21187 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:02.307846 [ 21713 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:02.308292 [ 21187 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:02.308374 [ 21187 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:02.308434 [ 21187 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:02.308480 [ 21187 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:02.308795 [ 21187 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:02.309258 [ 21187 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:02.329017 [ 21187 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:02.329209 [ 21187 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:02.329643 [ 21187 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:02.330282 [ 21187 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:02.330461 [ 21187 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:02.331655 [ 21187 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:02.337307 [ 21187 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:02.337405 [ 21187 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:02.337530 [ 21187 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:02.338030 [ 21187 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:02.354946 [ 21187 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:02.355067 [ 21187 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:02.387550 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:02.389286 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:02.389926 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:02.390656 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:02.391350 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:02.391909 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:02.399505 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:02.400373 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:02.401042 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:02.401585 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:02.402146 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:02.402902 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:02.403456 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:02.404014 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:02.404513 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:02.405327 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:02.405889 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:02.406520 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:02.407103 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:02.407751 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:02.408349 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:02.408973 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:02.409573 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:02.410751 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:02.412403 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:02.412960 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:02.414431 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:02.416229 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:02.416921 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:02.417502 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:02.418157 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:02.486073 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:02.487011 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:02.487843 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:02.488389 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:02.489029 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:02.489540 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:02.490117 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:02.490817 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:02.491329 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:02.492661 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:02.493381 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:02.493857 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:02.494303 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:02.494797 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:02.495263 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:02.495899 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:02.496399 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:02.496916 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:02.497472 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:02.500278 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:02.501253 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:02.502290 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:02.502960 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:02.503392 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:02.503841 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:02.504675 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:02.505214 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:02.505848 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:02.506270 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:02.506813 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:02.507275 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:02.508070 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:02.508532 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:02.509127 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:02.509921 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:02.510518 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:02.512838 [ 21187 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:02.672236 [ 21187 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:02.674578 [ 21187 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:02.713515 [ 21187 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:02.713649 [ 21187 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:02.713696 [ 21187 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:02.731207 [ 21187 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:02.731288 [ 21187 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:02.731345 [ 21187 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:02.731497 [ 21187 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:02.737153 [ 21187 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:02.744032 [ 21187 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:02.824689 [ 21187 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:02.825430 [ 21187 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:02.825655 [ 21187 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:02.828449 [ 21187 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:02.829278 [ 21187 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:02.829646 [ 21187 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:02.831044 [ 21187 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:02.831127 [ 21187 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:02.832892 [ 21187 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:02.832944 [ 21187 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:02.832987 [ 21187 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:02.833048 [ 21187 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:02.833099 [ 21187 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:02.833288 [ 21187 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:02.833401 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:02.992738 [ 21187 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:03.003575 [ 21187 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:03.003673 [ 21187 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:03.004750 [ 21187 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:03.004910 [ 21187 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw 2025.04.02 04:07:03.005037 [ 21187 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw 2025.04.02 04:07:03.005124 [ 21187 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw, size 4 2025.04.02 04:07:03.005616 [ 21187 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw. 2025.04.02 04:07:03.005729 [ 21773 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw 2025.04.02 04:07:03.012753 [ 21773 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw, size 4 2025.04.02 04:07:03.013474 [ 21187 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/chb/qswryysxizutslodsbhszwuxtksmw. 2025.04.02 04:07:03.013734 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/chb/qswryysxizutslodsbhszwuxtksmw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.016823 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/chb/qswryysxizutslodsbhszwuxtksmw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.016907 [ 21187 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/chb/qswryysxizutslodsbhszwuxtksmw, Version: Latest, Offset: 2 2025.04.02 04:07:03.022905 [ 21187 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/chb/qswryysxizutslodsbhszwuxtksmw 2025.04.02 04:07:03.022997 [ 21187 ] {} deleteFileFromS3: Object with path s3/chb/qswryysxizutslodsbhszwuxtksmw was removed from S3 2025.04.02 04:07:03.023090 [ 21187 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:03.023157 [ 21187 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:03.093126 [ 21187 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:03.106329 [ 21187 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:03.106480 [ 21187 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:03.107219 [ 21187 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:03.117114 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.123473 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.123595 [ 21187 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:03.188129 [ 21187 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:03.188421 [ 21187 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:03 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E3D50CD958F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:03.188624 [ 21187 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:03.194182 [ 21187 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:03.194273 [ 21187 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:03.194343 [ 21187 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:03.204633 [ 21187 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:03.204882 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.205019 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.205152 [ 21187 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:03.205250 [ 21187 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:03.205339 [ 21187 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:03.205424 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.205516 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.205614 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.205698 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.205807 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.209904 [ 21187 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:03.222149 [ 21187 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:03.222255 [ 21187 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:03.223273 [ 21187 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:03.231104 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/rjx/maaxlshtavwawqunshizpbtpnldue (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.234463 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/rjx/maaxlshtavwawqunshizpbtpnldue (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.234580 [ 21187 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/rjx/maaxlshtavwawqunshizpbtpnldue, Version: Latest, Offset: 2 2025.04.02 04:07:03.240125 [ 21187 ] {} deleteFileFromS3: No blob storage log, not writing blob special/rjx/maaxlshtavwawqunshizpbtpnldue 2025.04.02 04:07:03.240197 [ 21187 ] {} deleteFileFromS3: Object with path special/rjx/maaxlshtavwawqunshizpbtpnldue was removed from S3 2025.04.02 04:07:03.240263 [ 21187 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:03.240308 [ 21187 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:03.244287 [ 21187 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:03.254883 [ 21187 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:03.254988 [ 21187 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:03.255752 [ 21187 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:03.262264 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jls/nkvjuyyedikspfpjbfsrywhpckxxw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.265312 [ 21187 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jls/nkvjuyyedikspfpjbfsrywhpckxxw (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:03.265393 [ 21187 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/jls/nkvjuyyedikspfpjbfsrywhpckxxw, Version: Latest, Offset: 2 2025.04.02 04:07:03.271115 [ 21187 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/jls/nkvjuyyedikspfpjbfsrywhpckxxw 2025.04.02 04:07:03.271181 [ 21187 ] {} deleteFileFromS3: Object with path test_02944/jls/nkvjuyyedikspfpjbfsrywhpckxxw was removed from S3 2025.04.02 04:07:03.271243 [ 21187 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:03.271284 [ 21187 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:03.271422 [ 21187 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:03.274625 [ 21187 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:03.278850 [ 21187 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:03.278990 [ 21187 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:03.280646 [ 21187 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:03.280838 [ 21187 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:03.281697 [ 21187 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:03.281752 [ 21187 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:03.281854 [ 21187 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:03.281893 [ 21187 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:03.281924 [ 21187 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:03.282537 [ 21187 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 27 entries 2025.04.02 04:07:03.282606 [ 21187 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:03.282715 [ 21187 ] {} KeeperServer: Last local log idx 27 2025.04.02 04:07:03.282782 [ 21187 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 27 2025.04.02 04:07:03.283991 [ 21187 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:03.295364 [ 21187 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:03.295876 [ 21187 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:03.296060 [ 21187 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:03.296168 [ 21187 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:03.296269 [ 21187 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:03.296338 [ 21187 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:03.296473 [ 21187 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 27 election timer allowed log store start 1, end 27 config log idx 27, prev log idx 26 -- ASYNC REPLICATION -- 2025.04.02 04:07:03.296537 [ 21187 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:03.296621 [ 21187 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:03.296703 [ 21187 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:03.297420 [ 21187 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:03.297525 [ 21803 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:03.347896 [ 21786 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:03.348067 [ 21786 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:03.348187 [ 21786 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 27, state term 27, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:03.348249 [ 21786 ] {} RaftInstance: pre-vote term (0) is different, reset it to 27 2025.04.02 04:07:03.348519 [ 21786 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:03.348551 [ 21187 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:03.351972 [ 21786 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 28, log idx 27, log term 27, priority (target 1 / mine 1) 2025.04.02 04:07:03.352059 [ 21786 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:03.352122 [ 21786 ] {} RaftInstance: state machine commit index 0, precommit index 27, last log index 27 2025.04.02 04:07:03.352191 [ 21786 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:03.352607 [ 21784 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:03.352825 [ 21786 ] {} RaftInstance: [BECOME LEADER] appended new config at 28 2025.04.02 04:07:03.353162 [ 21802 ] {} RaftInstance: config at index 1 is committed, prev config log idx 27 2025.04.02 04:07:03.353245 [ 21802 ] {} RaftInstance: skipped config 1, latest config 27 2025.04.02 04:07:03.353367 [ 21802 ] {} RaftInstance: config at index 2 is committed, prev config log idx 27 2025.04.02 04:07:03.353447 [ 21802 ] {} RaftInstance: skipped config 2, latest config 27 2025.04.02 04:07:03.353530 [ 21802 ] {} RaftInstance: config at index 3 is committed, prev config log idx 27 2025.04.02 04:07:03.353569 [ 21802 ] {} RaftInstance: skipped config 3, latest config 27 2025.04.02 04:07:03.353684 [ 21802 ] {} RaftInstance: config at index 4 is committed, prev config log idx 27 2025.04.02 04:07:03.353721 [ 21802 ] {} RaftInstance: skipped config 4, latest config 27 2025.04.02 04:07:03.353814 [ 21802 ] {} RaftInstance: config at index 5 is committed, prev config log idx 27 2025.04.02 04:07:03.353851 [ 21802 ] {} RaftInstance: skipped config 5, latest config 27 2025.04.02 04:07:03.353921 [ 21802 ] {} RaftInstance: config at index 6 is committed, prev config log idx 27 2025.04.02 04:07:03.353956 [ 21802 ] {} RaftInstance: skipped config 6, latest config 27 2025.04.02 04:07:03.354025 [ 21802 ] {} RaftInstance: config at index 7 is committed, prev config log idx 27 2025.04.02 04:07:03.354068 [ 21802 ] {} RaftInstance: skipped config 7, latest config 27 2025.04.02 04:07:03.354136 [ 21802 ] {} RaftInstance: config at index 8 is committed, prev config log idx 27 2025.04.02 04:07:03.354179 [ 21802 ] {} RaftInstance: skipped config 8, latest config 27 2025.04.02 04:07:03.354264 [ 21802 ] {} RaftInstance: config at index 9 is committed, prev config log idx 27 2025.04.02 04:07:03.354299 [ 21802 ] {} RaftInstance: skipped config 9, latest config 27 2025.04.02 04:07:03.354371 [ 21802 ] {} RaftInstance: config at index 10 is committed, prev config log idx 27 2025.04.02 04:07:03.354523 [ 21802 ] {} RaftInstance: skipped config 10, latest config 27 2025.04.02 04:07:03.354614 [ 21802 ] {} RaftInstance: config at index 11 is committed, prev config log idx 27 2025.04.02 04:07:03.354652 [ 21802 ] {} RaftInstance: skipped config 11, latest config 27 2025.04.02 04:07:03.354758 [ 21802 ] {} RaftInstance: config at index 12 is committed, prev config log idx 27 2025.04.02 04:07:03.354820 [ 21802 ] {} RaftInstance: skipped config 12, latest config 27 2025.04.02 04:07:03.354918 [ 21802 ] {} RaftInstance: config at index 13 is committed, prev config log idx 27 2025.04.02 04:07:03.354957 [ 21802 ] {} RaftInstance: skipped config 13, latest config 27 2025.04.02 04:07:03.355026 [ 21802 ] {} RaftInstance: config at index 14 is committed, prev config log idx 27 2025.04.02 04:07:03.355062 [ 21802 ] {} RaftInstance: skipped config 14, latest config 27 2025.04.02 04:07:03.355140 [ 21802 ] {} RaftInstance: config at index 15 is committed, prev config log idx 27 2025.04.02 04:07:03.355181 [ 21802 ] {} RaftInstance: skipped config 15, latest config 27 2025.04.02 04:07:03.355255 [ 21802 ] {} RaftInstance: config at index 16 is committed, prev config log idx 27 2025.04.02 04:07:03.355291 [ 21802 ] {} RaftInstance: skipped config 16, latest config 27 2025.04.02 04:07:03.355359 [ 21802 ] {} RaftInstance: config at index 17 is committed, prev config log idx 27 2025.04.02 04:07:03.355398 [ 21802 ] {} RaftInstance: skipped config 17, latest config 27 2025.04.02 04:07:03.355466 [ 21802 ] {} RaftInstance: config at index 18 is committed, prev config log idx 27 2025.04.02 04:07:03.355502 [ 21802 ] {} RaftInstance: skipped config 18, latest config 27 2025.04.02 04:07:03.355568 [ 21802 ] {} RaftInstance: config at index 19 is committed, prev config log idx 27 2025.04.02 04:07:03.355632 [ 21802 ] {} RaftInstance: skipped config 19, latest config 27 2025.04.02 04:07:03.355724 [ 21802 ] {} RaftInstance: config at index 20 is committed, prev config log idx 27 2025.04.02 04:07:03.355760 [ 21802 ] {} RaftInstance: skipped config 20, latest config 27 2025.04.02 04:07:03.355950 [ 21802 ] {} RaftInstance: config at index 21 is committed, prev config log idx 27 2025.04.02 04:07:03.356048 [ 21802 ] {} RaftInstance: skipped config 21, latest config 27 2025.04.02 04:07:03.356128 [ 21802 ] {} RaftInstance: config at index 22 is committed, prev config log idx 27 2025.04.02 04:07:03.356184 [ 21802 ] {} RaftInstance: skipped config 22, latest config 27 2025.04.02 04:07:03.356257 [ 21802 ] {} RaftInstance: config at index 23 is committed, prev config log idx 27 2025.04.02 04:07:03.356291 [ 21802 ] {} RaftInstance: skipped config 23, latest config 27 2025.04.02 04:07:03.356398 [ 21802 ] {} RaftInstance: config at index 24 is committed, prev config log idx 27 2025.04.02 04:07:03.356439 [ 21802 ] {} RaftInstance: skipped config 24, latest config 27 2025.04.02 04:07:03.356522 [ 21802 ] {} RaftInstance: config at index 25 is committed, prev config log idx 27 2025.04.02 04:07:03.356558 [ 21802 ] {} RaftInstance: skipped config 25, latest config 27 2025.04.02 04:07:03.356627 [ 21802 ] {} RaftInstance: config at index 26 is committed, prev config log idx 27 2025.04.02 04:07:03.356692 [ 21802 ] {} RaftInstance: skipped config 26, latest config 27 2025.04.02 04:07:03.356795 [ 21802 ] {} RaftInstance: config at index 27 is committed, prev config log idx 27 2025.04.02 04:07:03.356839 [ 21802 ] {} RaftInstance: skipped config 27, latest config 27 2025.04.02 04:07:03.356940 [ 21802 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:03.356992 [ 21802 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:03.357061 [ 21802 ] {} RaftInstance: config at index 28 is committed, prev config log idx 27 2025.04.02 04:07:03.357134 [ 21802 ] {} RaftInstance: new config log idx 28, prev log idx 27, cur config log idx 27, prev log idx 26 2025.04.02 04:07:03.357250 [ 21802 ] {} RaftInstance: new configuration: log idx 28, prev log idx 27 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 28 2025.04.02 04:07:03.357451 [ 21187 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:03.358519 [ 21187 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:03.360539 [ 21187 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:03.361043 [ 21187 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:03.471620 [ 21187 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:03.471789 [ 21187 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:03.473196 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:03.473719 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:03.474351 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:03.474713 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:03.475022 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:03.475270 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:03.475514 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:03.475896 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:03.497970 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:03.498528 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:03.498947 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:03.499317 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:03.499662 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:03.500056 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:03.500520 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:03.501083 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:03.501607 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:03.502209 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:03.502707 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:03.503091 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:03.503423 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:03.503920 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:03.504681 [ 21187 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:03.594078 [ 21187 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:03.594381 [ 21187 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:03.603434 [ 21187 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:03.603576 [ 21187 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:03.652583 [ 21187 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:03.654571 [ 21187 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:03.655424 [ 21187 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:03.655956 [ 21810 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:03.664791 [ 21187 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:03.667973 [ 21187 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:03.674018 [ 21187 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:03.677207 [ 21187 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:03.683862 [ 21187 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:03.686354 [ 21187 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:03.688455 [ 21187 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:03.690075 [ 21187 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:03.690203 [ 21187 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:03.690257 [ 21202 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:03.691194 [ 21202 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:07:08.274046 [ 21187 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:08.274540 [ 21187 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:07:08.275059 [ 21187 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:07:08.275123 [ 21187 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:07:08.275352 [ 21713 ] {} CancellationChecker: Execution took 5967 ms. 2025.04.02 04:07:08.275706 [ 21187 ] {} Application: Shutting down storages. 2025.04.02 04:07:08.275786 [ 21187 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:07:08.277464 [ 21187 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:07:08.277523 [ 21187 ] {} Context: Shutting down workload entity storage 2025.04.02 04:07:08.277556 [ 21187 ] {} Context: Shutting down named sessions 2025.04.02 04:07:08.277648 [ 21187 ] {} Context: Shutting down database catalog 2025.04.02 04:07:08.277689 [ 21187 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:07:08.277776 [ 21187 ] {} Context: Shutting down merges executor 2025.04.02 04:07:08.278249 [ 21187 ] {} Context: Shutting down fetches executor 2025.04.02 04:07:08.279181 [ 21187 ] {} Context: Shutting down moves executor 2025.04.02 04:07:08.279478 [ 21187 ] {} Context: Shutting down common executor 2025.04.02 04:07:08.279692 [ 21187 ] {} Context: Shutting down DDLWorker 2025.04.02 04:07:08.279723 [ 21187 ] {} Context: Shutting down caches 2025.04.02 04:07:08.279753 [ 21187 ] {} Context: Shutting down AccessControl 2025.04.02 04:07:08.280048 [ 21187 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:07:08.282796 [ 21187 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:07:08.322574 [ 21187 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:07:08.323061 [ 21187 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:07:08.323728 [ 21187 ] {} Application: Shut down storages. 2025.04.02 04:07:08.323799 [ 21187 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:07:08.367431 [ 21187 ] {} Application: Closed all listening sockets. 2025.04.02 04:07:08.367565 [ 21187 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:07:08.367694 [ 21187 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:07:08.860938 [ 21187 ] {} RaftInstance: shutting down raft core 2025.04.02 04:07:08.861152 [ 21187 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:07:08.861243 [ 21187 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:07:08.861297 [ 21187 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:07:08.861349 [ 21187 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:07:08.861402 [ 21187 ] {} RaftInstance: reset all pointers. 2025.04.02 04:07:08.861488 [ 21187 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:07:08.861636 [ 21187 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:07:08.861677 [ 21803 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:07:08.861899 [ 21187 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:07:08.861966 [ 21187 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:07:08.862019 [ 21187 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:07:08.862300 [ 21789 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:07:08.862580 [ 21786 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:07:08.862721 [ 21790 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:08.862831 [ 21789 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:08.863085 [ 21798 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:07:08.863094 [ 21793 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:08.863152 [ 21795 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:07:08.863119 [ 21792 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:07:08.863290 [ 21794 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:08.863608 [ 21796 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:08.863617 [ 21788 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:07:08.863622 [ 21800 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:07:08.863300 [ 21801 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:08.863361 [ 21791 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:07:08.863292 [ 21797 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:07:08.863359 [ 21787 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:07:08.863308 [ 21799 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:07:08.864274 [ 21187 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:08.864284 [ 21784 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:07:08.864457 [ 21785 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:07:08.865164 [ 21187 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:07:08.865333 [ 21187 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:07:08.865399 [ 21187 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:07:08.865467 [ 21187 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:07:08.865519 [ 21187 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:08.865708 [ 21187 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:08.865783 [ 21187 ] {} Context: Destructing threadpool writer 2025.04.02 04:07:08.869293 [ 21187 ] {} Application: Destroyed global context. 2025.04.02 04:07:08.870028 [ 21187 ] {} Application: Waiting for background threads 2025.04.02 04:07:08.945332 [ 21187 ] {} Application: Background threads finished in 75 ms 2025.04.02 04:07:08.945905 [ 21187 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:07:08.945968 [ 21187 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:08.960156 [ 21187 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:08.960440 [ 21187 ] {} Application: shutting down 2025.04.02 04:07:08.960487 [ 21187 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:07:09.046882 [ 21190 ] {} BaseDaemon: Received signal -2 2025.04.02 04:07:09.046998 [ 21190 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:07:09.178768 [ 21185 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:10.019526 [ 21922 ] {} Application: Will watch for the process with pid 21924 2025.04.02 04:07:10.020894 [ 21924 ] {} Application: Forked a child process to watch 2025.04.02 04:07:10.022224 [ 21924 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:10.540176 [ 21924 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 21924 2025.04.02 04:07:10.541147 [ 21924 ] {} Application: starting up 2025.04.02 04:07:10.541234 [ 21924 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:10.573807 [ 21924 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:10.573964 [ 21924 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:10.574211 [ 21924 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:10.574301 [ 21924 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:10.574347 [ 21924 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:10.574412 [ 21924 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:10.576137 [ 21924 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:10.576616 [ 21924 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:10.576679 [ 21924 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:10.576893 [ 21924 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:10.576951 [ 21924 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:11.691497 [ 21924 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:11.693676 [ 21924 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:11.693746 [ 21924 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:11.693916 [ 21924 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:11.694648 [ 21924 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:12.022056 [ 22450 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:12.022491 [ 21924 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:12.022578 [ 21924 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:12.022644 [ 21924 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:12.022688 [ 21924 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:12.023006 [ 21924 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:12.023473 [ 21924 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:12.040422 [ 21924 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:12.040586 [ 21924 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:12.040991 [ 21924 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:12.041582 [ 21924 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:12.041770 [ 21924 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:12.043102 [ 21924 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:12.049682 [ 21924 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:12.049783 [ 21924 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:12.049896 [ 21924 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:12.050462 [ 21924 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:12.062931 [ 21924 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:12.063011 [ 21924 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:12.070769 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:12.071799 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:12.072307 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:12.072825 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:12.073279 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:12.073722 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:12.078366 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:12.078849 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:12.079267 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:12.079633 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:12.080016 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:12.080455 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:12.080849 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:12.081197 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:12.081545 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:12.082063 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:12.082547 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:12.082965 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:12.083332 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:12.083776 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:12.084150 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:12.084548 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:12.084953 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:12.085681 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:12.086780 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:12.087127 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:12.088129 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:12.089269 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:12.089671 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:12.090044 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:12.090477 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:12.090911 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:12.091321 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:12.091794 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:12.092152 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:12.092688 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:12.093106 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:12.093624 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:12.094159 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:12.094618 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:12.095812 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:12.096467 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:12.096909 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:12.097351 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:12.097831 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:12.098279 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:12.098906 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:12.099330 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:12.099801 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:12.100284 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:12.102936 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:12.103795 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:12.104794 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:12.105419 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:12.105845 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:12.106251 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:12.107030 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:12.107539 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:12.108148 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:12.108556 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:12.109029 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:12.109470 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:12.110165 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:12.110647 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:12.111199 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:12.111952 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:12.112474 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:12.114350 [ 21924 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:12.332651 [ 21924 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:12.371071 [ 21924 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:12.411471 [ 21924 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:12.411571 [ 21924 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:12.411610 [ 21924 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:12.426738 [ 21924 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:12.426828 [ 21924 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:12.426881 [ 21924 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:12.427006 [ 21924 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:12.433836 [ 21924 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:12.440582 [ 21924 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:12.453064 [ 21924 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:12.453565 [ 21924 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:12.453726 [ 21924 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:12.456352 [ 21924 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:12.457029 [ 21924 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:12.457326 [ 21924 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:12.458459 [ 21924 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:12.458546 [ 21924 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:12.460071 [ 21924 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:12.460113 [ 21924 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:12.460137 [ 21924 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:12.460176 [ 21924 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:12.460199 [ 21924 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:12.460378 [ 21924 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:12.460444 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:12.632456 [ 21924 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:12.717716 [ 21924 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:12.717864 [ 21924 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:12.719150 [ 21924 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:12.719311 [ 21924 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv 2025.04.02 04:07:12.719389 [ 21924 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv 2025.04.02 04:07:12.719453 [ 21924 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv, size 4 2025.04.02 04:07:12.720040 [ 21924 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv. 2025.04.02 04:07:12.720166 [ 22510 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv 2025.04.02 04:07:12.727118 [ 22510 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv, size 4 2025.04.02 04:07:12.727909 [ 21924 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/vet/oizrzzhovbcduwzijerptllisgssv. 2025.04.02 04:07:12.728219 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vet/oizrzzhovbcduwzijerptllisgssv (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:12.732297 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vet/oizrzzhovbcduwzijerptllisgssv (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:12.732435 [ 21924 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/vet/oizrzzhovbcduwzijerptllisgssv, Version: Latest, Offset: 2 2025.04.02 04:07:12.739434 [ 21924 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/vet/oizrzzhovbcduwzijerptllisgssv 2025.04.02 04:07:12.739513 [ 21924 ] {} deleteFileFromS3: Object with path s3/vet/oizrzzhovbcduwzijerptllisgssv was removed from S3 2025.04.02 04:07:12.739576 [ 21924 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:12.739633 [ 21924 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:12.817995 [ 21924 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:12.997352 [ 21924 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:12.997460 [ 21924 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:12.998205 [ 21924 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:13.008509 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:13.013671 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:13.013806 [ 21924 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:13.020474 [ 21924 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:13.020699 [ 21924 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:13 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E3F9ADD7E2B x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:13.020893 [ 21924 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:13.025917 [ 21924 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:13.025998 [ 21924 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:13.026061 [ 21924 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:13.026104 [ 21924 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:13.026239 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.026323 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.026439 [ 21924 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:13.026517 [ 21924 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:13.026587 [ 21924 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:13.026654 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.026721 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.026818 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.026891 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.026970 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.030555 [ 21924 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:13.043541 [ 21924 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:13.043618 [ 21924 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:13.044529 [ 21924 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:13.051064 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ptv/gimmerosfxmnaxvgrxfhiopxbjyot (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:13.053732 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ptv/gimmerosfxmnaxvgrxfhiopxbjyot (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:13.053820 [ 21924 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ptv/gimmerosfxmnaxvgrxfhiopxbjyot, Version: Latest, Offset: 2 2025.04.02 04:07:13.059177 [ 21924 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ptv/gimmerosfxmnaxvgrxfhiopxbjyot 2025.04.02 04:07:13.059237 [ 21924 ] {} deleteFileFromS3: Object with path special/ptv/gimmerosfxmnaxvgrxfhiopxbjyot was removed from S3 2025.04.02 04:07:13.059286 [ 21924 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:13.059327 [ 21924 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:13.062860 [ 21924 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:13.072481 [ 21924 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:13.072542 [ 21924 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:13.073295 [ 21924 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:13.079428 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/fpa/rybqykzabbhynkvojbhapxxuxdvyj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:13.082093 [ 21924 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/fpa/rybqykzabbhynkvojbhapxxuxdvyj (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:13.082165 [ 21924 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/fpa/rybqykzabbhynkvojbhapxxuxdvyj, Version: Latest, Offset: 2 2025.04.02 04:07:13.087078 [ 21924 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/fpa/rybqykzabbhynkvojbhapxxuxdvyj 2025.04.02 04:07:13.087128 [ 21924 ] {} deleteFileFromS3: Object with path test_02944/fpa/rybqykzabbhynkvojbhapxxuxdvyj was removed from S3 2025.04.02 04:07:13.087179 [ 21924 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:13.087215 [ 21924 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:13.087343 [ 21924 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:13.090722 [ 21924 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:13.094950 [ 21924 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:13.095074 [ 21924 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:13.096677 [ 21924 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:13.096864 [ 21924 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:13.098040 [ 21924 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:13.098089 [ 21924 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:13.098142 [ 21924 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:13.098175 [ 21924 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:13.098207 [ 21924 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:13.098804 [ 21924 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 28 entries 2025.04.02 04:07:13.098872 [ 21924 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:13.098979 [ 21924 ] {} KeeperServer: Last local log idx 28 2025.04.02 04:07:13.099030 [ 21924 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 28 2025.04.02 04:07:13.100160 [ 21924 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:13.110975 [ 21924 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:13.111374 [ 21924 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:13.111485 [ 21924 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:13.111548 [ 21924 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:13.111612 [ 21924 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:13.111653 [ 21924 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:13.111747 [ 21924 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 28 election timer allowed log store start 1, end 28 config log idx 28, prev log idx 27 -- ASYNC REPLICATION -- 2025.04.02 04:07:13.111819 [ 21924 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:13.111884 [ 21924 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:13.111943 [ 21924 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:13.112521 [ 21924 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:13.112608 [ 22538 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:13.163004 [ 22521 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:13.163193 [ 22521 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:13.163319 [ 22521 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 28, state term 28, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:13.163397 [ 22521 ] {} RaftInstance: pre-vote term (0) is different, reset it to 28 2025.04.02 04:07:13.163463 [ 21924 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:13.163765 [ 22521 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:13.167616 [ 22521 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 29, log idx 28, log term 28, priority (target 1 / mine 1) 2025.04.02 04:07:13.167738 [ 22521 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:13.167845 [ 22521 ] {} RaftInstance: state machine commit index 0, precommit index 28, last log index 28 2025.04.02 04:07:13.167955 [ 22521 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:13.168393 [ 22519 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:13.168573 [ 22521 ] {} RaftInstance: [BECOME LEADER] appended new config at 29 2025.04.02 04:07:13.168944 [ 22537 ] {} RaftInstance: config at index 1 is committed, prev config log idx 28 2025.04.02 04:07:13.169037 [ 22537 ] {} RaftInstance: skipped config 1, latest config 28 2025.04.02 04:07:13.169173 [ 22537 ] {} RaftInstance: config at index 2 is committed, prev config log idx 28 2025.04.02 04:07:13.169225 [ 22537 ] {} RaftInstance: skipped config 2, latest config 28 2025.04.02 04:07:13.169318 [ 22537 ] {} RaftInstance: config at index 3 is committed, prev config log idx 28 2025.04.02 04:07:13.169365 [ 22537 ] {} RaftInstance: skipped config 3, latest config 28 2025.04.02 04:07:13.169451 [ 22537 ] {} RaftInstance: config at index 4 is committed, prev config log idx 28 2025.04.02 04:07:13.169494 [ 22537 ] {} RaftInstance: skipped config 4, latest config 28 2025.04.02 04:07:13.169574 [ 22537 ] {} RaftInstance: config at index 5 is committed, prev config log idx 28 2025.04.02 04:07:13.169616 [ 22537 ] {} RaftInstance: skipped config 5, latest config 28 2025.04.02 04:07:13.169688 [ 22537 ] {} RaftInstance: config at index 6 is committed, prev config log idx 28 2025.04.02 04:07:13.169727 [ 22537 ] {} RaftInstance: skipped config 6, latest config 28 2025.04.02 04:07:13.169817 [ 22537 ] {} RaftInstance: config at index 7 is committed, prev config log idx 28 2025.04.02 04:07:13.169862 [ 22537 ] {} RaftInstance: skipped config 7, latest config 28 2025.04.02 04:07:13.169935 [ 22537 ] {} RaftInstance: config at index 8 is committed, prev config log idx 28 2025.04.02 04:07:13.169985 [ 22537 ] {} RaftInstance: skipped config 8, latest config 28 2025.04.02 04:07:13.170061 [ 22537 ] {} RaftInstance: config at index 9 is committed, prev config log idx 28 2025.04.02 04:07:13.170095 [ 22537 ] {} RaftInstance: skipped config 9, latest config 28 2025.04.02 04:07:13.170175 [ 22537 ] {} RaftInstance: config at index 10 is committed, prev config log idx 28 2025.04.02 04:07:13.170215 [ 22537 ] {} RaftInstance: skipped config 10, latest config 28 2025.04.02 04:07:13.170286 [ 22537 ] {} RaftInstance: config at index 11 is committed, prev config log idx 28 2025.04.02 04:07:13.170325 [ 22537 ] {} RaftInstance: skipped config 11, latest config 28 2025.04.02 04:07:13.205924 [ 22537 ] {} RaftInstance: config at index 12 is committed, prev config log idx 28 2025.04.02 04:07:13.206025 [ 22537 ] {} RaftInstance: skipped config 12, latest config 28 2025.04.02 04:07:13.206147 [ 22537 ] {} RaftInstance: config at index 13 is committed, prev config log idx 28 2025.04.02 04:07:13.206189 [ 22537 ] {} RaftInstance: skipped config 13, latest config 28 2025.04.02 04:07:13.206262 [ 22537 ] {} RaftInstance: config at index 14 is committed, prev config log idx 28 2025.04.02 04:07:13.206304 [ 22537 ] {} RaftInstance: skipped config 14, latest config 28 2025.04.02 04:07:13.206433 [ 22537 ] {} RaftInstance: config at index 15 is committed, prev config log idx 28 2025.04.02 04:07:13.206477 [ 22537 ] {} RaftInstance: skipped config 15, latest config 28 2025.04.02 04:07:13.206571 [ 22537 ] {} RaftInstance: config at index 16 is committed, prev config log idx 28 2025.04.02 04:07:13.206622 [ 22537 ] {} RaftInstance: skipped config 16, latest config 28 2025.04.02 04:07:13.206704 [ 22537 ] {} RaftInstance: config at index 17 is committed, prev config log idx 28 2025.04.02 04:07:13.206763 [ 22537 ] {} RaftInstance: skipped config 17, latest config 28 2025.04.02 04:07:13.206847 [ 22537 ] {} RaftInstance: config at index 18 is committed, prev config log idx 28 2025.04.02 04:07:13.206890 [ 22537 ] {} RaftInstance: skipped config 18, latest config 28 2025.04.02 04:07:13.206979 [ 22537 ] {} RaftInstance: config at index 19 is committed, prev config log idx 28 2025.04.02 04:07:13.207018 [ 22537 ] {} RaftInstance: skipped config 19, latest config 28 2025.04.02 04:07:13.207098 [ 22537 ] {} RaftInstance: config at index 20 is committed, prev config log idx 28 2025.04.02 04:07:13.207136 [ 22537 ] {} RaftInstance: skipped config 20, latest config 28 2025.04.02 04:07:13.207207 [ 22537 ] {} RaftInstance: config at index 21 is committed, prev config log idx 28 2025.04.02 04:07:13.207246 [ 22537 ] {} RaftInstance: skipped config 21, latest config 28 2025.04.02 04:07:13.207325 [ 22537 ] {} RaftInstance: config at index 22 is committed, prev config log idx 28 2025.04.02 04:07:13.207371 [ 22537 ] {} RaftInstance: skipped config 22, latest config 28 2025.04.02 04:07:13.207449 [ 22537 ] {} RaftInstance: config at index 23 is committed, prev config log idx 28 2025.04.02 04:07:13.207487 [ 22537 ] {} RaftInstance: skipped config 23, latest config 28 2025.04.02 04:07:13.207559 [ 22537 ] {} RaftInstance: config at index 24 is committed, prev config log idx 28 2025.04.02 04:07:13.207598 [ 22537 ] {} RaftInstance: skipped config 24, latest config 28 2025.04.02 04:07:13.207666 [ 22537 ] {} RaftInstance: config at index 25 is committed, prev config log idx 28 2025.04.02 04:07:13.207701 [ 22537 ] {} RaftInstance: skipped config 25, latest config 28 2025.04.02 04:07:13.207783 [ 22537 ] {} RaftInstance: config at index 26 is committed, prev config log idx 28 2025.04.02 04:07:13.207820 [ 22537 ] {} RaftInstance: skipped config 26, latest config 28 2025.04.02 04:07:13.207889 [ 22537 ] {} RaftInstance: config at index 27 is committed, prev config log idx 28 2025.04.02 04:07:13.207923 [ 22537 ] {} RaftInstance: skipped config 27, latest config 28 2025.04.02 04:07:13.207987 [ 22537 ] {} RaftInstance: config at index 28 is committed, prev config log idx 28 2025.04.02 04:07:13.208020 [ 22537 ] {} RaftInstance: skipped config 28, latest config 28 2025.04.02 04:07:13.208110 [ 22537 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:13.208160 [ 22537 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:13.208218 [ 22537 ] {} RaftInstance: config at index 29 is committed, prev config log idx 28 2025.04.02 04:07:13.208284 [ 22537 ] {} RaftInstance: new config log idx 29, prev log idx 28, cur config log idx 28, prev log idx 27 2025.04.02 04:07:13.208380 [ 22537 ] {} RaftInstance: new configuration: log idx 29, prev log idx 28 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 29 2025.04.02 04:07:13.208547 [ 21924 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:13.209441 [ 21924 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:13.211355 [ 21924 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:13.211679 [ 21924 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:13.224434 [ 21924 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:13.224515 [ 21924 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:13.225629 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:13.226025 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:13.226641 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:13.226943 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:13.227207 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:13.227469 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:13.227730 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:13.228121 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:13.232075 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:13.232458 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:13.232821 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:13.233182 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:13.233536 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:13.233847 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:13.234159 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:13.322123 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:13.323107 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:13.323961 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:13.324500 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:13.325024 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:13.325495 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:13.326086 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:13.386470 [ 21924 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:13.396231 [ 21924 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:13.396498 [ 21924 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:13.404940 [ 21924 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:13.405064 [ 21924 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:13.408619 [ 21924 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:13.410100 [ 21924 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:13.410703 [ 21924 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:13.411140 [ 22546 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:13.419862 [ 21924 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:13.423138 [ 21924 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:13.429466 [ 21924 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:13.433201 [ 21924 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:13.439926 [ 21924 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:13.442553 [ 21924 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:13.444605 [ 21924 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:13.446272 [ 21924 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:13.446372 [ 21924 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:13.446528 [ 21940 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:13.447287 [ 21940 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:07:18.533633 [ 21924 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:18.534090 [ 21924 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:07:18.534477 [ 21924 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:07:18.534535 [ 21924 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:07:18.534682 [ 22450 ] {} CancellationChecker: Execution took 6512 ms. 2025.04.02 04:07:18.534878 [ 21924 ] {} Application: Shutting down storages. 2025.04.02 04:07:18.534925 [ 21924 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:07:18.536406 [ 21924 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:07:18.536452 [ 21924 ] {} Context: Shutting down workload entity storage 2025.04.02 04:07:18.536480 [ 21924 ] {} Context: Shutting down named sessions 2025.04.02 04:07:18.536536 [ 21924 ] {} Context: Shutting down database catalog 2025.04.02 04:07:18.536568 [ 21924 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:07:18.536627 [ 21924 ] {} Context: Shutting down merges executor 2025.04.02 04:07:18.536975 [ 21924 ] {} Context: Shutting down fetches executor 2025.04.02 04:07:18.537454 [ 21924 ] {} Context: Shutting down moves executor 2025.04.02 04:07:18.537675 [ 21924 ] {} Context: Shutting down common executor 2025.04.02 04:07:18.537916 [ 21924 ] {} Context: Shutting down DDLWorker 2025.04.02 04:07:18.537972 [ 21924 ] {} Context: Shutting down caches 2025.04.02 04:07:18.538035 [ 21924 ] {} Context: Shutting down AccessControl 2025.04.02 04:07:18.538349 [ 21924 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:07:18.540531 [ 21924 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:07:18.550217 [ 21924 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:07:18.550665 [ 21924 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:07:18.551514 [ 21924 ] {} Application: Shut down storages. 2025.04.02 04:07:18.551583 [ 21924 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:07:18.718990 [ 21924 ] {} Application: Closed all listening sockets. 2025.04.02 04:07:18.719142 [ 21924 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:07:18.719245 [ 21924 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:07:19.211663 [ 21924 ] {} RaftInstance: shutting down raft core 2025.04.02 04:07:19.211848 [ 21924 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:07:19.211954 [ 21924 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:07:19.212022 [ 21924 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:07:19.212093 [ 21924 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:07:19.212158 [ 21924 ] {} RaftInstance: reset all pointers. 2025.04.02 04:07:19.212246 [ 21924 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:07:19.212453 [ 21924 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:07:19.212477 [ 22538 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:07:19.212729 [ 21924 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:07:19.212857 [ 21924 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:07:19.212910 [ 21924 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:07:19.213489 [ 22524 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:19.213513 [ 22522 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:19.213566 [ 22528 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:19.213582 [ 22526 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:19.213812 [ 22521 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:07:19.213709 [ 22534 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:07:19.213710 [ 22527 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:07:19.213709 [ 22535 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:07:19.213958 [ 22523 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:07:19.213705 [ 22530 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:19.213764 [ 22536 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:19.213762 [ 22533 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:07:19.213987 [ 22525 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:07:19.213969 [ 22532 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:07:19.213975 [ 22531 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:19.213773 [ 22529 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:07:19.295234 [ 21924 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:19.295393 [ 22519 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:07:19.296190 [ 21924 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:07:19.296428 [ 21924 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:07:19.296482 [ 21924 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:07:19.296640 [ 21924 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:07:19.296716 [ 21924 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:19.296944 [ 21924 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:19.296989 [ 21924 ] {} Context: Destructing threadpool writer 2025.04.02 04:07:19.301226 [ 21924 ] {} Application: Destroyed global context. 2025.04.02 04:07:19.301823 [ 21924 ] {} Application: Waiting for background threads 2025.04.02 04:07:19.401401 [ 21924 ] {} Application: Background threads finished in 99 ms 2025.04.02 04:07:19.402221 [ 21924 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:07:19.402309 [ 21924 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:19.415581 [ 21924 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:19.415869 [ 21924 ] {} Application: shutting down 2025.04.02 04:07:19.415917 [ 21924 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:07:19.448362 [ 21927 ] {} BaseDaemon: Received signal -2 2025.04.02 04:07:19.448568 [ 21927 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:07:19.627823 [ 21922 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:20.094449 [ 22659 ] {} Application: Will watch for the process with pid 22661 2025.04.02 04:07:20.095813 [ 22661 ] {} Application: Forked a child process to watch 2025.04.02 04:07:20.097397 [ 22661 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:20.601680 [ 22661 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 22661 2025.04.02 04:07:20.602654 [ 22661 ] {} Application: starting up 2025.04.02 04:07:20.602755 [ 22661 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:20.636082 [ 22661 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:20.636277 [ 22661 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:20.636504 [ 22661 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:20.636570 [ 22661 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:20.636609 [ 22661 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:20.636638 [ 22661 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:20.638460 [ 22661 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:20.638917 [ 22661 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:20.638969 [ 22661 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:20.639133 [ 22661 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:20.639185 [ 22661 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:21.637916 [ 22661 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:21.640015 [ 22661 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:21.640087 [ 22661 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:21.640249 [ 22661 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:21.640969 [ 22661 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:21.809199 [ 22674 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:21.809508 [ 22661 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:21.809583 [ 22661 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:21.809647 [ 22661 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:21.809689 [ 22661 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:21.809984 [ 22661 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:21.810526 [ 22661 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:21.824600 [ 22661 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:21.824726 [ 22661 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:21.825072 [ 22661 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:21.825532 [ 22661 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:21.825612 [ 22661 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:21.826579 [ 22661 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:21.831967 [ 22661 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:21.832032 [ 22661 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:21.832124 [ 22661 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:21.832605 [ 22661 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:21.844093 [ 22661 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:21.844177 [ 22661 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:21.852018 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:21.852998 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:21.853360 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:21.853872 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:21.854296 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:21.854670 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:21.859221 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:21.859664 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:21.860056 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:21.860380 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:21.860722 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:21.861169 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:21.861559 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:21.861918 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:21.862243 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:21.862810 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:21.863178 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:21.863553 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:21.863939 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:21.864374 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:21.864732 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:21.865153 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:21.865560 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:21.866313 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:21.867355 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:21.867703 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:21.868654 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:21.869846 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:21.870265 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:21.870697 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:21.871108 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:21.871524 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:21.871951 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:21.872433 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:21.872805 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:21.873281 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:21.873754 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:21.874238 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:21.874801 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:21.875243 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:21.876432 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:21.877061 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:21.877457 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:21.877919 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:21.878373 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:21.878866 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:21.879477 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:21.879938 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:21.880409 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:21.880905 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:21.883388 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:21.884177 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:21.885181 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:21.885845 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:21.886266 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:21.886689 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:21.887405 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:21.887889 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:21.888476 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:21.888884 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:21.889326 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:21.889772 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:21.890479 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:21.890956 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:21.891510 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:21.892234 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:21.892794 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:21.950978 [ 22661 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:22.103633 [ 22661 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:22.105860 [ 22661 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:22.205451 [ 22661 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:22.205547 [ 22661 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:22.205585 [ 22661 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:22.232200 [ 22661 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:22.232279 [ 22661 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:22.232332 [ 22661 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:22.232472 [ 22661 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:22.238563 [ 22661 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:22.243810 [ 22661 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:22.352875 [ 22661 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:22.353397 [ 22661 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:22.353589 [ 22661 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:22.356302 [ 22661 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:22.357073 [ 22661 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:22.357374 [ 22661 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:22.358608 [ 22661 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:22.358706 [ 22661 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:22.360471 [ 22661 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:22.360517 [ 22661 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:22.360546 [ 22661 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:22.360592 [ 22661 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:22.360620 [ 22661 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:22.360830 [ 22661 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:22.360907 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.547945 [ 22661 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:22.558098 [ 22661 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:22.558189 [ 22661 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:22.559222 [ 22661 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:22.559354 [ 22661 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp 2025.04.02 04:07:22.559418 [ 22661 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp 2025.04.02 04:07:22.559471 [ 22661 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp, size 4 2025.04.02 04:07:22.559878 [ 22661 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp. 2025.04.02 04:07:22.559948 [ 23247 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp 2025.04.02 04:07:22.565681 [ 23247 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp, size 4 2025.04.02 04:07:22.566209 [ 22661 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp. 2025.04.02 04:07:22.566469 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.569665 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.569818 [ 22661 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp, Version: Latest, Offset: 2 2025.04.02 04:07:22.575413 [ 22661 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp 2025.04.02 04:07:22.575475 [ 22661 ] {} deleteFileFromS3: Object with path s3/lpt/xhskrqxgqxcjekskqvrebklumoxkp was removed from S3 2025.04.02 04:07:22.575530 [ 22661 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:22.575574 [ 22661 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:22.578761 [ 22661 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:22.589321 [ 22661 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:22.589392 [ 22661 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:22.589949 [ 22661 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:22.598682 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.603398 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.603481 [ 22661 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:22.609786 [ 22661 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:22.609971 [ 22661 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:22 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E41D66BBBF4 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:22.610116 [ 22661 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:22.614831 [ 22661 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:22.614890 [ 22661 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:22.614939 [ 22661 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:22.614983 [ 22661 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:22.615108 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.615178 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.615244 [ 22661 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:22.615303 [ 22661 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:22.615359 [ 22661 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:22.615412 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.615464 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.615525 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.615579 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.615642 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.618570 [ 22661 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:22.628273 [ 22661 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:22.628335 [ 22661 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:22.629101 [ 22661 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:22.635841 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/bvh/kygutmlvhgzpbkygihobkuydvjtwv (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.638502 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/bvh/kygutmlvhgzpbkygihobkuydvjtwv (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.638568 [ 22661 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/bvh/kygutmlvhgzpbkygihobkuydvjtwv, Version: Latest, Offset: 2 2025.04.02 04:07:22.643256 [ 22661 ] {} deleteFileFromS3: No blob storage log, not writing blob special/bvh/kygutmlvhgzpbkygihobkuydvjtwv 2025.04.02 04:07:22.643302 [ 22661 ] {} deleteFileFromS3: Object with path special/bvh/kygutmlvhgzpbkygihobkuydvjtwv was removed from S3 2025.04.02 04:07:22.643342 [ 22661 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:22.643375 [ 22661 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:22.646510 [ 22661 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:22.656135 [ 22661 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:22.656182 [ 22661 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:22.656834 [ 22661 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:22.662479 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gau/gkoobshixdoblrdhevkfqelxkbhub (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.665284 [ 22661 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gau/gkoobshixdoblrdhevkfqelxkbhub (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:22.665347 [ 22661 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/gau/gkoobshixdoblrdhevkfqelxkbhub, Version: Latest, Offset: 2 2025.04.02 04:07:22.670664 [ 22661 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/gau/gkoobshixdoblrdhevkfqelxkbhub 2025.04.02 04:07:22.670713 [ 22661 ] {} deleteFileFromS3: Object with path test_02944/gau/gkoobshixdoblrdhevkfqelxkbhub was removed from S3 2025.04.02 04:07:22.670779 [ 22661 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:22.670817 [ 22661 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:22.670956 [ 22661 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:22.674329 [ 22661 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:22.678719 [ 22661 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:22.678854 [ 22661 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:22.680592 [ 22661 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:22.680725 [ 22661 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:22.681886 [ 22661 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:22.681952 [ 22661 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:22.682044 [ 22661 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:22.682081 [ 22661 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:22.682113 [ 22661 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:22.682791 [ 22661 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 29 entries 2025.04.02 04:07:22.682866 [ 22661 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:22.683009 [ 22661 ] {} KeeperServer: Last local log idx 29 2025.04.02 04:07:22.683062 [ 22661 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 29 2025.04.02 04:07:22.684195 [ 22661 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:22.694683 [ 22661 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:22.695031 [ 22661 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:22.695119 [ 22661 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:22.695177 [ 22661 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:22.695240 [ 22661 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:22.695280 [ 22661 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:22.695362 [ 22661 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 29 election timer allowed log store start 1, end 29 config log idx 29, prev log idx 28 -- ASYNC REPLICATION -- 2025.04.02 04:07:22.695402 [ 22661 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:22.695457 [ 22661 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:22.695513 [ 22661 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:22.696371 [ 22661 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:22.746919 [ 23258 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:22.747130 [ 23258 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:22.747246 [ 23258 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 29, state term 29, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:22.747311 [ 23258 ] {} RaftInstance: pre-vote term (0) is different, reset it to 29 2025.04.02 04:07:22.747462 [ 22661 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:22.747645 [ 23258 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:22.750612 [ 23258 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 30, log idx 29, log term 29, priority (target 1 / mine 1) 2025.04.02 04:07:22.750711 [ 23258 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:22.750800 [ 23258 ] {} RaftInstance: state machine commit index 0, precommit index 29, last log index 29 2025.04.02 04:07:22.750863 [ 23258 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:22.751267 [ 23256 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:22.751453 [ 23258 ] {} RaftInstance: [BECOME LEADER] appended new config at 30 2025.04.02 04:07:22.751803 [ 23274 ] {} RaftInstance: config at index 1 is committed, prev config log idx 29 2025.04.02 04:07:22.751921 [ 23274 ] {} RaftInstance: skipped config 1, latest config 29 2025.04.02 04:07:22.752050 [ 23274 ] {} RaftInstance: config at index 2 is committed, prev config log idx 29 2025.04.02 04:07:22.752095 [ 23274 ] {} RaftInstance: skipped config 2, latest config 29 2025.04.02 04:07:22.752182 [ 23274 ] {} RaftInstance: config at index 3 is committed, prev config log idx 29 2025.04.02 04:07:22.752220 [ 23274 ] {} RaftInstance: skipped config 3, latest config 29 2025.04.02 04:07:22.752293 [ 23274 ] {} RaftInstance: config at index 4 is committed, prev config log idx 29 2025.04.02 04:07:22.752329 [ 23274 ] {} RaftInstance: skipped config 4, latest config 29 2025.04.02 04:07:22.752396 [ 23274 ] {} RaftInstance: config at index 5 is committed, prev config log idx 29 2025.04.02 04:07:22.752435 [ 23274 ] {} RaftInstance: skipped config 5, latest config 29 2025.04.02 04:07:22.752505 [ 23274 ] {} RaftInstance: config at index 6 is committed, prev config log idx 29 2025.04.02 04:07:22.752541 [ 23274 ] {} RaftInstance: skipped config 6, latest config 29 2025.04.02 04:07:22.752638 [ 23274 ] {} RaftInstance: config at index 7 is committed, prev config log idx 29 2025.04.02 04:07:22.752649 [ 23252 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:22.752695 [ 23274 ] {} RaftInstance: skipped config 7, latest config 29 2025.04.02 04:07:22.752868 [ 23274 ] {} RaftInstance: config at index 8 is committed, prev config log idx 29 2025.04.02 04:07:22.752934 [ 23274 ] {} RaftInstance: skipped config 8, latest config 29 2025.04.02 04:07:22.753031 [ 23274 ] {} RaftInstance: config at index 9 is committed, prev config log idx 29 2025.04.02 04:07:22.753069 [ 23274 ] {} RaftInstance: skipped config 9, latest config 29 2025.04.02 04:07:22.753141 [ 23274 ] {} RaftInstance: config at index 10 is committed, prev config log idx 29 2025.04.02 04:07:22.753191 [ 23274 ] {} RaftInstance: skipped config 10, latest config 29 2025.04.02 04:07:22.753263 [ 23274 ] {} RaftInstance: config at index 11 is committed, prev config log idx 29 2025.04.02 04:07:22.753296 [ 23274 ] {} RaftInstance: skipped config 11, latest config 29 2025.04.02 04:07:22.753362 [ 23274 ] {} RaftInstance: config at index 12 is committed, prev config log idx 29 2025.04.02 04:07:22.753403 [ 23274 ] {} RaftInstance: skipped config 12, latest config 29 2025.04.02 04:07:22.753456 [ 23274 ] {} RaftInstance: config at index 13 is committed, prev config log idx 29 2025.04.02 04:07:22.753484 [ 23274 ] {} RaftInstance: skipped config 13, latest config 29 2025.04.02 04:07:22.753538 [ 23274 ] {} RaftInstance: config at index 14 is committed, prev config log idx 29 2025.04.02 04:07:22.753565 [ 23274 ] {} RaftInstance: skipped config 14, latest config 29 2025.04.02 04:07:22.753627 [ 23274 ] {} RaftInstance: config at index 15 is committed, prev config log idx 29 2025.04.02 04:07:22.753657 [ 23274 ] {} RaftInstance: skipped config 15, latest config 29 2025.04.02 04:07:22.753729 [ 23274 ] {} RaftInstance: config at index 16 is committed, prev config log idx 29 2025.04.02 04:07:22.753777 [ 23274 ] {} RaftInstance: skipped config 16, latest config 29 2025.04.02 04:07:22.753834 [ 23274 ] {} RaftInstance: config at index 17 is committed, prev config log idx 29 2025.04.02 04:07:22.753867 [ 23274 ] {} RaftInstance: skipped config 17, latest config 29 2025.04.02 04:07:22.753919 [ 23274 ] {} RaftInstance: config at index 18 is committed, prev config log idx 29 2025.04.02 04:07:22.753947 [ 23274 ] {} RaftInstance: skipped config 18, latest config 29 2025.04.02 04:07:22.753999 [ 23274 ] {} RaftInstance: config at index 19 is committed, prev config log idx 29 2025.04.02 04:07:22.754026 [ 23274 ] {} RaftInstance: skipped config 19, latest config 29 2025.04.02 04:07:22.754083 [ 23274 ] {} RaftInstance: config at index 20 is committed, prev config log idx 29 2025.04.02 04:07:22.754112 [ 23274 ] {} RaftInstance: skipped config 20, latest config 29 2025.04.02 04:07:22.754163 [ 23274 ] {} RaftInstance: config at index 21 is committed, prev config log idx 29 2025.04.02 04:07:22.754191 [ 23274 ] {} RaftInstance: skipped config 21, latest config 29 2025.04.02 04:07:22.754249 [ 23274 ] {} RaftInstance: config at index 22 is committed, prev config log idx 29 2025.04.02 04:07:22.754282 [ 23274 ] {} RaftInstance: skipped config 22, latest config 29 2025.04.02 04:07:22.754336 [ 23274 ] {} RaftInstance: config at index 23 is committed, prev config log idx 29 2025.04.02 04:07:22.754364 [ 23274 ] {} RaftInstance: skipped config 23, latest config 29 2025.04.02 04:07:22.754504 [ 23274 ] {} RaftInstance: config at index 24 is committed, prev config log idx 29 2025.04.02 04:07:22.754543 [ 23274 ] {} RaftInstance: skipped config 24, latest config 29 2025.04.02 04:07:22.754599 [ 23274 ] {} RaftInstance: config at index 25 is committed, prev config log idx 29 2025.04.02 04:07:22.754628 [ 23274 ] {} RaftInstance: skipped config 25, latest config 29 2025.04.02 04:07:22.754678 [ 23274 ] {} RaftInstance: config at index 26 is committed, prev config log idx 29 2025.04.02 04:07:22.754707 [ 23274 ] {} RaftInstance: skipped config 26, latest config 29 2025.04.02 04:07:22.754781 [ 23274 ] {} RaftInstance: config at index 27 is committed, prev config log idx 29 2025.04.02 04:07:22.754812 [ 23274 ] {} RaftInstance: skipped config 27, latest config 29 2025.04.02 04:07:22.754871 [ 23274 ] {} RaftInstance: config at index 28 is committed, prev config log idx 29 2025.04.02 04:07:22.754900 [ 23274 ] {} RaftInstance: skipped config 28, latest config 29 2025.04.02 04:07:22.754963 [ 23274 ] {} RaftInstance: config at index 29 is committed, prev config log idx 29 2025.04.02 04:07:22.754997 [ 23274 ] {} RaftInstance: skipped config 29, latest config 29 2025.04.02 04:07:22.755075 [ 23274 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:22.755112 [ 23274 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:22.755156 [ 23274 ] {} RaftInstance: config at index 30 is committed, prev config log idx 29 2025.04.02 04:07:22.755213 [ 23274 ] {} RaftInstance: new config log idx 30, prev log idx 29, cur config log idx 29, prev log idx 28 2025.04.02 04:07:22.755310 [ 23274 ] {} RaftInstance: new configuration: log idx 30, prev log idx 29 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 30 2025.04.02 04:07:22.755471 [ 22661 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:22.756363 [ 22661 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:22.758295 [ 22661 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:22.758775 [ 22661 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:22.771808 [ 22661 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:22.771903 [ 22661 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:22.773050 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:22.773532 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:22.774139 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:22.774463 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:22.774713 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:22.774926 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:22.775143 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:22.775414 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:22.778819 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:22.779171 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:22.779460 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:22.779772 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:22.780063 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:22.780356 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:22.780661 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:22.781023 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:22.781363 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:22.781785 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:22.782109 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:22.782465 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:22.782820 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:22.783317 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:22.784088 [ 22661 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:22.791284 [ 22661 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:22.791477 [ 22661 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:22.798222 [ 22661 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:22.798326 [ 22661 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:22.801402 [ 22661 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:22.802643 [ 22661 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:22.803243 [ 22661 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:22.803718 [ 23279 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:22.811974 [ 22661 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:22.815150 [ 22661 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:22.821601 [ 22661 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:22.824765 [ 22661 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:22.830995 [ 22661 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:22.833409 [ 22661 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:22.835012 [ 22661 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:22.836322 [ 22661 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:22.836455 [ 22661 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:22.836485 [ 22675 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:22.837277 [ 22675 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:07:27.547646 [ 22661 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:27.548092 [ 22661 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:07:27.548470 [ 22661 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:07:27.548552 [ 22661 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:07:27.548722 [ 22674 ] {} CancellationChecker: Execution took 5739 ms. 2025.04.02 04:07:27.549516 [ 22661 ] {} Application: Shutting down storages. 2025.04.02 04:07:27.549582 [ 22661 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:07:27.551170 [ 22661 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:07:27.551240 [ 22661 ] {} Context: Shutting down workload entity storage 2025.04.02 04:07:27.551275 [ 22661 ] {} Context: Shutting down named sessions 2025.04.02 04:07:27.551354 [ 22661 ] {} Context: Shutting down database catalog 2025.04.02 04:07:27.551394 [ 22661 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:07:27.551468 [ 22661 ] {} Context: Shutting down merges executor 2025.04.02 04:07:27.552000 [ 22661 ] {} Context: Shutting down fetches executor 2025.04.02 04:07:27.552412 [ 22661 ] {} Context: Shutting down moves executor 2025.04.02 04:07:27.552679 [ 22661 ] {} Context: Shutting down common executor 2025.04.02 04:07:27.552963 [ 22661 ] {} Context: Shutting down DDLWorker 2025.04.02 04:07:27.553010 [ 22661 ] {} Context: Shutting down caches 2025.04.02 04:07:27.553045 [ 22661 ] {} Context: Shutting down AccessControl 2025.04.02 04:07:27.553354 [ 22661 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:07:27.556284 [ 22661 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:07:27.568773 [ 22661 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:07:27.569280 [ 22661 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:07:27.569934 [ 22661 ] {} Application: Shut down storages. 2025.04.02 04:07:27.569995 [ 22661 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:07:28.015496 [ 22661 ] {} Application: Closed all listening sockets. 2025.04.02 04:07:28.015621 [ 22661 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:07:28.015717 [ 22661 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:07:28.258933 [ 22661 ] {} RaftInstance: shutting down raft core 2025.04.02 04:07:28.259069 [ 22661 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:07:28.259163 [ 22661 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:07:28.259219 [ 22661 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:07:28.259265 [ 22661 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:07:28.259310 [ 22661 ] {} RaftInstance: reset all pointers. 2025.04.02 04:07:28.259356 [ 22661 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:07:28.259481 [ 22661 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:07:28.259524 [ 23252 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:07:28.259725 [ 22661 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:07:28.259807 [ 22661 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:07:28.259846 [ 22661 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:07:28.260247 [ 23258 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:07:28.260334 [ 23263 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:07:28.260337 [ 23261 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:28.260431 [ 23264 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:07:28.260552 [ 23266 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:28.260979 [ 23265 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:07:28.260977 [ 23271 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:28.261120 [ 23259 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:07:28.261119 [ 23268 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:28.260994 [ 23272 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:07:28.261131 [ 23270 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:28.261120 [ 23267 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:07:28.261083 [ 23260 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:07:28.261098 [ 23269 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:07:28.261081 [ 23273 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:07:28.261136 [ 23262 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:07:28.261848 [ 22661 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:28.261893 [ 23256 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:07:28.262686 [ 22661 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:07:28.262856 [ 22661 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:07:28.262903 [ 22661 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:07:28.262969 [ 22661 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:07:28.263016 [ 22661 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:28.263159 [ 22661 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:28.263204 [ 22661 ] {} Context: Destructing threadpool writer 2025.04.02 04:07:28.306649 [ 22661 ] {} Application: Destroyed global context. 2025.04.02 04:07:28.307294 [ 22661 ] {} Application: Waiting for background threads 2025.04.02 04:07:28.387234 [ 22661 ] {} Application: Background threads finished in 79 ms 2025.04.02 04:07:28.388220 [ 22661 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:07:28.388282 [ 22661 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:28.408681 [ 22661 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:28.409091 [ 22661 ] {} Application: shutting down 2025.04.02 04:07:28.409144 [ 22661 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:07:28.597774 [ 22664 ] {} BaseDaemon: Received signal -2 2025.04.02 04:07:28.597875 [ 22664 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:07:28.731246 [ 22659 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:29.148803 [ 23391 ] {} Application: Will watch for the process with pid 23393 2025.04.02 04:07:29.150157 [ 23393 ] {} Application: Forked a child process to watch 2025.04.02 04:07:29.152033 [ 23393 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:29.665935 [ 23393 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 23393 2025.04.02 04:07:29.667012 [ 23393 ] {} Application: starting up 2025.04.02 04:07:29.667106 [ 23393 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:29.701794 [ 23393 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:29.701944 [ 23393 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:29.702178 [ 23393 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:29.702245 [ 23393 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:29.702286 [ 23393 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:29.702319 [ 23393 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:29.703798 [ 23393 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:29.704261 [ 23393 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:29.704312 [ 23393 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:29.704487 [ 23393 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:29.704564 [ 23393 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:30.569893 [ 23393 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:30.572100 [ 23393 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:30.572174 [ 23393 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:30.572343 [ 23393 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:30.573175 [ 23393 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:30.888375 [ 23403 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:30.888752 [ 23393 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:30.888837 [ 23393 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:30.888919 [ 23393 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:30.888976 [ 23393 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:30.889278 [ 23393 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:30.889805 [ 23393 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:30.907699 [ 23393 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:30.907874 [ 23393 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:30.908268 [ 23393 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:30.908891 [ 23393 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:30.909018 [ 23393 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:30.910230 [ 23393 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:30.916404 [ 23393 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:30.916488 [ 23393 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:30.916580 [ 23393 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:30.917046 [ 23393 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:30.930009 [ 23393 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:30.930125 [ 23393 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:30.938986 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:30.940063 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:30.940517 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:30.941020 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:30.941469 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:30.941829 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:30.946352 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:30.946829 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:30.947246 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:30.947583 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:30.947944 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:30.948383 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:30.948748 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:30.949092 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:30.949455 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:30.950013 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:30.950364 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:30.950802 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:30.951178 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:30.951621 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:30.952018 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:30.952434 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:30.952855 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:30.953599 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:30.954715 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:30.955095 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:30.956105 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:30.957290 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:30.957749 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:30.958093 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:30.958508 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:30.958939 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:30.959376 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:30.959907 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:30.960387 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:30.960923 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:30.961371 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:30.961982 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:30.962532 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:30.963012 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:30.964173 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:30.964813 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:30.965231 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:30.965690 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:30.966146 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:30.966599 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:30.967200 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:30.967651 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:30.968121 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:30.968646 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:30.971300 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:30.972146 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:30.973154 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:30.973785 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:30.974217 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:30.974668 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:30.975401 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:30.975897 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:30.976509 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:30.976934 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:30.977379 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:30.977822 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:31.032055 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:31.033011 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:31.033884 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:31.034838 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:31.035498 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:31.037530 [ 23393 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:31.085872 [ 23393 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:31.087822 [ 23393 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:31.214764 [ 23393 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:31.214867 [ 23393 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:31.214905 [ 23393 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:31.328801 [ 23393 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:31.328896 [ 23393 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:31.328960 [ 23393 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:31.329113 [ 23393 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:31.336194 [ 23393 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:31.343124 [ 23393 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:31.360977 [ 23393 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:31.361740 [ 23393 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:31.361952 [ 23393 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:31.365640 [ 23393 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:31.366759 [ 23393 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:31.367143 [ 23393 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:31.368762 [ 23393 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:31.368899 [ 23393 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:31.371570 [ 23393 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:31.371663 [ 23393 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:31.371707 [ 23393 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:31.371791 [ 23393 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:31.371834 [ 23393 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:31.372107 [ 23393 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:31.372216 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.562848 [ 23393 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:31.574635 [ 23393 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:31.574767 [ 23393 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:31.575859 [ 23393 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:31.576012 [ 23393 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi 2025.04.02 04:07:31.576086 [ 23393 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi 2025.04.02 04:07:31.576143 [ 23393 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi, size 4 2025.04.02 04:07:31.576824 [ 23393 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi. 2025.04.02 04:07:31.577041 [ 23975 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi 2025.04.02 04:07:31.584114 [ 23975 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi, size 4 2025.04.02 04:07:31.584955 [ 23393 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi. 2025.04.02 04:07:31.585249 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.588810 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.588906 [ 23393 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi, Version: Latest, Offset: 2 2025.04.02 04:07:31.594718 [ 23393 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi 2025.04.02 04:07:31.594853 [ 23393 ] {} deleteFileFromS3: Object with path s3/gcz/thvguwwezcrtfhbjrirnfbnepcwbi was removed from S3 2025.04.02 04:07:31.594942 [ 23393 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:31.594996 [ 23393 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:31.598694 [ 23393 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:31.609383 [ 23393 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:31.609477 [ 23393 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:31.610154 [ 23393 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:31.621093 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.626678 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.626880 [ 23393 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:31.702372 [ 23393 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:31.702805 [ 23393 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:31 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E43F45E1AFF x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:31.703104 [ 23393 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:31.711327 [ 23393 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:31.711535 [ 23393 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:31.711664 [ 23393 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:31.711748 [ 23393 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:31.712009 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.712169 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.712318 [ 23393 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:31.712425 [ 23393 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:31.712530 [ 23393 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:31.712625 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.712875 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.713016 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.713119 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.713221 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.719847 [ 23393 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:31.738618 [ 23393 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:31.738764 [ 23393 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:31.739978 [ 23393 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:31.748113 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/fwz/skrhudmrqmuyeivtgmblajbcfwtig (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.752657 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/fwz/skrhudmrqmuyeivtgmblajbcfwtig (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.752795 [ 23393 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/fwz/skrhudmrqmuyeivtgmblajbcfwtig, Version: Latest, Offset: 2 2025.04.02 04:07:31.760066 [ 23393 ] {} deleteFileFromS3: No blob storage log, not writing blob special/fwz/skrhudmrqmuyeivtgmblajbcfwtig 2025.04.02 04:07:31.760135 [ 23393 ] {} deleteFileFromS3: Object with path special/fwz/skrhudmrqmuyeivtgmblajbcfwtig was removed from S3 2025.04.02 04:07:31.760184 [ 23393 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:31.760222 [ 23393 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:31.763831 [ 23393 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:31.774868 [ 23393 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:31.774960 [ 23393 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:31.775780 [ 23393 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:31.871356 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vku/xncvmtxhelgilgyhbmtblfpnobwao (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.875220 [ 23393 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vku/xncvmtxhelgilgyhbmtblfpnobwao (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:31.875436 [ 23393 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/vku/xncvmtxhelgilgyhbmtblfpnobwao, Version: Latest, Offset: 2 2025.04.02 04:07:31.899258 [ 23393 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/vku/xncvmtxhelgilgyhbmtblfpnobwao 2025.04.02 04:07:31.899341 [ 23393 ] {} deleteFileFromS3: Object with path test_02944/vku/xncvmtxhelgilgyhbmtblfpnobwao was removed from S3 2025.04.02 04:07:31.899436 [ 23393 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:31.899523 [ 23393 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:31.899697 [ 23393 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:31.904240 [ 23393 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:31.908874 [ 23393 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:31.909012 [ 23393 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:31.910919 [ 23393 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:31.911195 [ 23393 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:31.912312 [ 23393 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:31.912379 [ 23393 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:31.912478 [ 23393 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:31.912522 [ 23393 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:31.912572 [ 23393 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:31.913404 [ 23393 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 30 entries 2025.04.02 04:07:31.913528 [ 23393 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:31.913739 [ 23393 ] {} KeeperServer: Last local log idx 30 2025.04.02 04:07:31.913825 [ 23393 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 30 2025.04.02 04:07:31.915653 [ 23393 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:31.929550 [ 23393 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:31.930240 [ 23393 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:31.967208 [ 23393 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:31.967395 [ 23393 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:31.967543 [ 23393 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:31.967615 [ 23393 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:31.967763 [ 23393 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 30 election timer allowed log store start 1, end 30 config log idx 30, prev log idx 29 -- ASYNC REPLICATION -- 2025.04.02 04:07:31.967824 [ 23393 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:31.967905 [ 23393 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:31.968074 [ 23393 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:31.969256 [ 23393 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:31.969411 [ 24006 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:32.020010 [ 23989 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:32.020329 [ 23989 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:32.020487 [ 23989 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 30, state term 30, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:32.020559 [ 23989 ] {} RaftInstance: pre-vote term (0) is different, reset it to 30 2025.04.02 04:07:32.020745 [ 23393 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:32.020953 [ 23989 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:32.024144 [ 23989 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 31, log idx 30, log term 30, priority (target 1 / mine 1) 2025.04.02 04:07:32.024266 [ 23989 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:32.024353 [ 23989 ] {} RaftInstance: state machine commit index 0, precommit index 30, last log index 30 2025.04.02 04:07:32.024470 [ 23989 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:32.024890 [ 23987 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:32.025094 [ 23989 ] {} RaftInstance: [BECOME LEADER] appended new config at 31 2025.04.02 04:07:32.025600 [ 24005 ] {} RaftInstance: config at index 1 is committed, prev config log idx 30 2025.04.02 04:07:32.025790 [ 24005 ] {} RaftInstance: skipped config 1, latest config 30 2025.04.02 04:07:32.025991 [ 24005 ] {} RaftInstance: config at index 2 is committed, prev config log idx 30 2025.04.02 04:07:32.026073 [ 24005 ] {} RaftInstance: skipped config 2, latest config 30 2025.04.02 04:07:32.026196 [ 24005 ] {} RaftInstance: config at index 3 is committed, prev config log idx 30 2025.04.02 04:07:32.026258 [ 24005 ] {} RaftInstance: skipped config 3, latest config 30 2025.04.02 04:07:32.026380 [ 24005 ] {} RaftInstance: config at index 4 is committed, prev config log idx 30 2025.04.02 04:07:32.026543 [ 24005 ] {} RaftInstance: skipped config 4, latest config 30 2025.04.02 04:07:32.026664 [ 24005 ] {} RaftInstance: config at index 5 is committed, prev config log idx 30 2025.04.02 04:07:32.026754 [ 24005 ] {} RaftInstance: skipped config 5, latest config 30 2025.04.02 04:07:32.026865 [ 24005 ] {} RaftInstance: config at index 6 is committed, prev config log idx 30 2025.04.02 04:07:32.026922 [ 24005 ] {} RaftInstance: skipped config 6, latest config 30 2025.04.02 04:07:32.027028 [ 24005 ] {} RaftInstance: config at index 7 is committed, prev config log idx 30 2025.04.02 04:07:32.027127 [ 24005 ] {} RaftInstance: skipped config 7, latest config 30 2025.04.02 04:07:32.027263 [ 24005 ] {} RaftInstance: config at index 8 is committed, prev config log idx 30 2025.04.02 04:07:32.027336 [ 24005 ] {} RaftInstance: skipped config 8, latest config 30 2025.04.02 04:07:32.027443 [ 24005 ] {} RaftInstance: config at index 9 is committed, prev config log idx 30 2025.04.02 04:07:32.027494 [ 24005 ] {} RaftInstance: skipped config 9, latest config 30 2025.04.02 04:07:32.027599 [ 24005 ] {} RaftInstance: config at index 10 is committed, prev config log idx 30 2025.04.02 04:07:32.027663 [ 24005 ] {} RaftInstance: skipped config 10, latest config 30 2025.04.02 04:07:32.027779 [ 24005 ] {} RaftInstance: config at index 11 is committed, prev config log idx 30 2025.04.02 04:07:32.027838 [ 24005 ] {} RaftInstance: skipped config 11, latest config 30 2025.04.02 04:07:32.027957 [ 24005 ] {} RaftInstance: config at index 12 is committed, prev config log idx 30 2025.04.02 04:07:32.028019 [ 24005 ] {} RaftInstance: skipped config 12, latest config 30 2025.04.02 04:07:32.028151 [ 24005 ] {} RaftInstance: config at index 13 is committed, prev config log idx 30 2025.04.02 04:07:32.028208 [ 24005 ] {} RaftInstance: skipped config 13, latest config 30 2025.04.02 04:07:32.028311 [ 24005 ] {} RaftInstance: config at index 14 is committed, prev config log idx 30 2025.04.02 04:07:32.028367 [ 24005 ] {} RaftInstance: skipped config 14, latest config 30 2025.04.02 04:07:32.028499 [ 24005 ] {} RaftInstance: config at index 15 is committed, prev config log idx 30 2025.04.02 04:07:32.028556 [ 24005 ] {} RaftInstance: skipped config 15, latest config 30 2025.04.02 04:07:32.028668 [ 24005 ] {} RaftInstance: config at index 16 is committed, prev config log idx 30 2025.04.02 04:07:32.028737 [ 24005 ] {} RaftInstance: skipped config 16, latest config 30 2025.04.02 04:07:32.028840 [ 24005 ] {} RaftInstance: config at index 17 is committed, prev config log idx 30 2025.04.02 04:07:32.028897 [ 24005 ] {} RaftInstance: skipped config 17, latest config 30 2025.04.02 04:07:32.028990 [ 24005 ] {} RaftInstance: config at index 18 is committed, prev config log idx 30 2025.04.02 04:07:32.029044 [ 24005 ] {} RaftInstance: skipped config 18, latest config 30 2025.04.02 04:07:32.029133 [ 24005 ] {} RaftInstance: config at index 19 is committed, prev config log idx 30 2025.04.02 04:07:32.029181 [ 24005 ] {} RaftInstance: skipped config 19, latest config 30 2025.04.02 04:07:32.029278 [ 24005 ] {} RaftInstance: config at index 20 is committed, prev config log idx 30 2025.04.02 04:07:32.029327 [ 24005 ] {} RaftInstance: skipped config 20, latest config 30 2025.04.02 04:07:32.029422 [ 24005 ] {} RaftInstance: config at index 21 is committed, prev config log idx 30 2025.04.02 04:07:32.029476 [ 24005 ] {} RaftInstance: skipped config 21, latest config 30 2025.04.02 04:07:32.029571 [ 24005 ] {} RaftInstance: config at index 22 is committed, prev config log idx 30 2025.04.02 04:07:32.029624 [ 24005 ] {} RaftInstance: skipped config 22, latest config 30 2025.04.02 04:07:32.029717 [ 24005 ] {} RaftInstance: config at index 23 is committed, prev config log idx 30 2025.04.02 04:07:32.029820 [ 24005 ] {} RaftInstance: skipped config 23, latest config 30 2025.04.02 04:07:32.029980 [ 24005 ] {} RaftInstance: config at index 24 is committed, prev config log idx 30 2025.04.02 04:07:32.030044 [ 24005 ] {} RaftInstance: skipped config 24, latest config 30 2025.04.02 04:07:32.030160 [ 24005 ] {} RaftInstance: config at index 25 is committed, prev config log idx 30 2025.04.02 04:07:32.030215 [ 24005 ] {} RaftInstance: skipped config 25, latest config 30 2025.04.02 04:07:32.030309 [ 24005 ] {} RaftInstance: config at index 26 is committed, prev config log idx 30 2025.04.02 04:07:32.030356 [ 24005 ] {} RaftInstance: skipped config 26, latest config 30 2025.04.02 04:07:32.030512 [ 24005 ] {} RaftInstance: config at index 27 is committed, prev config log idx 30 2025.04.02 04:07:32.030570 [ 24005 ] {} RaftInstance: skipped config 27, latest config 30 2025.04.02 04:07:32.030655 [ 24005 ] {} RaftInstance: config at index 28 is committed, prev config log idx 30 2025.04.02 04:07:32.030704 [ 24005 ] {} RaftInstance: skipped config 28, latest config 30 2025.04.02 04:07:32.030837 [ 24005 ] {} RaftInstance: config at index 29 is committed, prev config log idx 30 2025.04.02 04:07:32.030911 [ 24005 ] {} RaftInstance: skipped config 29, latest config 30 2025.04.02 04:07:32.031024 [ 24005 ] {} RaftInstance: config at index 30 is committed, prev config log idx 30 2025.04.02 04:07:32.031087 [ 24005 ] {} RaftInstance: skipped config 30, latest config 30 2025.04.02 04:07:32.031205 [ 24005 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:32.031284 [ 24005 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:32.031377 [ 24005 ] {} RaftInstance: config at index 31 is committed, prev config log idx 30 2025.04.02 04:07:32.031467 [ 24005 ] {} RaftInstance: new config log idx 31, prev log idx 30, cur config log idx 30, prev log idx 29 2025.04.02 04:07:32.031621 [ 24005 ] {} RaftInstance: new configuration: log idx 31, prev log idx 30 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 31 2025.04.02 04:07:32.031905 [ 23393 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:32.033152 [ 23393 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:32.035468 [ 23393 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:32.035939 [ 23393 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:32.049792 [ 23393 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:32.049934 [ 23393 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:32.051312 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:32.051838 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:32.052515 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:32.052845 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:32.053108 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:32.053348 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:32.053601 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:32.053960 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:32.058818 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:32.059355 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:32.059889 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:32.060403 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:32.060850 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:32.061302 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:32.061876 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:32.062501 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:32.063005 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:32.063500 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:32.063908 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:32.064261 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:32.064691 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:32.065244 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:32.066147 [ 23393 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:32.144650 [ 23393 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:32.144937 [ 23393 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:32.152281 [ 23393 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:32.152440 [ 23393 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:32.156166 [ 23393 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:32.157550 [ 23393 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:32.158283 [ 23393 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:32.158994 [ 24011 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:32.167554 [ 23393 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:32.170804 [ 23393 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:32.176918 [ 23393 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:32.179951 [ 23393 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:32.186331 [ 23393 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:32.188670 [ 23393 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:32.190370 [ 23393 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:32.191661 [ 23393 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:32.191850 [ 23393 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:32.191988 [ 23404 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:32.193180 [ 23404 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:07:36.741550 [ 23393 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:36.741937 [ 23393 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:07:36.742272 [ 23393 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:07:36.742323 [ 23393 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:07:36.742475 [ 23403 ] {} CancellationChecker: Execution took 5854 ms. 2025.04.02 04:07:36.742687 [ 23393 ] {} Application: Shutting down storages. 2025.04.02 04:07:36.742751 [ 23393 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:07:36.743841 [ 23393 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:07:36.743888 [ 23393 ] {} Context: Shutting down workload entity storage 2025.04.02 04:07:36.743913 [ 23393 ] {} Context: Shutting down named sessions 2025.04.02 04:07:36.743965 [ 23393 ] {} Context: Shutting down database catalog 2025.04.02 04:07:36.743998 [ 23393 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:07:36.744049 [ 23393 ] {} Context: Shutting down merges executor 2025.04.02 04:07:36.744433 [ 23393 ] {} Context: Shutting down fetches executor 2025.04.02 04:07:36.744821 [ 23393 ] {} Context: Shutting down moves executor 2025.04.02 04:07:36.745047 [ 23393 ] {} Context: Shutting down common executor 2025.04.02 04:07:36.745296 [ 23393 ] {} Context: Shutting down DDLWorker 2025.04.02 04:07:36.745355 [ 23393 ] {} Context: Shutting down caches 2025.04.02 04:07:36.745431 [ 23393 ] {} Context: Shutting down AccessControl 2025.04.02 04:07:36.745784 [ 23393 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:07:36.748200 [ 23393 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:07:36.823290 [ 23393 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:07:36.823847 [ 23393 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:07:36.824378 [ 23393 ] {} Application: Shut down storages. 2025.04.02 04:07:36.824426 [ 23393 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:07:37.042299 [ 23393 ] {} Application: Closed all listening sockets. 2025.04.02 04:07:37.090089 [ 23393 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:07:37.090227 [ 23393 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:07:37.534792 [ 23393 ] {} RaftInstance: shutting down raft core 2025.04.02 04:07:37.534907 [ 23393 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:07:37.534980 [ 23393 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:07:37.535032 [ 23393 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:07:37.535074 [ 23393 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:07:37.535118 [ 23393 ] {} RaftInstance: reset all pointers. 2025.04.02 04:07:37.535158 [ 23393 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:07:37.535275 [ 23393 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:07:37.535285 [ 24006 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:07:37.535406 [ 23393 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:07:37.535464 [ 23393 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:07:37.535502 [ 23393 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:07:37.535673 [ 23992 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:07:37.535863 [ 23989 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:37.535977 [ 23992 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:07:37.536106 [ 23993 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:37.535922 [ 23991 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:37.536154 [ 23990 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:07:37.536301 [ 23998 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:07:37.536372 [ 23997 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:07:37.536600 [ 24004 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:07:37.536601 [ 23996 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:07:37.536405 [ 24003 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:07:37.536397 [ 24002 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:07:37.536396 [ 24001 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:37.536463 [ 23994 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:07:37.536456 [ 24000 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:37.536414 [ 23999 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:07:37.536533 [ 23995 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:37.537123 [ 23393 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:37.537179 [ 23987 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:07:37.537313 [ 23988 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:07:37.537896 [ 23393 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:07:37.538049 [ 23393 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:07:37.538106 [ 23393 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:07:37.538172 [ 23393 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:07:37.538223 [ 23393 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:37.538370 [ 23393 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:37.538453 [ 23393 ] {} Context: Destructing threadpool writer 2025.04.02 04:07:37.541106 [ 23393 ] {} Application: Destroyed global context. 2025.04.02 04:07:37.541622 [ 23393 ] {} Application: Waiting for background threads 2025.04.02 04:07:37.601827 [ 23393 ] {} Application: Background threads finished in 60 ms 2025.04.02 04:07:37.602481 [ 23393 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:07:37.602539 [ 23393 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:37.615585 [ 23393 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:37.615866 [ 23393 ] {} Application: shutting down 2025.04.02 04:07:37.615903 [ 23393 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:07:37.663267 [ 23396 ] {} BaseDaemon: Received signal -2 2025.04.02 04:07:37.663565 [ 23396 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:07:37.856497 [ 23391 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:38.208256 [ 24123 ] {} Application: Will watch for the process with pid 24125 2025.04.02 04:07:38.209509 [ 24125 ] {} Application: Forked a child process to watch 2025.04.02 04:07:38.211185 [ 24125 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:38.690863 [ 24125 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 24125 2025.04.02 04:07:38.691803 [ 24125 ] {} Application: starting up 2025.04.02 04:07:38.691892 [ 24125 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:38.724755 [ 24125 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:38.724885 [ 24125 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:38.725053 [ 24125 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:38.725112 [ 24125 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:38.725146 [ 24125 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:38.725171 [ 24125 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:38.726641 [ 24125 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:38.727072 [ 24125 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:38.727117 [ 24125 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:38.727279 [ 24125 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:38.727328 [ 24125 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:39.549837 [ 24125 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:39.551948 [ 24125 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:39.552022 [ 24125 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:39.552198 [ 24125 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:39.552913 [ 24125 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:39.905424 [ 24651 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:39.905765 [ 24125 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:39.905848 [ 24125 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:39.905906 [ 24125 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:39.905946 [ 24125 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:39.906219 [ 24125 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:39.906672 [ 24125 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:39.989641 [ 24125 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:39.989813 [ 24125 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:39.990181 [ 24125 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:39.990775 [ 24125 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:39.990889 [ 24125 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:39.992029 [ 24125 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:39.998212 [ 24125 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:39.998290 [ 24125 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:39.998421 [ 24125 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:39.998951 [ 24125 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:40.010686 [ 24125 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:40.010778 [ 24125 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:40.018518 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:40.019529 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:40.019940 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:40.020383 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:40.020805 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:40.021138 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:40.025401 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:40.025808 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:40.026191 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:40.026541 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:40.026899 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:40.027317 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:40.027651 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:40.028017 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:40.028329 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:40.028835 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:40.029159 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:40.029511 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:40.029865 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:40.030251 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:40.030620 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:40.031011 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:40.031413 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:40.032122 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:40.033110 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:40.033443 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:40.034379 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:40.035527 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:40.035935 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:40.036260 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:40.036634 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:40.037046 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:40.037438 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:40.037899 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:40.038251 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:40.038742 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:40.039117 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:40.039600 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:40.040119 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:40.040530 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:40.041663 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:40.042271 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:40.042690 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:40.043128 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:40.043553 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:40.043991 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:40.044527 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:40.044951 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:40.045387 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:40.045847 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:40.048280 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:40.049046 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:40.049988 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:40.050627 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:40.051043 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:40.051424 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:40.052132 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:40.052606 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:40.053160 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:40.053554 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:40.053988 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:40.054440 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:40.055122 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:40.055540 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:40.056070 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:40.056758 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:40.057253 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:40.059103 [ 24125 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:40.208020 [ 24125 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:40.209666 [ 24125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:40.286279 [ 24125 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:40.286370 [ 24125 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:40.286442 [ 24125 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:40.300390 [ 24125 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:40.300435 [ 24125 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:40.300482 [ 24125 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:40.300595 [ 24125 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:40.306671 [ 24125 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:40.311590 [ 24125 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:40.323657 [ 24125 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:40.324206 [ 24125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:40.324353 [ 24125 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:40.327946 [ 24125 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:40.328815 [ 24125 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:40.329096 [ 24125 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:40.330526 [ 24125 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:40.330610 [ 24125 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:40.332826 [ 24125 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:40.332884 [ 24125 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:40.332923 [ 24125 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:40.332979 [ 24125 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:40.333016 [ 24125 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:40.333260 [ 24125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:40.333353 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.490563 [ 24125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:40.500003 [ 24125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:40.500061 [ 24125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:40.500904 [ 24125 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:40.501020 [ 24125 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars 2025.04.02 04:07:40.501080 [ 24125 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars 2025.04.02 04:07:40.501131 [ 24125 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars, size 4 2025.04.02 04:07:40.501496 [ 24125 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars. 2025.04.02 04:07:40.501587 [ 24710 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars 2025.04.02 04:07:40.512777 [ 24710 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars, size 4 2025.04.02 04:07:40.513315 [ 24125 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/wcu/lhutbffedzrbislyhevmpzcgoyars. 2025.04.02 04:07:40.513548 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/wcu/lhutbffedzrbislyhevmpzcgoyars (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.517496 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/wcu/lhutbffedzrbislyhevmpzcgoyars (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.517686 [ 24125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/wcu/lhutbffedzrbislyhevmpzcgoyars, Version: Latest, Offset: 2 2025.04.02 04:07:40.526755 [ 24125 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/wcu/lhutbffedzrbislyhevmpzcgoyars 2025.04.02 04:07:40.526876 [ 24125 ] {} deleteFileFromS3: Object with path s3/wcu/lhutbffedzrbislyhevmpzcgoyars was removed from S3 2025.04.02 04:07:40.526975 [ 24125 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:40.527061 [ 24125 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:40.533119 [ 24125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:40.552973 [ 24125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:40.553078 [ 24125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:40.554084 [ 24125 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:40.632102 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.639484 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.639646 [ 24125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:40.649710 [ 24125 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:40.650087 [ 24125 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:40 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E4609AF4B09 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:40.650440 [ 24125 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:40.658017 [ 24125 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:40.658125 [ 24125 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:40.658214 [ 24125 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:40.658281 [ 24125 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:40.658502 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.658643 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.658795 [ 24125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:40.658920 [ 24125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:40.659084 [ 24125 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:40.659199 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.659307 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.659432 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.659539 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.659646 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.665610 [ 24125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:40.684402 [ 24125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:40.684480 [ 24125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:40.685443 [ 24125 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:40.692473 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/deb/uddktkdbzigbjgumluoqcrptyiqji (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.696202 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/deb/uddktkdbzigbjgumluoqcrptyiqji (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.696301 [ 24125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/deb/uddktkdbzigbjgumluoqcrptyiqji, Version: Latest, Offset: 2 2025.04.02 04:07:40.702364 [ 24125 ] {} deleteFileFromS3: No blob storage log, not writing blob special/deb/uddktkdbzigbjgumluoqcrptyiqji 2025.04.02 04:07:40.702477 [ 24125 ] {} deleteFileFromS3: Object with path special/deb/uddktkdbzigbjgumluoqcrptyiqji was removed from S3 2025.04.02 04:07:40.702539 [ 24125 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:40.702588 [ 24125 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:40.707330 [ 24125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:40.721903 [ 24125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:40.721945 [ 24125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:40.722649 [ 24125 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:40.728160 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/irq/qdithbukulzbmylbiteaaswhsdbyn (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.730424 [ 24125 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/irq/qdithbukulzbmylbiteaaswhsdbyn (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:40.730485 [ 24125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/irq/qdithbukulzbmylbiteaaswhsdbyn, Version: Latest, Offset: 2 2025.04.02 04:07:40.735419 [ 24125 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/irq/qdithbukulzbmylbiteaaswhsdbyn 2025.04.02 04:07:40.735487 [ 24125 ] {} deleteFileFromS3: Object with path test_02944/irq/qdithbukulzbmylbiteaaswhsdbyn was removed from S3 2025.04.02 04:07:40.735555 [ 24125 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:40.735606 [ 24125 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:40.735744 [ 24125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:40.740045 [ 24125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:40.745075 [ 24125 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:40.745225 [ 24125 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:40.747607 [ 24125 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:40.747815 [ 24125 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:40.748843 [ 24125 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:40.748893 [ 24125 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:40.748936 [ 24125 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:40.748970 [ 24125 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:40.749004 [ 24125 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:40.749559 [ 24125 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 31 entries 2025.04.02 04:07:40.749626 [ 24125 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:40.749753 [ 24125 ] {} KeeperServer: Last local log idx 31 2025.04.02 04:07:40.749805 [ 24125 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 31 2025.04.02 04:07:40.751167 [ 24125 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:40.760532 [ 24125 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:40.760811 [ 24125 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:40.760897 [ 24125 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:40.760951 [ 24125 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:40.761011 [ 24125 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:40.761055 [ 24125 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:40.761128 [ 24125 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 31 election timer allowed log store start 1, end 31 config log idx 31, prev log idx 30 -- ASYNC REPLICATION -- 2025.04.02 04:07:40.761165 [ 24125 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:40.761219 [ 24125 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:40.761274 [ 24125 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:40.761941 [ 24125 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:40.762098 [ 24738 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:40.812396 [ 24721 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:40.812594 [ 24721 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:40.812726 [ 24721 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 31, state term 31, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:40.812787 [ 24721 ] {} RaftInstance: pre-vote term (0) is different, reset it to 31 2025.04.02 04:07:40.813153 [ 24125 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:40.813152 [ 24721 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:40.816112 [ 24721 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 32, log idx 31, log term 31, priority (target 1 / mine 1) 2025.04.02 04:07:40.816192 [ 24721 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:40.816250 [ 24721 ] {} RaftInstance: state machine commit index 0, precommit index 31, last log index 31 2025.04.02 04:07:40.816313 [ 24721 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:40.816625 [ 24719 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:40.816810 [ 24721 ] {} RaftInstance: [BECOME LEADER] appended new config at 32 2025.04.02 04:07:40.817155 [ 24737 ] {} RaftInstance: config at index 1 is committed, prev config log idx 31 2025.04.02 04:07:40.817268 [ 24737 ] {} RaftInstance: skipped config 1, latest config 31 2025.04.02 04:07:40.817421 [ 24737 ] {} RaftInstance: config at index 2 is committed, prev config log idx 31 2025.04.02 04:07:40.817503 [ 24737 ] {} RaftInstance: skipped config 2, latest config 31 2025.04.02 04:07:40.817621 [ 24737 ] {} RaftInstance: config at index 3 is committed, prev config log idx 31 2025.04.02 04:07:40.817677 [ 24737 ] {} RaftInstance: skipped config 3, latest config 31 2025.04.02 04:07:40.817804 [ 24737 ] {} RaftInstance: config at index 4 is committed, prev config log idx 31 2025.04.02 04:07:40.817860 [ 24737 ] {} RaftInstance: skipped config 4, latest config 31 2025.04.02 04:07:40.817999 [ 24737 ] {} RaftInstance: config at index 5 is committed, prev config log idx 31 2025.04.02 04:07:40.818083 [ 24737 ] {} RaftInstance: skipped config 5, latest config 31 2025.04.02 04:07:40.818228 [ 24737 ] {} RaftInstance: config at index 6 is committed, prev config log idx 31 2025.04.02 04:07:40.818284 [ 24737 ] {} RaftInstance: skipped config 6, latest config 31 2025.04.02 04:07:40.818378 [ 24737 ] {} RaftInstance: config at index 7 is committed, prev config log idx 31 2025.04.02 04:07:40.840578 [ 24737 ] {} RaftInstance: skipped config 7, latest config 31 2025.04.02 04:07:40.840705 [ 24737 ] {} RaftInstance: config at index 8 is committed, prev config log idx 31 2025.04.02 04:07:40.840800 [ 24737 ] {} RaftInstance: skipped config 8, latest config 31 2025.04.02 04:07:40.840911 [ 24737 ] {} RaftInstance: config at index 9 is committed, prev config log idx 31 2025.04.02 04:07:40.840971 [ 24737 ] {} RaftInstance: skipped config 9, latest config 31 2025.04.02 04:07:40.841083 [ 24737 ] {} RaftInstance: config at index 10 is committed, prev config log idx 31 2025.04.02 04:07:40.841137 [ 24737 ] {} RaftInstance: skipped config 10, latest config 31 2025.04.02 04:07:40.841235 [ 24737 ] {} RaftInstance: config at index 11 is committed, prev config log idx 31 2025.04.02 04:07:40.841287 [ 24737 ] {} RaftInstance: skipped config 11, latest config 31 2025.04.02 04:07:40.841398 [ 24737 ] {} RaftInstance: config at index 12 is committed, prev config log idx 31 2025.04.02 04:07:40.841473 [ 24737 ] {} RaftInstance: skipped config 12, latest config 31 2025.04.02 04:07:40.841583 [ 24737 ] {} RaftInstance: config at index 13 is committed, prev config log idx 31 2025.04.02 04:07:40.841643 [ 24737 ] {} RaftInstance: skipped config 13, latest config 31 2025.04.02 04:07:40.841772 [ 24737 ] {} RaftInstance: config at index 14 is committed, prev config log idx 31 2025.04.02 04:07:40.841832 [ 24737 ] {} RaftInstance: skipped config 14, latest config 31 2025.04.02 04:07:40.841955 [ 24737 ] {} RaftInstance: config at index 15 is committed, prev config log idx 31 2025.04.02 04:07:40.842013 [ 24737 ] {} RaftInstance: skipped config 15, latest config 31 2025.04.02 04:07:40.842133 [ 24737 ] {} RaftInstance: config at index 16 is committed, prev config log idx 31 2025.04.02 04:07:40.842192 [ 24737 ] {} RaftInstance: skipped config 16, latest config 31 2025.04.02 04:07:40.842352 [ 24737 ] {} RaftInstance: config at index 17 is committed, prev config log idx 31 2025.04.02 04:07:40.842443 [ 24737 ] {} RaftInstance: skipped config 17, latest config 31 2025.04.02 04:07:40.842526 [ 24737 ] {} RaftInstance: config at index 18 is committed, prev config log idx 31 2025.04.02 04:07:40.842564 [ 24737 ] {} RaftInstance: skipped config 18, latest config 31 2025.04.02 04:07:40.842642 [ 24737 ] {} RaftInstance: config at index 19 is committed, prev config log idx 31 2025.04.02 04:07:40.842680 [ 24737 ] {} RaftInstance: skipped config 19, latest config 31 2025.04.02 04:07:40.842778 [ 24737 ] {} RaftInstance: config at index 20 is committed, prev config log idx 31 2025.04.02 04:07:40.842821 [ 24737 ] {} RaftInstance: skipped config 20, latest config 31 2025.04.02 04:07:40.842924 [ 24737 ] {} RaftInstance: config at index 21 is committed, prev config log idx 31 2025.04.02 04:07:40.842965 [ 24737 ] {} RaftInstance: skipped config 21, latest config 31 2025.04.02 04:07:40.843049 [ 24737 ] {} RaftInstance: config at index 22 is committed, prev config log idx 31 2025.04.02 04:07:40.843092 [ 24737 ] {} RaftInstance: skipped config 22, latest config 31 2025.04.02 04:07:40.843170 [ 24737 ] {} RaftInstance: config at index 23 is committed, prev config log idx 31 2025.04.02 04:07:40.843208 [ 24737 ] {} RaftInstance: skipped config 23, latest config 31 2025.04.02 04:07:40.843295 [ 24737 ] {} RaftInstance: config at index 24 is committed, prev config log idx 31 2025.04.02 04:07:40.843337 [ 24737 ] {} RaftInstance: skipped config 24, latest config 31 2025.04.02 04:07:40.843410 [ 24737 ] {} RaftInstance: config at index 25 is committed, prev config log idx 31 2025.04.02 04:07:40.843440 [ 24737 ] {} RaftInstance: skipped config 25, latest config 31 2025.04.02 04:07:40.843497 [ 24737 ] {} RaftInstance: config at index 26 is committed, prev config log idx 31 2025.04.02 04:07:40.843528 [ 24737 ] {} RaftInstance: skipped config 26, latest config 31 2025.04.02 04:07:40.843588 [ 24737 ] {} RaftInstance: config at index 27 is committed, prev config log idx 31 2025.04.02 04:07:40.843618 [ 24737 ] {} RaftInstance: skipped config 27, latest config 31 2025.04.02 04:07:40.843675 [ 24737 ] {} RaftInstance: config at index 28 is committed, prev config log idx 31 2025.04.02 04:07:40.843705 [ 24737 ] {} RaftInstance: skipped config 28, latest config 31 2025.04.02 04:07:40.843778 [ 24737 ] {} RaftInstance: config at index 29 is committed, prev config log idx 31 2025.04.02 04:07:40.843817 [ 24737 ] {} RaftInstance: skipped config 29, latest config 31 2025.04.02 04:07:40.843874 [ 24737 ] {} RaftInstance: config at index 30 is committed, prev config log idx 31 2025.04.02 04:07:40.843904 [ 24737 ] {} RaftInstance: skipped config 30, latest config 31 2025.04.02 04:07:40.843964 [ 24737 ] {} RaftInstance: config at index 31 is committed, prev config log idx 31 2025.04.02 04:07:40.843998 [ 24737 ] {} RaftInstance: skipped config 31, latest config 31 2025.04.02 04:07:40.844072 [ 24737 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:40.844111 [ 24737 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:40.844156 [ 24737 ] {} RaftInstance: config at index 32 is committed, prev config log idx 31 2025.04.02 04:07:40.844207 [ 24737 ] {} RaftInstance: new config log idx 32, prev log idx 31, cur config log idx 31, prev log idx 30 2025.04.02 04:07:40.844286 [ 24737 ] {} RaftInstance: new configuration: log idx 32, prev log idx 31 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 32 2025.04.02 04:07:40.844473 [ 24125 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:40.845409 [ 24125 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:40.847380 [ 24125 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:40.847742 [ 24125 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:40.859755 [ 24125 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:40.859843 [ 24125 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:40.860899 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:40.861287 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:40.861817 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:40.862089 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:40.862334 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:40.862595 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:40.862842 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:40.863177 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:40.867043 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:40.867448 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:40.867835 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:40.868217 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:40.868579 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:40.868939 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:40.869303 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:40.869743 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:40.870152 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:40.870675 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:40.871072 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:40.871484 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:40.871875 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:40.872383 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:40.873263 [ 24125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:40.955106 [ 24125 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:40.955391 [ 24125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:40.963219 [ 24125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:40.963331 [ 24125 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:40.966835 [ 24125 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:40.968253 [ 24125 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:40.968980 [ 24125 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:40.969568 [ 24743 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:41.062456 [ 24125 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:41.065859 [ 24125 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:41.111601 [ 24125 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:41.116526 [ 24125 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:41.124264 [ 24125 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:41.144581 [ 24125 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:41.146478 [ 24125 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:41.147846 [ 24125 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:41.147940 [ 24125 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:41.148088 [ 24135 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:41.149200 [ 24135 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:07:45.779788 [ 24125 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:45.780183 [ 24125 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:07:45.780520 [ 24125 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:07:45.780575 [ 24125 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:07:45.780784 [ 24651 ] {} CancellationChecker: Execution took 5875 ms. 2025.04.02 04:07:45.781016 [ 24125 ] {} Application: Shutting down storages. 2025.04.02 04:07:45.781070 [ 24125 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:07:45.782579 [ 24125 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:07:45.782639 [ 24125 ] {} Context: Shutting down workload entity storage 2025.04.02 04:07:45.782678 [ 24125 ] {} Context: Shutting down named sessions 2025.04.02 04:07:45.782796 [ 24125 ] {} Context: Shutting down database catalog 2025.04.02 04:07:45.782846 [ 24125 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:07:45.782913 [ 24125 ] {} Context: Shutting down merges executor 2025.04.02 04:07:45.783313 [ 24125 ] {} Context: Shutting down fetches executor 2025.04.02 04:07:45.783777 [ 24125 ] {} Context: Shutting down moves executor 2025.04.02 04:07:45.783959 [ 24125 ] {} Context: Shutting down common executor 2025.04.02 04:07:45.784163 [ 24125 ] {} Context: Shutting down DDLWorker 2025.04.02 04:07:45.784209 [ 24125 ] {} Context: Shutting down caches 2025.04.02 04:07:45.784253 [ 24125 ] {} Context: Shutting down AccessControl 2025.04.02 04:07:45.784510 [ 24125 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:07:45.786820 [ 24125 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:07:45.799176 [ 24125 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:07:45.799593 [ 24125 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:07:45.800082 [ 24125 ] {} Application: Shut down storages. 2025.04.02 04:07:45.800130 [ 24125 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:07:46.104575 [ 24125 ] {} Application: Closed all listening sockets. 2025.04.02 04:07:46.104685 [ 24125 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:07:46.104764 [ 24125 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:07:46.347364 [ 24125 ] {} RaftInstance: shutting down raft core 2025.04.02 04:07:46.347488 [ 24125 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:07:46.347559 [ 24125 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:07:46.347610 [ 24125 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:07:46.347653 [ 24125 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:07:46.347717 [ 24125 ] {} RaftInstance: reset all pointers. 2025.04.02 04:07:46.347763 [ 24125 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:07:46.347892 [ 24125 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:07:46.347921 [ 24738 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:07:46.348103 [ 24125 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:07:46.348156 [ 24125 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:07:46.348202 [ 24125 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:07:46.348473 [ 24724 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:07:46.348555 [ 24721 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:07:46.348682 [ 24727 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:07:46.348889 [ 24725 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:46.348678 [ 24723 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:07:46.349105 [ 24726 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:46.349289 [ 24736 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:46.349288 [ 24731 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:46.349084 [ 24730 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:07:46.349151 [ 24729 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:07:46.349315 [ 24722 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:07:46.349367 [ 24724 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:07:46.349320 [ 24732 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:46.349444 [ 24733 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:07:46.349382 [ 24735 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:07:46.349294 [ 24734 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:46.349299 [ 24728 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:46.349994 [ 24125 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:46.350015 [ 24719 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:07:46.350170 [ 24720 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:07:46.350823 [ 24125 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:07:46.350994 [ 24125 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:07:46.351057 [ 24125 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:07:46.351123 [ 24125 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:07:46.351172 [ 24125 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:46.351366 [ 24125 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:46.351407 [ 24125 ] {} Context: Destructing threadpool writer 2025.04.02 04:07:46.353984 [ 24125 ] {} Application: Destroyed global context. 2025.04.02 04:07:46.354476 [ 24125 ] {} Application: Waiting for background threads 2025.04.02 04:07:46.412790 [ 24125 ] {} Application: Background threads finished in 58 ms 2025.04.02 04:07:46.413217 [ 24125 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:07:46.413270 [ 24125 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:46.425384 [ 24125 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:46.425648 [ 24125 ] {} Application: shutting down 2025.04.02 04:07:46.425691 [ 24125 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:07:46.432192 [ 24128 ] {} BaseDaemon: Received signal -2 2025.04.02 04:07:46.432294 [ 24128 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:07:46.647160 [ 24123 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:46.966700 [ 24855 ] {} Application: Will watch for the process with pid 24857 2025.04.02 04:07:46.967692 [ 24857 ] {} Application: Forked a child process to watch 2025.04.02 04:07:46.968941 [ 24857 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:47.443929 [ 24857 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 24857 2025.04.02 04:07:47.444875 [ 24857 ] {} Application: starting up 2025.04.02 04:07:47.444961 [ 24857 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:47.476004 [ 24857 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:47.476145 [ 24857 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:47.476324 [ 24857 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:47.476396 [ 24857 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:47.476449 [ 24857 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:47.476475 [ 24857 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:47.477901 [ 24857 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:47.478331 [ 24857 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:47.478379 [ 24857 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:47.478574 [ 24857 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:47.478625 [ 24857 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:48.434727 [ 24857 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:48.437145 [ 24857 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:48.437209 [ 24857 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:48.437357 [ 24857 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:48.437982 [ 24857 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:48.594718 [ 24867 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:48.595054 [ 24857 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:48.595125 [ 24857 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:48.595191 [ 24857 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:48.595245 [ 24857 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:48.595582 [ 24857 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:48.596068 [ 24857 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:48.647042 [ 24857 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:48.647223 [ 24857 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:48.647720 [ 24857 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:48.648283 [ 24857 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:48.648398 [ 24857 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:48.649775 [ 24857 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:48.657993 [ 24857 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:48.658115 [ 24857 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:48.658270 [ 24857 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:48.658983 [ 24857 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:48.683323 [ 24857 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:48.683449 [ 24857 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:48.694094 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:48.695179 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:48.695551 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:48.695994 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:48.696390 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:48.696722 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:48.700911 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:48.701285 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:48.701661 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:48.702023 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:48.702419 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:48.702903 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:48.703248 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:48.703578 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:48.703904 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:48.704393 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:48.704739 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:48.705112 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:48.705455 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:48.705878 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:48.706240 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:48.796935 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:48.797601 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:48.798573 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:48.799646 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:48.800004 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:48.800988 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:48.802143 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:48.802580 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:48.802936 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:48.803304 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:48.803686 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:48.804090 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:48.804533 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:48.804906 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:48.805353 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:48.805761 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:48.806235 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:48.806775 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:48.807196 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:48.808342 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:48.808942 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:48.809338 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:48.809778 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:48.810198 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:48.810660 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:48.811239 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:48.811674 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:48.812127 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:48.812578 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:48.815079 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:48.815874 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:48.816806 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:48.817386 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:48.817820 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:48.818206 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:48.818955 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:48.819425 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:48.820024 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:48.820437 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:48.820892 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:48.821322 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:48.822007 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:48.822478 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:48.823053 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:48.823757 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:48.824242 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:48.826060 [ 24857 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:48.917211 [ 24857 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:48.919013 [ 24857 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:49.052904 [ 24857 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:49.053066 [ 24857 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:49.053117 [ 24857 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:49.124995 [ 24857 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:49.125080 [ 24857 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:49.125143 [ 24857 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:49.125283 [ 24857 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:49.131235 [ 24857 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:49.136684 [ 24857 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:49.148821 [ 24857 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:49.149265 [ 24857 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:49.149428 [ 24857 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:49.152241 [ 24857 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:49.152979 [ 24857 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:49.153293 [ 24857 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:49.154508 [ 24857 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:49.154584 [ 24857 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:49.156161 [ 24857 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:49.156201 [ 24857 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:49.156224 [ 24857 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:49.156263 [ 24857 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:49.156286 [ 24857 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:49.156455 [ 24857 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:49.156521 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.427697 [ 24857 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:49.437133 [ 24857 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:49.437207 [ 24857 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:49.438091 [ 24857 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:49.438211 [ 24857 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn 2025.04.02 04:07:49.438271 [ 24857 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn 2025.04.02 04:07:49.438323 [ 24857 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn, size 4 2025.04.02 04:07:49.438730 [ 24857 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn. 2025.04.02 04:07:49.438804 [ 25443 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn 2025.04.02 04:07:49.443638 [ 25443 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn, size 4 2025.04.02 04:07:49.444129 [ 24857 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/lhq/qetltuzxnovyvlipmopjfecdivvkn. 2025.04.02 04:07:49.444338 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lhq/qetltuzxnovyvlipmopjfecdivvkn (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.447182 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/lhq/qetltuzxnovyvlipmopjfecdivvkn (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.447259 [ 24857 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/lhq/qetltuzxnovyvlipmopjfecdivvkn, Version: Latest, Offset: 2 2025.04.02 04:07:49.452197 [ 24857 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/lhq/qetltuzxnovyvlipmopjfecdivvkn 2025.04.02 04:07:49.452269 [ 24857 ] {} deleteFileFromS3: Object with path s3/lhq/qetltuzxnovyvlipmopjfecdivvkn was removed from S3 2025.04.02 04:07:49.452326 [ 24857 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:49.452385 [ 24857 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:49.455890 [ 24857 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:49.465263 [ 24857 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:49.465320 [ 24857 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:49.465815 [ 24857 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:49.473051 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.477094 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.477192 [ 24857 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:49.483304 [ 24857 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:49.483488 [ 24857 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:49 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E4818394985 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:49.483633 [ 24857 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:49.487810 [ 24857 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:49.487867 [ 24857 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:49.487928 [ 24857 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:49.487964 [ 24857 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:49.488072 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.488136 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.488200 [ 24857 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:49.488256 [ 24857 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:49.488310 [ 24857 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:49.488361 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.488412 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.488472 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.488525 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.488575 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.491488 [ 24857 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:49.500889 [ 24857 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:49.500955 [ 24857 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:49.501606 [ 24857 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:49.508200 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/equ/hypwjtzexdpomvwynmpkqntjpfnfg (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.510544 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/equ/hypwjtzexdpomvwynmpkqntjpfnfg (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.510610 [ 24857 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/equ/hypwjtzexdpomvwynmpkqntjpfnfg, Version: Latest, Offset: 2 2025.04.02 04:07:49.514851 [ 24857 ] {} deleteFileFromS3: No blob storage log, not writing blob special/equ/hypwjtzexdpomvwynmpkqntjpfnfg 2025.04.02 04:07:49.514898 [ 24857 ] {} deleteFileFromS3: Object with path special/equ/hypwjtzexdpomvwynmpkqntjpfnfg was removed from S3 2025.04.02 04:07:49.514937 [ 24857 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:49.514969 [ 24857 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:49.517888 [ 24857 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:49.622903 [ 24857 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:49.622984 [ 24857 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:49.623813 [ 24857 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:49.629683 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/bkt/wmjnwlggdxkxbhzxobbwwowxtzhwf (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.632234 [ 24857 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/bkt/wmjnwlggdxkxbhzxobbwwowxtzhwf (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:49.632314 [ 24857 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/bkt/wmjnwlggdxkxbhzxobbwwowxtzhwf, Version: Latest, Offset: 2 2025.04.02 04:07:49.636987 [ 24857 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/bkt/wmjnwlggdxkxbhzxobbwwowxtzhwf 2025.04.02 04:07:49.637042 [ 24857 ] {} deleteFileFromS3: Object with path test_02944/bkt/wmjnwlggdxkxbhzxobbwwowxtzhwf was removed from S3 2025.04.02 04:07:49.637100 [ 24857 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:49.637145 [ 24857 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:49.637284 [ 24857 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:49.640458 [ 24857 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:49.644129 [ 24857 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:49.644247 [ 24857 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:49.645871 [ 24857 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:49.646018 [ 24857 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:49.733113 [ 24857 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:49.733211 [ 24857 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:49.733269 [ 24857 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:49.733323 [ 24857 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:49.733364 [ 24857 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:49.734053 [ 24857 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 32 entries 2025.04.02 04:07:49.734135 [ 24857 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:49.734254 [ 24857 ] {} KeeperServer: Last local log idx 32 2025.04.02 04:07:49.734314 [ 24857 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 32 2025.04.02 04:07:49.735919 [ 24857 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:49.746313 [ 24857 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:49.746723 [ 24857 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:49.746840 [ 24857 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:49.746914 [ 24857 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:49.746989 [ 24857 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:49.747037 [ 24857 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:49.747136 [ 24857 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 32 election timer allowed log store start 1, end 32 config log idx 32, prev log idx 31 -- ASYNC REPLICATION -- 2025.04.02 04:07:49.747184 [ 24857 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:49.747250 [ 24857 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:49.747313 [ 24857 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:49.748203 [ 24857 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:49.771124 [ 25451 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:49.798871 [ 25454 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:49.799137 [ 25454 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:49.799306 [ 25454 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 32, state term 32, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:49.799334 [ 24857 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:49.799405 [ 25454 ] {} RaftInstance: pre-vote term (0) is different, reset it to 32 2025.04.02 04:07:49.799825 [ 25454 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:49.803136 [ 25454 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 33, log idx 32, log term 32, priority (target 1 / mine 1) 2025.04.02 04:07:49.803259 [ 25454 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:49.803369 [ 25454 ] {} RaftInstance: state machine commit index 0, precommit index 32, last log index 32 2025.04.02 04:07:49.803489 [ 25454 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:49.803857 [ 25452 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:49.804115 [ 25454 ] {} RaftInstance: [BECOME LEADER] appended new config at 33 2025.04.02 04:07:49.804440 [ 25470 ] {} RaftInstance: config at index 1 is committed, prev config log idx 32 2025.04.02 04:07:49.804526 [ 25470 ] {} RaftInstance: skipped config 1, latest config 32 2025.04.02 04:07:49.804632 [ 25470 ] {} RaftInstance: config at index 2 is committed, prev config log idx 32 2025.04.02 04:07:49.804678 [ 25470 ] {} RaftInstance: skipped config 2, latest config 32 2025.04.02 04:07:49.804761 [ 25470 ] {} RaftInstance: config at index 3 is committed, prev config log idx 32 2025.04.02 04:07:49.804794 [ 25470 ] {} RaftInstance: skipped config 3, latest config 32 2025.04.02 04:07:49.804853 [ 25470 ] {} RaftInstance: config at index 4 is committed, prev config log idx 32 2025.04.02 04:07:49.804884 [ 25470 ] {} RaftInstance: skipped config 4, latest config 32 2025.04.02 04:07:49.804943 [ 25470 ] {} RaftInstance: config at index 5 is committed, prev config log idx 32 2025.04.02 04:07:49.804973 [ 25470 ] {} RaftInstance: skipped config 5, latest config 32 2025.04.02 04:07:49.805030 [ 25470 ] {} RaftInstance: config at index 6 is committed, prev config log idx 32 2025.04.02 04:07:49.805059 [ 25470 ] {} RaftInstance: skipped config 6, latest config 32 2025.04.02 04:07:49.805113 [ 25470 ] {} RaftInstance: config at index 7 is committed, prev config log idx 32 2025.04.02 04:07:49.805147 [ 25470 ] {} RaftInstance: skipped config 7, latest config 32 2025.04.02 04:07:49.805205 [ 25470 ] {} RaftInstance: config at index 8 is committed, prev config log idx 32 2025.04.02 04:07:49.805245 [ 25470 ] {} RaftInstance: skipped config 8, latest config 32 2025.04.02 04:07:49.805302 [ 25470 ] {} RaftInstance: config at index 9 is committed, prev config log idx 32 2025.04.02 04:07:49.805331 [ 25470 ] {} RaftInstance: skipped config 9, latest config 32 2025.04.02 04:07:49.805386 [ 25470 ] {} RaftInstance: config at index 10 is committed, prev config log idx 32 2025.04.02 04:07:49.805415 [ 25470 ] {} RaftInstance: skipped config 10, latest config 32 2025.04.02 04:07:49.805469 [ 25470 ] {} RaftInstance: config at index 11 is committed, prev config log idx 32 2025.04.02 04:07:49.805496 [ 25470 ] {} RaftInstance: skipped config 11, latest config 32 2025.04.02 04:07:49.805548 [ 25470 ] {} RaftInstance: config at index 12 is committed, prev config log idx 32 2025.04.02 04:07:49.805582 [ 25470 ] {} RaftInstance: skipped config 12, latest config 32 2025.04.02 04:07:49.805634 [ 25470 ] {} RaftInstance: config at index 13 is committed, prev config log idx 32 2025.04.02 04:07:49.805662 [ 25470 ] {} RaftInstance: skipped config 13, latest config 32 2025.04.02 04:07:49.805746 [ 25470 ] {} RaftInstance: config at index 14 is committed, prev config log idx 32 2025.04.02 04:07:49.805790 [ 25470 ] {} RaftInstance: skipped config 14, latest config 32 2025.04.02 04:07:49.805862 [ 25470 ] {} RaftInstance: config at index 15 is committed, prev config log idx 32 2025.04.02 04:07:49.805893 [ 25470 ] {} RaftInstance: skipped config 15, latest config 32 2025.04.02 04:07:49.805951 [ 25470 ] {} RaftInstance: config at index 16 is committed, prev config log idx 32 2025.04.02 04:07:49.805980 [ 25470 ] {} RaftInstance: skipped config 16, latest config 32 2025.04.02 04:07:49.806043 [ 25470 ] {} RaftInstance: config at index 17 is committed, prev config log idx 32 2025.04.02 04:07:49.806077 [ 25470 ] {} RaftInstance: skipped config 17, latest config 32 2025.04.02 04:07:49.806130 [ 25470 ] {} RaftInstance: config at index 18 is committed, prev config log idx 32 2025.04.02 04:07:49.806158 [ 25470 ] {} RaftInstance: skipped config 18, latest config 32 2025.04.02 04:07:49.806210 [ 25470 ] {} RaftInstance: config at index 19 is committed, prev config log idx 32 2025.04.02 04:07:49.806237 [ 25470 ] {} RaftInstance: skipped config 19, latest config 32 2025.04.02 04:07:49.806293 [ 25470 ] {} RaftInstance: config at index 20 is committed, prev config log idx 32 2025.04.02 04:07:49.806322 [ 25470 ] {} RaftInstance: skipped config 20, latest config 32 2025.04.02 04:07:49.806373 [ 25470 ] {} RaftInstance: config at index 21 is committed, prev config log idx 32 2025.04.02 04:07:49.900562 [ 25470 ] {} RaftInstance: skipped config 21, latest config 32 2025.04.02 04:07:49.900699 [ 25470 ] {} RaftInstance: config at index 22 is committed, prev config log idx 32 2025.04.02 04:07:49.900796 [ 25470 ] {} RaftInstance: skipped config 22, latest config 32 2025.04.02 04:07:49.900875 [ 25470 ] {} RaftInstance: config at index 23 is committed, prev config log idx 32 2025.04.02 04:07:49.900912 [ 25470 ] {} RaftInstance: skipped config 23, latest config 32 2025.04.02 04:07:49.900996 [ 25470 ] {} RaftInstance: config at index 24 is committed, prev config log idx 32 2025.04.02 04:07:49.901036 [ 25470 ] {} RaftInstance: skipped config 24, latest config 32 2025.04.02 04:07:49.901107 [ 25470 ] {} RaftInstance: config at index 25 is committed, prev config log idx 32 2025.04.02 04:07:49.901142 [ 25470 ] {} RaftInstance: skipped config 25, latest config 32 2025.04.02 04:07:49.901208 [ 25470 ] {} RaftInstance: config at index 26 is committed, prev config log idx 32 2025.04.02 04:07:49.901242 [ 25470 ] {} RaftInstance: skipped config 26, latest config 32 2025.04.02 04:07:49.901319 [ 25470 ] {} RaftInstance: config at index 27 is committed, prev config log idx 32 2025.04.02 04:07:49.901356 [ 25470 ] {} RaftInstance: skipped config 27, latest config 32 2025.04.02 04:07:49.901433 [ 25470 ] {} RaftInstance: config at index 28 is committed, prev config log idx 32 2025.04.02 04:07:49.901490 [ 25470 ] {} RaftInstance: skipped config 28, latest config 32 2025.04.02 04:07:49.901565 [ 25470 ] {} RaftInstance: config at index 29 is committed, prev config log idx 32 2025.04.02 04:07:49.901606 [ 25470 ] {} RaftInstance: skipped config 29, latest config 32 2025.04.02 04:07:49.901674 [ 25470 ] {} RaftInstance: config at index 30 is committed, prev config log idx 32 2025.04.02 04:07:49.901728 [ 25470 ] {} RaftInstance: skipped config 30, latest config 32 2025.04.02 04:07:49.901800 [ 25470 ] {} RaftInstance: config at index 31 is committed, prev config log idx 32 2025.04.02 04:07:49.901846 [ 25470 ] {} RaftInstance: skipped config 31, latest config 32 2025.04.02 04:07:49.901918 [ 25470 ] {} RaftInstance: config at index 32 is committed, prev config log idx 32 2025.04.02 04:07:49.901953 [ 25470 ] {} RaftInstance: skipped config 32, latest config 32 2025.04.02 04:07:49.902036 [ 25470 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:49.902075 [ 25470 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:49.902130 [ 25470 ] {} RaftInstance: config at index 33 is committed, prev config log idx 32 2025.04.02 04:07:49.902197 [ 25470 ] {} RaftInstance: new config log idx 33, prev log idx 32, cur config log idx 32, prev log idx 31 2025.04.02 04:07:49.902301 [ 25470 ] {} RaftInstance: new configuration: log idx 33, prev log idx 32 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 33 2025.04.02 04:07:49.902515 [ 24857 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:49.903359 [ 24857 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:49.905479 [ 24857 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:49.905863 [ 24857 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:49.922229 [ 24857 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:49.922326 [ 24857 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:49.923779 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:49.924307 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:49.925080 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:49.925483 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:49.925902 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:49.926217 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:49.926598 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:49.927159 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:49.933292 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:49.933963 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:49.934593 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:49.935244 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:49.935806 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:49.936303 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:49.936842 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:49.937477 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:49.938014 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:49.938738 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:49.939254 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:49.939895 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:49.940459 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:49.941168 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:49.942523 [ 24857 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:49.955758 [ 24857 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:49.956209 [ 24857 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:49.967936 [ 24857 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:49.968126 [ 24857 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:49.972988 [ 24857 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:49.974243 [ 24857 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:49.975076 [ 24857 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:49.975819 [ 25476 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:49.983357 [ 24857 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:49.986347 [ 24857 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:49.992225 [ 24857 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:49.995148 [ 24857 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:50.000818 [ 24857 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:50.003569 [ 24857 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:50.005751 [ 24857 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:50.007775 [ 24857 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:50.007903 [ 24857 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:50.007952 [ 24868 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:50.008725 [ 24868 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:07:54.871484 [ 24857 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:54.872458 [ 24857 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:07:54.872893 [ 24857 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:07:54.872943 [ 24857 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:07:54.873065 [ 24867 ] {} CancellationChecker: Execution took 6278 ms. 2025.04.02 04:07:54.873299 [ 24857 ] {} Application: Shutting down storages. 2025.04.02 04:07:54.873348 [ 24857 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:07:54.874768 [ 24857 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:07:54.874809 [ 24857 ] {} Context: Shutting down workload entity storage 2025.04.02 04:07:54.874840 [ 24857 ] {} Context: Shutting down named sessions 2025.04.02 04:07:54.874891 [ 24857 ] {} Context: Shutting down database catalog 2025.04.02 04:07:54.874922 [ 24857 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:07:54.874972 [ 24857 ] {} Context: Shutting down merges executor 2025.04.02 04:07:54.875469 [ 24857 ] {} Context: Shutting down fetches executor 2025.04.02 04:07:54.875989 [ 24857 ] {} Context: Shutting down moves executor 2025.04.02 04:07:54.876202 [ 24857 ] {} Context: Shutting down common executor 2025.04.02 04:07:54.876494 [ 24857 ] {} Context: Shutting down DDLWorker 2025.04.02 04:07:54.876525 [ 24857 ] {} Context: Shutting down caches 2025.04.02 04:07:54.876552 [ 24857 ] {} Context: Shutting down AccessControl 2025.04.02 04:07:54.876798 [ 24857 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:07:54.879561 [ 24857 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:07:54.928178 [ 24857 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:07:54.928729 [ 24857 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:07:54.929224 [ 24857 ] {} Application: Shut down storages. 2025.04.02 04:07:54.929278 [ 24857 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:07:55.412501 [ 24857 ] {} Application: Closed all listening sockets. 2025.04.02 04:07:55.412586 [ 24857 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:07:55.412667 [ 24857 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:07:55.905495 [ 24857 ] {} RaftInstance: shutting down raft core 2025.04.02 04:07:55.905629 [ 24857 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:07:55.905694 [ 24857 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:07:55.905753 [ 24857 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:07:55.905802 [ 24857 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:07:55.905855 [ 24857 ] {} RaftInstance: reset all pointers. 2025.04.02 04:07:55.905923 [ 24857 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:07:55.906080 [ 24857 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:07:55.906107 [ 25451 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:07:55.906300 [ 24857 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:07:55.906373 [ 24857 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:07:55.906491 [ 24857 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:07:55.906818 [ 25457 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:07:55.906989 [ 25454 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:55.907044 [ 25455 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:07:55.907169 [ 25462 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:07:55.907460 [ 25457 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:07:55.907157 [ 25465 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:07:55.907497 [ 25459 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:07:55.907556 [ 25467 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:07:55.907566 [ 25466 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:07:55.907566 [ 25456 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:07:55.907637 [ 25464 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:07:55.907789 [ 25458 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:07:55.907638 [ 25460 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:07:55.907649 [ 25461 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:07:55.907641 [ 25468 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:07:55.907833 [ 25469 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:07:55.907857 [ 25463 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:07:55.908461 [ 24857 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:55.908521 [ 25452 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:07:55.908673 [ 25453 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:07:55.909304 [ 24857 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:07:55.909492 [ 24857 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:07:55.909559 [ 24857 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:07:55.909632 [ 24857 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:07:55.909722 [ 24857 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:55.909904 [ 24857 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:07:55.909953 [ 24857 ] {} Context: Destructing threadpool writer 2025.04.02 04:07:55.914069 [ 24857 ] {} Application: Destroyed global context. 2025.04.02 04:07:55.914743 [ 24857 ] {} Application: Waiting for background threads 2025.04.02 04:07:55.992971 [ 24857 ] {} Application: Background threads finished in 78 ms 2025.04.02 04:07:55.993608 [ 24857 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:07:55.993694 [ 24857 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:07:56.084912 [ 24857 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:07:56.085168 [ 24857 ] {} Application: shutting down 2025.04.02 04:07:56.085211 [ 24857 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:07:56.093745 [ 24860 ] {} BaseDaemon: Received signal -2 2025.04.02 04:07:56.093899 [ 24860 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:07:56.270154 [ 24855 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:07:56.577243 [ 25592 ] {} Application: Will watch for the process with pid 25594 2025.04.02 04:07:56.578529 [ 25594 ] {} Application: Forked a child process to watch 2025.04.02 04:07:56.580065 [ 25594 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:07:57.074639 [ 25594 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 25594 2025.04.02 04:07:57.075547 [ 25594 ] {} Application: starting up 2025.04.02 04:07:57.075636 [ 25594 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:07:57.108025 [ 25594 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:07:57.108169 [ 25594 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:07:57.108353 [ 25594 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:07:57.108414 [ 25594 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:07:57.108451 [ 25594 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:07:57.108485 [ 25594 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:07:57.109908 [ 25594 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:07:57.110336 [ 25594 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:07:57.110402 [ 25594 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:07:57.110579 [ 25594 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:07:57.110630 [ 25594 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:07:57.965607 [ 25594 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:07:57.967840 [ 25594 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:07:57.967948 [ 25594 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:07:57.968119 [ 25594 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:07:57.968750 [ 25594 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:07:58.174348 [ 25604 ] {} CancellationChecker: Started worker function 2025.04.02 04:07:58.174731 [ 25594 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:07:58.174810 [ 25594 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:07:58.174885 [ 25594 ] {} Application: Initializing DateLUT. 2025.04.02 04:07:58.174930 [ 25594 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:07:58.175215 [ 25594 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:07:58.175715 [ 25594 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:07:58.278053 [ 25594 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:07:58.278242 [ 25594 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:07:58.278721 [ 25594 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:07:58.279323 [ 25594 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:07:58.279454 [ 25594 ] {} Application: Initializing interserver credentials. 2025.04.02 04:07:58.280676 [ 25594 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:07:58.325309 [ 25594 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:58.325423 [ 25594 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:07:58.325562 [ 25594 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:07:58.326132 [ 25594 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:07:58.393176 [ 25594 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:07:58.393296 [ 25594 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:07:58.403123 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:07:58.404381 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:07:58.404888 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:07:58.405452 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:07:58.406014 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:07:58.406498 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:07:58.412153 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:07:58.412679 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:07:58.413143 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:07:58.413508 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:07:58.413880 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:07:58.414318 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:07:58.414717 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:07:58.415067 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:07:58.415396 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:07:58.415937 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:07:58.416286 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:07:58.416716 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:07:58.417098 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:07:58.417590 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:07:58.417969 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:07:58.418365 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:07:58.418802 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:07:58.419507 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:07:58.420549 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:07:58.420903 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:07:58.421874 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:07:58.423037 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:07:58.423440 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:07:58.423782 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:07:58.424164 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:07:58.424554 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:07:58.424963 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:07:58.425423 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:07:58.425792 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:07:58.426257 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:07:58.426671 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:07:58.427248 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:07:58.427826 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:07:58.428282 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:07:58.429439 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:07:58.430086 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:07:58.430581 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:07:58.431042 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:07:58.431493 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:07:58.431942 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:07:58.432509 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:07:58.432953 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:07:58.433391 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:07:58.433881 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:07:58.436397 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:07:58.437250 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:07:58.438297 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:07:58.515276 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:07:58.516054 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:07:58.516657 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:07:58.517609 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:07:58.518212 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:07:58.518894 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:07:58.519342 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:07:58.519841 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:07:58.520290 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:07:58.521010 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:07:58.521470 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:07:58.522087 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:07:58.522835 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:07:58.523347 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:07:58.525259 [ 25594 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:07:58.572304 [ 25594 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:07:58.574350 [ 25594 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:07:58.774588 [ 25594 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:07:58.774685 [ 25594 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:07:58.774734 [ 25594 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:07:58.789845 [ 25594 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:07:58.789897 [ 25594 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:07:58.789945 [ 25594 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:07:58.790066 [ 25594 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:58.796764 [ 25594 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:58.803228 [ 25594 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:07:58.814997 [ 25594 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:07:58.815361 [ 25594 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:07:58.815478 [ 25594 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:58.817577 [ 25594 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:07:58.818165 [ 25594 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:07:58.818455 [ 25594 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:07:58.819483 [ 25594 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:07:58.819548 [ 25594 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:07:58.821077 [ 25594 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:07:58.821116 [ 25594 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:07:58.821141 [ 25594 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:07:58.821180 [ 25594 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:07:58.821205 [ 25594 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:07:58.821418 [ 25594 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:58.821492 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.226080 [ 25594 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:59.237992 [ 25594 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:59.238090 [ 25594 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:59.280737 [ 25594 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:59.280930 [ 25594 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq 2025.04.02 04:07:59.281010 [ 25594 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq 2025.04.02 04:07:59.281082 [ 25594 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq, size 4 2025.04.02 04:07:59.281736 [ 25594 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq. 2025.04.02 04:07:59.281908 [ 26180 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq 2025.04.02 04:07:59.289448 [ 26180 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq, size 4 2025.04.02 04:07:59.290345 [ 25594 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/vyc/eswnaurnxaypawkncfallawnvcbkq. 2025.04.02 04:07:59.290772 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vyc/eswnaurnxaypawkncfallawnvcbkq (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.294328 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/vyc/eswnaurnxaypawkncfallawnvcbkq (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.294480 [ 25594 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/vyc/eswnaurnxaypawkncfallawnvcbkq, Version: Latest, Offset: 2 2025.04.02 04:07:59.301286 [ 25594 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/vyc/eswnaurnxaypawkncfallawnvcbkq 2025.04.02 04:07:59.301384 [ 25594 ] {} deleteFileFromS3: Object with path s3/vyc/eswnaurnxaypawkncfallawnvcbkq was removed from S3 2025.04.02 04:07:59.301451 [ 25594 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:07:59.301509 [ 25594 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:07:59.305659 [ 25594 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:59.318371 [ 25594 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:59.318534 [ 25594 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:59.319209 [ 25594 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:59.330104 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.336247 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.336397 [ 25594 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:07:59.344845 [ 25594 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:07:59.345152 [ 25594 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:07:59 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E4A640289EB x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:07:59.345398 [ 25594 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:07:59.351463 [ 25594 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:59.351562 [ 25594 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:07:59.351642 [ 25594 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:07:59.351719 [ 25594 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:07:59.351876 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.351984 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.352083 [ 25594 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:59.352170 [ 25594 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:59.352247 [ 25594 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:07:59.352321 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.352392 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.352479 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.352555 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.352630 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.356801 [ 25594 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:59.372757 [ 25594 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:59.372885 [ 25594 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:59.373980 [ 25594 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:59.381055 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/elu/gfseldakcvqsdlipvoujeupkgbuwh (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.384574 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/elu/gfseldakcvqsdlipvoujeupkgbuwh (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.384675 [ 25594 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/elu/gfseldakcvqsdlipvoujeupkgbuwh, Version: Latest, Offset: 2 2025.04.02 04:07:59.391262 [ 25594 ] {} deleteFileFromS3: No blob storage log, not writing blob special/elu/gfseldakcvqsdlipvoujeupkgbuwh 2025.04.02 04:07:59.391360 [ 25594 ] {} deleteFileFromS3: Object with path special/elu/gfseldakcvqsdlipvoujeupkgbuwh was removed from S3 2025.04.02 04:07:59.391443 [ 25594 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:07:59.391513 [ 25594 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:07:59.396607 [ 25594 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:07:59.485819 [ 25594 ] {} S3Client: Provider type: Unknown 2025.04.02 04:07:59.485905 [ 25594 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:07:59.487038 [ 25594 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:07:59.494244 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mss/zekjijypvnenzgvefqcbgikvvwxka (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.497895 [ 25594 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mss/zekjijypvnenzgvefqcbgikvvwxka (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:07:59.498044 [ 25594 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/mss/zekjijypvnenzgvefqcbgikvvwxka, Version: Latest, Offset: 2 2025.04.02 04:07:59.565513 [ 25594 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/mss/zekjijypvnenzgvefqcbgikvvwxka 2025.04.02 04:07:59.565616 [ 25594 ] {} deleteFileFromS3: Object with path test_02944/mss/zekjijypvnenzgvefqcbgikvvwxka was removed from S3 2025.04.02 04:07:59.565738 [ 25594 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:07:59.565797 [ 25594 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:07:59.565960 [ 25594 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:07:59.571496 [ 25594 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:07:59.577673 [ 25594 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:07:59.577883 [ 25594 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:07:59.580736 [ 25594 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:07:59.581114 [ 25594 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:07:59.582490 [ 25594 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:07:59.582591 [ 25594 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:07:59.582675 [ 25594 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:07:59.582808 [ 25594 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:07:59.582874 [ 25594 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:07:59.584042 [ 25594 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 33 entries 2025.04.02 04:07:59.584153 [ 25594 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:07:59.584352 [ 25594 ] {} KeeperServer: Last local log idx 33 2025.04.02 04:07:59.584442 [ 25594 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 33 2025.04.02 04:07:59.586589 [ 25594 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:07:59.603876 [ 25594 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:07:59.604427 [ 25594 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:07:59.604594 [ 25594 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:07:59.604724 [ 25594 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:07:59.604849 [ 25594 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:07:59.604935 [ 25594 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:07:59.605131 [ 25594 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 33 election timer allowed log store start 1, end 33 config log idx 33, prev log idx 32 -- ASYNC REPLICATION -- 2025.04.02 04:07:59.605238 [ 25594 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:07:59.605361 [ 25594 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:07:59.605517 [ 25594 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:07:59.606296 [ 25594 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:07:59.606379 [ 26207 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:07:59.656935 [ 26190 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:07:59.657160 [ 26190 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:07:59.657302 [ 26190 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 33, state term 33, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:07:59.657379 [ 26190 ] {} RaftInstance: pre-vote term (0) is different, reset it to 33 2025.04.02 04:07:59.657643 [ 25594 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:07:59.657791 [ 26190 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:07:59.660937 [ 26190 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 34, log idx 33, log term 33, priority (target 1 / mine 1) 2025.04.02 04:07:59.661031 [ 26190 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:07:59.661095 [ 26190 ] {} RaftInstance: state machine commit index 0, precommit index 33, last log index 33 2025.04.02 04:07:59.661166 [ 26190 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:07:59.661692 [ 26188 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:07:59.661958 [ 26190 ] {} RaftInstance: [BECOME LEADER] appended new config at 34 2025.04.02 04:07:59.662349 [ 26206 ] {} RaftInstance: config at index 1 is committed, prev config log idx 33 2025.04.02 04:07:59.662640 [ 26206 ] {} RaftInstance: skipped config 1, latest config 33 2025.04.02 04:07:59.662788 [ 26206 ] {} RaftInstance: config at index 2 is committed, prev config log idx 33 2025.04.02 04:07:59.662840 [ 26206 ] {} RaftInstance: skipped config 2, latest config 33 2025.04.02 04:07:59.662912 [ 26206 ] {} RaftInstance: config at index 3 is committed, prev config log idx 33 2025.04.02 04:07:59.662951 [ 26206 ] {} RaftInstance: skipped config 3, latest config 33 2025.04.02 04:07:59.663085 [ 26206 ] {} RaftInstance: config at index 4 is committed, prev config log idx 33 2025.04.02 04:07:59.663127 [ 26206 ] {} RaftInstance: skipped config 4, latest config 33 2025.04.02 04:07:59.663227 [ 26206 ] {} RaftInstance: config at index 5 is committed, prev config log idx 33 2025.04.02 04:07:59.663270 [ 26206 ] {} RaftInstance: skipped config 5, latest config 33 2025.04.02 04:07:59.663343 [ 26206 ] {} RaftInstance: config at index 6 is committed, prev config log idx 33 2025.04.02 04:07:59.663377 [ 26206 ] {} RaftInstance: skipped config 6, latest config 33 2025.04.02 04:07:59.663442 [ 26206 ] {} RaftInstance: config at index 7 is committed, prev config log idx 33 2025.04.02 04:07:59.663481 [ 26206 ] {} RaftInstance: skipped config 7, latest config 33 2025.04.02 04:07:59.663549 [ 26206 ] {} RaftInstance: config at index 8 is committed, prev config log idx 33 2025.04.02 04:07:59.663602 [ 26206 ] {} RaftInstance: skipped config 8, latest config 33 2025.04.02 04:07:59.663716 [ 26206 ] {} RaftInstance: config at index 9 is committed, prev config log idx 33 2025.04.02 04:07:59.663756 [ 26206 ] {} RaftInstance: skipped config 9, latest config 33 2025.04.02 04:07:59.663842 [ 26206 ] {} RaftInstance: config at index 10 is committed, prev config log idx 33 2025.04.02 04:07:59.663902 [ 26206 ] {} RaftInstance: skipped config 10, latest config 33 2025.04.02 04:07:59.663994 [ 26206 ] {} RaftInstance: config at index 11 is committed, prev config log idx 33 2025.04.02 04:07:59.664041 [ 26206 ] {} RaftInstance: skipped config 11, latest config 33 2025.04.02 04:07:59.664125 [ 26206 ] {} RaftInstance: config at index 12 is committed, prev config log idx 33 2025.04.02 04:07:59.664172 [ 26206 ] {} RaftInstance: skipped config 12, latest config 33 2025.04.02 04:07:59.664252 [ 26206 ] {} RaftInstance: config at index 13 is committed, prev config log idx 33 2025.04.02 04:07:59.664302 [ 26206 ] {} RaftInstance: skipped config 13, latest config 33 2025.04.02 04:07:59.664379 [ 26206 ] {} RaftInstance: config at index 14 is committed, prev config log idx 33 2025.04.02 04:07:59.664416 [ 26206 ] {} RaftInstance: skipped config 14, latest config 33 2025.04.02 04:07:59.664495 [ 26206 ] {} RaftInstance: config at index 15 is committed, prev config log idx 33 2025.04.02 04:07:59.664531 [ 26206 ] {} RaftInstance: skipped config 15, latest config 33 2025.04.02 04:07:59.664611 [ 26206 ] {} RaftInstance: config at index 16 is committed, prev config log idx 33 2025.04.02 04:07:59.664651 [ 26206 ] {} RaftInstance: skipped config 16, latest config 33 2025.04.02 04:07:59.664740 [ 26206 ] {} RaftInstance: config at index 17 is committed, prev config log idx 33 2025.04.02 04:07:59.664788 [ 26206 ] {} RaftInstance: skipped config 17, latest config 33 2025.04.02 04:07:59.664867 [ 26206 ] {} RaftInstance: config at index 18 is committed, prev config log idx 33 2025.04.02 04:07:59.664913 [ 26206 ] {} RaftInstance: skipped config 18, latest config 33 2025.04.02 04:07:59.664990 [ 26206 ] {} RaftInstance: config at index 19 is committed, prev config log idx 33 2025.04.02 04:07:59.665049 [ 26206 ] {} RaftInstance: skipped config 19, latest config 33 2025.04.02 04:07:59.665140 [ 26206 ] {} RaftInstance: config at index 20 is committed, prev config log idx 33 2025.04.02 04:07:59.665179 [ 26206 ] {} RaftInstance: skipped config 20, latest config 33 2025.04.02 04:07:59.665255 [ 26206 ] {} RaftInstance: config at index 21 is committed, prev config log idx 33 2025.04.02 04:07:59.665304 [ 26206 ] {} RaftInstance: skipped config 21, latest config 33 2025.04.02 04:07:59.665385 [ 26206 ] {} RaftInstance: config at index 22 is committed, prev config log idx 33 2025.04.02 04:07:59.665464 [ 26206 ] {} RaftInstance: skipped config 22, latest config 33 2025.04.02 04:07:59.665545 [ 26206 ] {} RaftInstance: config at index 23 is committed, prev config log idx 33 2025.04.02 04:07:59.665583 [ 26206 ] {} RaftInstance: skipped config 23, latest config 33 2025.04.02 04:07:59.665663 [ 26206 ] {} RaftInstance: config at index 24 is committed, prev config log idx 33 2025.04.02 04:07:59.665722 [ 26206 ] {} RaftInstance: skipped config 24, latest config 33 2025.04.02 04:07:59.665809 [ 26206 ] {} RaftInstance: config at index 25 is committed, prev config log idx 33 2025.04.02 04:07:59.665858 [ 26206 ] {} RaftInstance: skipped config 25, latest config 33 2025.04.02 04:07:59.665941 [ 26206 ] {} RaftInstance: config at index 26 is committed, prev config log idx 33 2025.04.02 04:07:59.665987 [ 26206 ] {} RaftInstance: skipped config 26, latest config 33 2025.04.02 04:07:59.666118 [ 26206 ] {} RaftInstance: config at index 27 is committed, prev config log idx 33 2025.04.02 04:07:59.666194 [ 26206 ] {} RaftInstance: skipped config 27, latest config 33 2025.04.02 04:07:59.666301 [ 26206 ] {} RaftInstance: config at index 28 is committed, prev config log idx 33 2025.04.02 04:07:59.666350 [ 26206 ] {} RaftInstance: skipped config 28, latest config 33 2025.04.02 04:07:59.666536 [ 26206 ] {} RaftInstance: config at index 29 is committed, prev config log idx 33 2025.04.02 04:07:59.666578 [ 26206 ] {} RaftInstance: skipped config 29, latest config 33 2025.04.02 04:07:59.666627 [ 26206 ] {} RaftInstance: config at index 30 is committed, prev config log idx 33 2025.04.02 04:07:59.666651 [ 26206 ] {} RaftInstance: skipped config 30, latest config 33 2025.04.02 04:07:59.666714 [ 26206 ] {} RaftInstance: config at index 31 is committed, prev config log idx 33 2025.04.02 04:07:59.666746 [ 26206 ] {} RaftInstance: skipped config 31, latest config 33 2025.04.02 04:07:59.666802 [ 26206 ] {} RaftInstance: config at index 32 is committed, prev config log idx 33 2025.04.02 04:07:59.666825 [ 26206 ] {} RaftInstance: skipped config 32, latest config 33 2025.04.02 04:07:59.666868 [ 26206 ] {} RaftInstance: config at index 33 is committed, prev config log idx 33 2025.04.02 04:07:59.666891 [ 26206 ] {} RaftInstance: skipped config 33, latest config 33 2025.04.02 04:07:59.666951 [ 26206 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:07:59.666987 [ 26206 ] {} KeeperServer: Preprocessing done 2025.04.02 04:07:59.667024 [ 26206 ] {} RaftInstance: config at index 34 is committed, prev config log idx 33 2025.04.02 04:07:59.667096 [ 26206 ] {} RaftInstance: new config log idx 34, prev log idx 33, cur config log idx 33, prev log idx 32 2025.04.02 04:07:59.667209 [ 26206 ] {} RaftInstance: new configuration: log idx 34, prev log idx 33 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 34 2025.04.02 04:07:59.667437 [ 25594 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:07:59.668352 [ 25594 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:07:59.670534 [ 25594 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:07:59.671076 [ 25594 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:07:59.690015 [ 25594 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:07:59.690217 [ 25594 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:07:59.692123 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:07:59.692737 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:07:59.693554 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:07:59.694123 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:07:59.694683 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:07:59.695154 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:07:59.695524 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:07:59.696111 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:07:59.703813 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:07:59.704633 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:07:59.705395 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:07:59.706085 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:07:59.802201 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:07:59.803111 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:07:59.803838 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:07:59.804821 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:07:59.805574 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:07:59.806524 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:07:59.807307 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:07:59.808031 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:07:59.808727 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:07:59.809612 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:07:59.811099 [ 25594 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:07:59.825500 [ 25594 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:07:59.826057 [ 25594 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:07:59.839667 [ 25594 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:07:59.839912 [ 25594 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:07:59.846007 [ 25594 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:07:59.848641 [ 25594 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:07:59.849471 [ 25594 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:07:59.849971 [ 26213 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:07:59.861483 [ 25594 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:07:59.866278 [ 25594 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:07:59.873611 [ 25594 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:07:59.877101 [ 25594 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:07:59.884550 [ 25594 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:07:59.888205 [ 25594 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:07:59.891074 [ 25594 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:07:59.893149 [ 25594 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:07:59.893309 [ 25594 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:07:59.893359 [ 25605 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:07:59.894187 [ 25605 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:08:04.615625 [ 25594 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:08:04.616061 [ 25594 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:08:04.616607 [ 25594 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:08:04.616674 [ 25594 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:08:04.616855 [ 25604 ] {} CancellationChecker: Execution took 6442 ms. 2025.04.02 04:08:04.617111 [ 25594 ] {} Application: Shutting down storages. 2025.04.02 04:08:04.617165 [ 25594 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:08:04.618602 [ 25594 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:08:04.618650 [ 25594 ] {} Context: Shutting down workload entity storage 2025.04.02 04:08:04.618678 [ 25594 ] {} Context: Shutting down named sessions 2025.04.02 04:08:04.618753 [ 25594 ] {} Context: Shutting down database catalog 2025.04.02 04:08:04.618787 [ 25594 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:08:04.618849 [ 25594 ] {} Context: Shutting down merges executor 2025.04.02 04:08:04.619273 [ 25594 ] {} Context: Shutting down fetches executor 2025.04.02 04:08:04.619591 [ 25594 ] {} Context: Shutting down moves executor 2025.04.02 04:08:04.619797 [ 25594 ] {} Context: Shutting down common executor 2025.04.02 04:08:04.620060 [ 25594 ] {} Context: Shutting down DDLWorker 2025.04.02 04:08:04.620094 [ 25594 ] {} Context: Shutting down caches 2025.04.02 04:08:04.620125 [ 25594 ] {} Context: Shutting down AccessControl 2025.04.02 04:08:04.620349 [ 25594 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:08:04.622403 [ 25594 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:08:04.721479 [ 25594 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:08:04.722020 [ 25594 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:08:04.722773 [ 25594 ] {} Application: Shut down storages. 2025.04.02 04:08:04.722829 [ 25594 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:08:05.177298 [ 25594 ] {} Application: Closed all listening sockets. 2025.04.02 04:08:05.177400 [ 25594 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:08:05.177488 [ 25594 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:08:05.670727 [ 25594 ] {} RaftInstance: shutting down raft core 2025.04.02 04:08:05.670869 [ 25594 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:08:05.670946 [ 25594 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:08:05.670999 [ 25594 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:08:05.671072 [ 25594 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:08:05.671116 [ 25594 ] {} RaftInstance: reset all pointers. 2025.04.02 04:08:05.671161 [ 25594 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:08:05.671280 [ 25594 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:08:05.671295 [ 26207 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:08:05.671480 [ 25594 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:08:05.671543 [ 25594 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:08:05.671584 [ 25594 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:08:05.671949 [ 26190 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:08:05.672194 [ 26199 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:08:05.672246 [ 26198 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:08:05.672376 [ 26193 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:08:05.672390 [ 26194 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:08:05.672652 [ 26205 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:08:05.672658 [ 26195 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:08:05.672668 [ 26197 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:08:05.672980 [ 26204 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:08:05.673042 [ 26201 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:08:05.672914 [ 26196 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:08:05.672944 [ 26200 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:08:05.672913 [ 26202 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:08:05.672922 [ 26203 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:08:05.672844 [ 26192 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:08:05.672966 [ 26191 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:08:05.673783 [ 25594 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:08:05.673820 [ 26188 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:08:05.674667 [ 25594 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:08:05.674891 [ 25594 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:08:05.674950 [ 25594 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:08:05.675018 [ 25594 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:08:05.675080 [ 25594 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:08:05.675241 [ 25594 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:08:05.675289 [ 25594 ] {} Context: Destructing threadpool writer 2025.04.02 04:08:05.678771 [ 25594 ] {} Application: Destroyed global context. 2025.04.02 04:08:05.679375 [ 25594 ] {} Application: Waiting for background threads 2025.04.02 04:08:05.771774 [ 25594 ] {} Application: Background threads finished in 92 ms 2025.04.02 04:08:05.772404 [ 25594 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:08:05.772462 [ 25594 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:08:05.784261 [ 25594 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:08:05.784548 [ 25594 ] {} Application: shutting down 2025.04.02 04:08:05.784596 [ 25594 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:08:05.790948 [ 25597 ] {} BaseDaemon: Received signal -2 2025.04.02 04:08:05.791078 [ 25597 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:08:05.884669 [ 25592 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:08:06.671713 [ 26329 ] {} Application: Will watch for the process with pid 26331 2025.04.02 04:08:06.673009 [ 26331 ] {} Application: Forked a child process to watch 2025.04.02 04:08:06.674571 [ 26331 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:08:07.175970 [ 26331 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 26331 2025.04.02 04:08:07.176943 [ 26331 ] {} Application: starting up 2025.04.02 04:08:07.177039 [ 26331 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:08:07.210922 [ 26331 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:08:07.211123 [ 26331 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:08:07.211361 [ 26331 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:08:07.211441 [ 26331 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:08:07.211567 [ 26331 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:08:07.211610 [ 26331 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:08:07.213460 [ 26331 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:08:07.214091 [ 26331 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:08:07.214157 [ 26331 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:08:07.214447 [ 26331 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:08:07.214531 [ 26331 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:08:08.073736 [ 26331 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:08:08.076013 [ 26331 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:08:08.076104 [ 26331 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:08:08.076306 [ 26331 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:08:08.077066 [ 26331 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:08:08.280064 [ 26341 ] {} CancellationChecker: Started worker function 2025.04.02 04:08:08.280484 [ 26331 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:08:08.280587 [ 26331 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:08:08.280672 [ 26331 ] {} Application: Initializing DateLUT. 2025.04.02 04:08:08.280753 [ 26331 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:08:08.281124 [ 26331 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:08:08.281731 [ 26331 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:08:08.375391 [ 26331 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:08:08.375574 [ 26331 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:08:08.376119 [ 26331 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:08:08.376783 [ 26331 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:08:08.376912 [ 26331 ] {} Application: Initializing interserver credentials. 2025.04.02 04:08:08.378202 [ 26331 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:08:08.384096 [ 26331 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:08:08.384195 [ 26331 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:08:08.384310 [ 26331 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:08:08.384898 [ 26331 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:08:08.411727 [ 26331 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:08:08.411832 [ 26331 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:08:08.420537 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:08:08.421805 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:08:08.422320 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:08:08.422934 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:08:08.423517 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:08:08.423914 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:08:08.428640 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:08:08.429160 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:08:08.429591 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:08:08.429982 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:08:08.430350 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:08:08.430885 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:08:08.431338 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:08:08.431743 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:08:08.432081 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:08:08.432607 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:08:08.432957 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:08:08.433351 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:08:08.433762 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:08:08.434179 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:08:08.434589 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:08:08.435016 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:08:08.435423 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:08:08.436179 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:08:08.437324 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:08:08.437717 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:08:08.438888 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:08:08.440213 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:08:08.440653 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:08:08.441109 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:08:08.441543 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:08:08.441967 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:08:08.442419 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:08:08.442915 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:08:08.443305 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:08:08.443917 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:08:08.444365 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:08:08.444926 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:08:08.445479 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:08:08.445925 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:08:08.447326 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:08:08.448042 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:08:08.448463 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:08:08.448916 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:08:08.449369 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:08:08.449862 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:08:08.450560 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:08:08.451055 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:08:08.451553 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:08:08.452057 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:08:08.454798 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:08:08.455717 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:08:08.456817 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:08:08.457456 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:08:08.457967 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:08:08.458452 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:08:08.459203 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:08:08.459744 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:08:08.460395 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:08:08.460821 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:08:08.461305 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:08:08.461758 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:08:08.555025 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:08:08.556124 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:08:08.557071 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:08:08.558031 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:08:08.558772 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:08:08.560817 [ 26331 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:08:08.755235 [ 26331 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:08:08.757769 [ 26331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:08:08.849333 [ 26331 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:08:08.849443 [ 26331 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:08:08.849482 [ 26331 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:08:08.884487 [ 26331 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:08:08.884564 [ 26331 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:08:08.884620 [ 26331 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:08:08.884770 [ 26331 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:08:08.891805 [ 26331 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:08:08.898061 [ 26331 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:08:08.910665 [ 26331 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:08:08.911228 [ 26331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:08:08.911386 [ 26331 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:08:08.913625 [ 26331 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:08:08.914286 [ 26331 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:08:09.005796 [ 26331 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:08:09.007314 [ 26331 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:08:09.007393 [ 26331 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:08:09.009104 [ 26331 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:08:09.009150 [ 26331 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:08:09.009178 [ 26331 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:08:09.009258 [ 26331 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:08:09.009305 [ 26331 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:08:09.009601 [ 26331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:09.009734 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.384311 [ 26331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:09.398305 [ 26331 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:09.398495 [ 26331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:09.399996 [ 26331 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:09.400203 [ 26331 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz 2025.04.02 04:08:09.400318 [ 26331 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz 2025.04.02 04:08:09.400413 [ 26331 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz, size 4 2025.04.02 04:08:09.401105 [ 26331 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz. 2025.04.02 04:08:09.401247 [ 26917 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz 2025.04.02 04:08:09.408316 [ 26917 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz, size 4 2025.04.02 04:08:09.409102 [ 26331 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz. 2025.04.02 04:08:09.409568 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.413906 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.414055 [ 26331 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz, Version: Latest, Offset: 2 2025.04.02 04:08:09.422508 [ 26331 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz 2025.04.02 04:08:09.422641 [ 26331 ] {} deleteFileFromS3: Object with path s3/pqj/haelkpayrhvlnoxiacyhdqgupfbdz was removed from S3 2025.04.02 04:08:09.422773 [ 26331 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:08:09.422853 [ 26331 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:08:09.427357 [ 26331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:09.639031 [ 26331 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:09.639166 [ 26331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:09.640002 [ 26331 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:09.652107 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.658104 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.658263 [ 26331 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:08:09.666239 [ 26331 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:08:09.666526 [ 26331 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:08:09 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E4CCB35E892 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:08:09.666719 [ 26331 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:08:09.671826 [ 26331 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:09.671933 [ 26331 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:08:09.672064 [ 26331 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:08:09.672129 [ 26331 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:08:09.672284 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.672373 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.672443 [ 26331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:09.672500 [ 26331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:09.672555 [ 26331 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:08:09.672605 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.672656 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.672740 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.672795 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.672845 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.676344 [ 26331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:09.691391 [ 26331 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:09.691549 [ 26331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:09.692490 [ 26331 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:09.701328 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/wbj/pncophboijumqqztuspduohuhbvcx (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.751323 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/wbj/pncophboijumqqztuspduohuhbvcx (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.751446 [ 26331 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/wbj/pncophboijumqqztuspduohuhbvcx, Version: Latest, Offset: 2 2025.04.02 04:08:09.758075 [ 26331 ] {} deleteFileFromS3: No blob storage log, not writing blob special/wbj/pncophboijumqqztuspduohuhbvcx 2025.04.02 04:08:09.758162 [ 26331 ] {} deleteFileFromS3: Object with path special/wbj/pncophboijumqqztuspduohuhbvcx was removed from S3 2025.04.02 04:08:09.758224 [ 26331 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:08:09.758270 [ 26331 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:08:09.762715 [ 26331 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:09.774357 [ 26331 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:09.774501 [ 26331 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:09.775287 [ 26331 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:09.783548 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/hbk/ddlybwebekhazzwikmwbigyphgsrh (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.786971 [ 26331 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/hbk/ddlybwebekhazzwikmwbigyphgsrh (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:09.787086 [ 26331 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/hbk/ddlybwebekhazzwikmwbigyphgsrh, Version: Latest, Offset: 2 2025.04.02 04:08:09.792894 [ 26331 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/hbk/ddlybwebekhazzwikmwbigyphgsrh 2025.04.02 04:08:09.792987 [ 26331 ] {} deleteFileFromS3: Object with path test_02944/hbk/ddlybwebekhazzwikmwbigyphgsrh was removed from S3 2025.04.02 04:08:09.793131 [ 26331 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:08:09.793217 [ 26331 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:08:09.793391 [ 26331 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:09.797199 [ 26331 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:09.801657 [ 26331 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:08:09.801802 [ 26331 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:08:09.803541 [ 26331 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:08:09.803762 [ 26331 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:08:09.805074 [ 26331 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:08:09.805131 [ 26331 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:08:09.805177 [ 26331 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:08:09.805211 [ 26331 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:08:09.805242 [ 26331 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:08:09.805928 [ 26331 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 34 entries 2025.04.02 04:08:09.805999 [ 26331 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:08:09.806125 [ 26331 ] {} KeeperServer: Last local log idx 34 2025.04.02 04:08:09.806177 [ 26331 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 34 2025.04.02 04:08:09.807341 [ 26331 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:08:09.818770 [ 26331 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:08:09.819227 [ 26331 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:08:09.819354 [ 26331 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:08:09.819424 [ 26331 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:08:09.819493 [ 26331 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:08:09.819541 [ 26331 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:08:09.819637 [ 26331 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 34 election timer allowed log store start 1, end 34 config log idx 34, prev log idx 33 -- ASYNC REPLICATION -- 2025.04.02 04:08:09.819681 [ 26331 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:08:09.819765 [ 26331 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:08:09.819830 [ 26331 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:08:09.820792 [ 26331 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:08:09.820947 [ 26947 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:08:09.871392 [ 26930 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:08:09.871575 [ 26930 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:08:09.871713 [ 26930 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 34, state term 34, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:08:09.871780 [ 26930 ] {} RaftInstance: pre-vote term (0) is different, reset it to 34 2025.04.02 04:08:09.872045 [ 26331 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:08:09.872182 [ 26930 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:08:09.875310 [ 26930 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 35, log idx 34, log term 34, priority (target 1 / mine 1) 2025.04.02 04:08:09.875400 [ 26930 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:08:09.875456 [ 26930 ] {} RaftInstance: state machine commit index 0, precommit index 34, last log index 34 2025.04.02 04:08:09.875519 [ 26930 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:08:09.875804 [ 26926 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:08:09.875949 [ 26930 ] {} RaftInstance: [BECOME LEADER] appended new config at 35 2025.04.02 04:08:09.876262 [ 26946 ] {} RaftInstance: config at index 1 is committed, prev config log idx 34 2025.04.02 04:08:09.876359 [ 26946 ] {} RaftInstance: skipped config 1, latest config 34 2025.04.02 04:08:09.876564 [ 26946 ] {} RaftInstance: config at index 2 is committed, prev config log idx 34 2025.04.02 04:08:09.876632 [ 26946 ] {} RaftInstance: skipped config 2, latest config 34 2025.04.02 04:08:09.876753 [ 26946 ] {} RaftInstance: config at index 3 is committed, prev config log idx 34 2025.04.02 04:08:09.876806 [ 26946 ] {} RaftInstance: skipped config 3, latest config 34 2025.04.02 04:08:09.876937 [ 26946 ] {} RaftInstance: config at index 4 is committed, prev config log idx 34 2025.04.02 04:08:09.877008 [ 26946 ] {} RaftInstance: skipped config 4, latest config 34 2025.04.02 04:08:09.877119 [ 26946 ] {} RaftInstance: config at index 5 is committed, prev config log idx 34 2025.04.02 04:08:09.877169 [ 26946 ] {} RaftInstance: skipped config 5, latest config 34 2025.04.02 04:08:09.877373 [ 26946 ] {} RaftInstance: config at index 6 is committed, prev config log idx 34 2025.04.02 04:08:09.877440 [ 26946 ] {} RaftInstance: skipped config 6, latest config 34 2025.04.02 04:08:09.877561 [ 26946 ] {} RaftInstance: config at index 7 is committed, prev config log idx 34 2025.04.02 04:08:09.877629 [ 26946 ] {} RaftInstance: skipped config 7, latest config 34 2025.04.02 04:08:09.877773 [ 26946 ] {} RaftInstance: config at index 8 is committed, prev config log idx 34 2025.04.02 04:08:09.877841 [ 26946 ] {} RaftInstance: skipped config 8, latest config 34 2025.04.02 04:08:09.877954 [ 26946 ] {} RaftInstance: config at index 9 is committed, prev config log idx 34 2025.04.02 04:08:09.878010 [ 26946 ] {} RaftInstance: skipped config 9, latest config 34 2025.04.02 04:08:09.878119 [ 26946 ] {} RaftInstance: config at index 10 is committed, prev config log idx 34 2025.04.02 04:08:09.878176 [ 26946 ] {} RaftInstance: skipped config 10, latest config 34 2025.04.02 04:08:09.878325 [ 26946 ] {} RaftInstance: config at index 11 is committed, prev config log idx 34 2025.04.02 04:08:09.878507 [ 26946 ] {} RaftInstance: skipped config 11, latest config 34 2025.04.02 04:08:09.878644 [ 26946 ] {} RaftInstance: config at index 12 is committed, prev config log idx 34 2025.04.02 04:08:09.878733 [ 26946 ] {} RaftInstance: skipped config 12, latest config 34 2025.04.02 04:08:09.878848 [ 26946 ] {} RaftInstance: config at index 13 is committed, prev config log idx 34 2025.04.02 04:08:09.878907 [ 26946 ] {} RaftInstance: skipped config 13, latest config 34 2025.04.02 04:08:09.879013 [ 26946 ] {} RaftInstance: config at index 14 is committed, prev config log idx 34 2025.04.02 04:08:09.879085 [ 26946 ] {} RaftInstance: skipped config 14, latest config 34 2025.04.02 04:08:09.879211 [ 26946 ] {} RaftInstance: config at index 15 is committed, prev config log idx 34 2025.04.02 04:08:09.879271 [ 26946 ] {} RaftInstance: skipped config 15, latest config 34 2025.04.02 04:08:09.879398 [ 26946 ] {} RaftInstance: config at index 16 is committed, prev config log idx 34 2025.04.02 04:08:09.879457 [ 26946 ] {} RaftInstance: skipped config 16, latest config 34 2025.04.02 04:08:09.879594 [ 26946 ] {} RaftInstance: config at index 17 is committed, prev config log idx 34 2025.04.02 04:08:09.879664 [ 26946 ] {} RaftInstance: skipped config 17, latest config 34 2025.04.02 04:08:09.879849 [ 26946 ] {} RaftInstance: config at index 18 is committed, prev config log idx 34 2025.04.02 04:08:09.879916 [ 26946 ] {} RaftInstance: skipped config 18, latest config 34 2025.04.02 04:08:09.880099 [ 26946 ] {} RaftInstance: config at index 19 is committed, prev config log idx 34 2025.04.02 04:08:09.880162 [ 26946 ] {} RaftInstance: skipped config 19, latest config 34 2025.04.02 04:08:09.880280 [ 26946 ] {} RaftInstance: config at index 20 is committed, prev config log idx 34 2025.04.02 04:08:09.880336 [ 26946 ] {} RaftInstance: skipped config 20, latest config 34 2025.04.02 04:08:09.880439 [ 26946 ] {} RaftInstance: config at index 21 is committed, prev config log idx 34 2025.04.02 04:08:09.880503 [ 26946 ] {} RaftInstance: skipped config 21, latest config 34 2025.04.02 04:08:09.880615 [ 26946 ] {} RaftInstance: config at index 22 is committed, prev config log idx 34 2025.04.02 04:08:09.880678 [ 26946 ] {} RaftInstance: skipped config 22, latest config 34 2025.04.02 04:08:09.880829 [ 26946 ] {} RaftInstance: config at index 23 is committed, prev config log idx 34 2025.04.02 04:08:09.880884 [ 26946 ] {} RaftInstance: skipped config 23, latest config 34 2025.04.02 04:08:09.881047 [ 26946 ] {} RaftInstance: config at index 24 is committed, prev config log idx 34 2025.04.02 04:08:09.881117 [ 26946 ] {} RaftInstance: skipped config 24, latest config 34 2025.04.02 04:08:09.881223 [ 26946 ] {} RaftInstance: config at index 25 is committed, prev config log idx 34 2025.04.02 04:08:09.881281 [ 26946 ] {} RaftInstance: skipped config 25, latest config 34 2025.04.02 04:08:09.881431 [ 26946 ] {} RaftInstance: config at index 26 is committed, prev config log idx 34 2025.04.02 04:08:09.881490 [ 26946 ] {} RaftInstance: skipped config 26, latest config 34 2025.04.02 04:08:09.881602 [ 26946 ] {} RaftInstance: config at index 27 is committed, prev config log idx 34 2025.04.02 04:08:09.881677 [ 26946 ] {} RaftInstance: skipped config 27, latest config 34 2025.04.02 04:08:09.881797 [ 26946 ] {} RaftInstance: config at index 28 is committed, prev config log idx 34 2025.04.02 04:08:09.881894 [ 26946 ] {} RaftInstance: skipped config 28, latest config 34 2025.04.02 04:08:09.882048 [ 26946 ] {} RaftInstance: config at index 29 is committed, prev config log idx 34 2025.04.02 04:08:09.882121 [ 26946 ] {} RaftInstance: skipped config 29, latest config 34 2025.04.02 04:08:09.882230 [ 26946 ] {} RaftInstance: config at index 30 is committed, prev config log idx 34 2025.04.02 04:08:09.882290 [ 26946 ] {} RaftInstance: skipped config 30, latest config 34 2025.04.02 04:08:09.882479 [ 26946 ] {} RaftInstance: config at index 31 is committed, prev config log idx 34 2025.04.02 04:08:09.882552 [ 26946 ] {} RaftInstance: skipped config 31, latest config 34 2025.04.02 04:08:09.882674 [ 26946 ] {} RaftInstance: config at index 32 is committed, prev config log idx 34 2025.04.02 04:08:09.882750 [ 26946 ] {} RaftInstance: skipped config 32, latest config 34 2025.04.02 04:08:09.882873 [ 26946 ] {} RaftInstance: config at index 33 is committed, prev config log idx 34 2025.04.02 04:08:09.882933 [ 26946 ] {} RaftInstance: skipped config 33, latest config 34 2025.04.02 04:08:09.883038 [ 26946 ] {} RaftInstance: config at index 34 is committed, prev config log idx 34 2025.04.02 04:08:09.883090 [ 26946 ] {} RaftInstance: skipped config 34, latest config 34 2025.04.02 04:08:09.883203 [ 26946 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:08:09.883263 [ 26946 ] {} KeeperServer: Preprocessing done 2025.04.02 04:08:09.883357 [ 26946 ] {} RaftInstance: config at index 35 is committed, prev config log idx 34 2025.04.02 04:08:09.883473 [ 26946 ] {} RaftInstance: new config log idx 35, prev log idx 34, cur config log idx 34, prev log idx 33 2025.04.02 04:08:09.883633 [ 26946 ] {} RaftInstance: new configuration: log idx 35, prev log idx 34 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 35 2025.04.02 04:08:09.883953 [ 26331 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:08:09.884954 [ 26331 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:08:09.887566 [ 26331 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:08:09.888068 [ 26331 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:08:09.902513 [ 26331 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:08:09.902618 [ 26331 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:08:09.903831 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:08:09.904267 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:08:09.904905 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:08:09.905217 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:08:09.905471 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:08:09.905729 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:08:09.905973 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:08:09.906282 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:08:09.910033 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:08:09.910479 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:08:09.910850 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:08:09.911180 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:08:09.911501 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:08:09.911831 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:08:09.912200 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:08:09.912721 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:08:09.913116 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:08:09.913600 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:08:09.913992 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:08:09.914334 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:08:09.914710 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:08:09.915282 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:08:09.916153 [ 26331 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:08:09.923813 [ 26331 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:08:09.924059 [ 26331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:08:10.022342 [ 26331 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:08:10.022669 [ 26331 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:08:10.028258 [ 26331 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:08:10.030536 [ 26331 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:08:10.031362 [ 26331 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:08:10.031759 [ 26954 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:08:10.042288 [ 26331 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:08:10.045940 [ 26331 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:08:10.053433 [ 26331 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:08:10.057118 [ 26331 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:08:10.064578 [ 26331 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:08:10.094679 [ 26331 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:08:10.096835 [ 26331 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:08:10.098482 [ 26331 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:08:10.098603 [ 26331 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:08:10.098754 [ 26342 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:08:10.099725 [ 26342 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:08:15.000600 [ 26331 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:08:15.001305 [ 26331 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:08:15.001810 [ 26331 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:08:15.001891 [ 26331 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:08:15.002020 [ 26341 ] {} CancellationChecker: Execution took 6722 ms. 2025.04.02 04:08:15.002763 [ 26331 ] {} Application: Shutting down storages. 2025.04.02 04:08:15.002835 [ 26331 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:08:15.004439 [ 26331 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:08:15.004493 [ 26331 ] {} Context: Shutting down workload entity storage 2025.04.02 04:08:15.004544 [ 26331 ] {} Context: Shutting down named sessions 2025.04.02 04:08:15.004623 [ 26331 ] {} Context: Shutting down database catalog 2025.04.02 04:08:15.004666 [ 26331 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:08:15.004754 [ 26331 ] {} Context: Shutting down merges executor 2025.04.02 04:08:15.005150 [ 26331 ] {} Context: Shutting down fetches executor 2025.04.02 04:08:15.005594 [ 26331 ] {} Context: Shutting down moves executor 2025.04.02 04:08:15.005883 [ 26331 ] {} Context: Shutting down common executor 2025.04.02 04:08:15.006244 [ 26331 ] {} Context: Shutting down DDLWorker 2025.04.02 04:08:15.046548 [ 26331 ] {} Context: Shutting down caches 2025.04.02 04:08:15.046666 [ 26331 ] {} Context: Shutting down AccessControl 2025.04.02 04:08:15.047136 [ 26331 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:08:15.050863 [ 26331 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:08:15.065376 [ 26331 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:08:15.065726 [ 26331 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:08:15.066312 [ 26331 ] {} Application: Shut down storages. 2025.04.02 04:08:15.066369 [ 26331 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:08:15.146285 [ 26331 ] {} Application: Closed all listening sockets. 2025.04.02 04:08:15.146479 [ 26331 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:08:15.146587 [ 26331 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:08:15.387472 [ 26331 ] {} RaftInstance: shutting down raft core 2025.04.02 04:08:15.387680 [ 26331 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:08:15.387841 [ 26331 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:08:15.387910 [ 26331 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:08:15.387977 [ 26331 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:08:15.388040 [ 26331 ] {} RaftInstance: reset all pointers. 2025.04.02 04:08:15.388104 [ 26331 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:08:15.388286 [ 26331 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:08:15.388326 [ 26947 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:08:15.388540 [ 26331 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:08:15.388673 [ 26331 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:08:15.388746 [ 26331 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:08:15.389022 [ 26933 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:08:15.389247 [ 26930 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:08:15.389281 [ 26934 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:08:15.389439 [ 26933 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:08:15.389431 [ 26935 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:08:15.389742 [ 26931 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:08:15.389707 [ 26940 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:08:15.389846 [ 26944 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:08:15.389867 [ 26937 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:08:15.390048 [ 26938 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:08:15.390114 [ 26943 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:08:15.390105 [ 26932 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:08:15.389851 [ 26939 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:08:15.389851 [ 26936 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:08:15.390044 [ 26945 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:08:15.390059 [ 26942 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:08:15.390049 [ 26941 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:08:15.391343 [ 26331 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:08:15.391374 [ 26926 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:08:15.391532 [ 26927 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:08:15.392235 [ 26331 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:08:15.392416 [ 26331 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:08:15.392485 [ 26331 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:08:15.392592 [ 26331 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:08:15.392667 [ 26331 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:08:15.392882 [ 26331 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:08:15.392937 [ 26331 ] {} Context: Destructing threadpool writer 2025.04.02 04:08:15.397103 [ 26331 ] {} Application: Destroyed global context. 2025.04.02 04:08:15.397794 [ 26331 ] {} Application: Waiting for background threads 2025.04.02 04:08:15.477560 [ 26331 ] {} Application: Background threads finished in 79 ms 2025.04.02 04:08:15.478521 [ 26331 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:08:15.478637 [ 26331 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:08:15.501968 [ 26331 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:08:15.502598 [ 26331 ] {} Application: shutting down 2025.04.02 04:08:15.502663 [ 26331 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:08:15.515300 [ 26334 ] {} BaseDaemon: Received signal -2 2025.04.02 04:08:15.515538 [ 26334 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:08:15.698559 [ 26329 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:08:16.581720 [ 27066 ] {} Application: Will watch for the process with pid 27068 2025.04.02 04:08:16.582971 [ 27068 ] {} Application: Forked a child process to watch 2025.04.02 04:08:16.584393 [ 27068 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:08:17.086509 [ 27068 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: 112459FC069F72E3CDCCD58C30D8FBB50A2DD0FA), PID 27068 2025.04.02 04:08:17.087490 [ 27068 ] {} Application: starting up 2025.04.02 04:08:17.087583 [ 27068 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:08:17.120602 [ 27068 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 04:08:17.120772 [ 27068 ] {} Context: Server was built with thread sanitizer. It will work slowly. 2025.04.02 04:08:17.120987 [ 27068 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:08:17.121053 [ 27068 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:08:17.121094 [ 27068 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:08:17.121121 [ 27068 ] {} Application: Query Profiler and TraceCollector are disabled because they require PHDR cache to be created (otherwise the function 'dl_iterate_phdr' is not lock free and not async-signal safe). 2025.04.02 04:08:17.122757 [ 27068 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:08:17.123181 [ 27068 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:08:17.123292 [ 27068 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:08:17.123467 [ 27068 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:08:17.123520 [ 27068 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:08:17.974659 [ 27068 ] {} Application: Integrity check of the executable successfully passed (checksum: A333AF241E0B9A7BD9B0C516489D3EDE) 2025.04.02 04:08:17.976938 [ 27068 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:08:17.977029 [ 27068 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 429.41 MiB 2025.04.02 04:08:17.977206 [ 27068 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:08:17.977919 [ 27068 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:08:18.174783 [ 27068 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:08:18.174878 [ 27068 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:08:18.204951 [ 27068 ] {} Application: Initializing DateLUT. 2025.04.02 04:08:18.204882 [ 27077 ] {} CancellationChecker: Started worker function 2025.04.02 04:08:18.205114 [ 27068 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:08:18.205858 [ 27068 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:08:18.206556 [ 27068 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:08:18.268833 [ 27068 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:08:18.269044 [ 27068 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:08:18.269709 [ 27068 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:08:18.270491 [ 27068 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use 'cf816fa40877' as replica host. 2025.04.02 04:08:18.270628 [ 27068 ] {} Application: Initializing interserver credentials. 2025.04.02 04:08:18.272235 [ 27068 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:08:18.281941 [ 27068 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:08:18.282074 [ 27068 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:08:18.282244 [ 27068 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:08:18.283195 [ 27068 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:08:18.386640 [ 27068 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:08:18.386824 [ 27068 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:08:18.399481 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:08:18.401427 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:08:18.402201 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:08:18.403059 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:08:18.403845 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/cannot_allocate_thread_injection.xml'. 2025.04.02 04:08:18.404452 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:08:18.432113 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:08:18.433198 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:08:18.433990 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:08:18.434716 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:08:18.435421 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:08:18.436269 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:08:18.436929 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:08:18.437582 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:08:18.438210 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:08:18.439289 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:08:18.439971 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:08:18.440726 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:08:18.441358 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:08:18.442079 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:08:18.442784 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:08:18.443470 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:08:18.444211 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:08:18.445519 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:08:18.447610 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:08:18.448253 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:08:18.449928 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:08:18.452033 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:08:18.452755 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:08:18.453357 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:08:18.454055 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:08:18.454795 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:08:18.455588 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:08:18.456474 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:08:18.457213 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:08:18.458161 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:08:18.458935 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:08:18.459772 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:08:18.460726 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:08:18.461464 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:08:18.463702 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:08:18.464860 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:08:18.465646 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:08:18.466553 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:08:18.467343 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:08:18.468112 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:08:18.469394 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:08:18.470324 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:08:18.471231 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:08:18.472124 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:08:18.477019 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:08:18.478625 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:08:18.480404 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:08:18.481570 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:08:18.482328 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:08:18.483089 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:08:18.484336 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:08:18.485233 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:08:18.486244 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:08:18.486989 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:08:18.487802 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:08:18.488540 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:08:18.489818 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:08:18.573318 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:08:18.574733 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:08:18.575954 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:08:18.576867 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:08:18.579535 [ 27068 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:08:18.632164 [ 27068 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:08:18.634176 [ 27068 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:08:18.791636 [ 27068 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:08:18.791839 [ 27068 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:08:18.791915 [ 27068 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:08:18.964754 [ 27068 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:08:18.964885 [ 27068 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:08:18.964993 [ 27068 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:08:18.965422 [ 27068 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:08:18.972980 [ 27068 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:08:18.980181 [ 27068 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:08:18.995288 [ 27068 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:08:18.995974 [ 27068 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:08:18.996203 [ 27068 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:08:19.000820 [ 27068 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:08:19.001936 [ 27068 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:08:19.002442 [ 27068 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:08:19.004272 [ 27068 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:08:19.004396 [ 27068 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:08:19.007057 [ 27068 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:08:19.007165 [ 27068 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:08:19.007226 [ 27068 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 04:08:19.007310 [ 27068 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:08:19.007362 [ 27068 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: enabled 2025.04.02 04:08:19.007679 [ 27068 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:19.007856 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:19.771011 [ 27068 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:19.936836 [ 27068 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:19.937009 [ 27068 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:19.938866 [ 27068 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:19.939108 [ 27068 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct 2025.04.02 04:08:19.939261 [ 27068 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct 2025.04.02 04:08:19.939365 [ 27068 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct, size 4 2025.04.02 04:08:19.940109 [ 27068 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct. 2025.04.02 04:08:19.940268 [ 27657 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct 2025.04.02 04:08:19.948439 [ 27657 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct, size 4 2025.04.02 04:08:19.949699 [ 27068 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/foa/bhpzsapaemconktigysxuhisjdqct. 2025.04.02 04:08:19.950197 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/foa/bhpzsapaemconktigysxuhisjdqct (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:19.954976 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/foa/bhpzsapaemconktigysxuhisjdqct (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:19.955132 [ 27068 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/foa/bhpzsapaemconktigysxuhisjdqct, Version: Latest, Offset: 2 2025.04.02 04:08:19.963620 [ 27068 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/foa/bhpzsapaemconktigysxuhisjdqct 2025.04.02 04:08:19.963770 [ 27068 ] {} deleteFileFromS3: Object with path s3/foa/bhpzsapaemconktigysxuhisjdqct was removed from S3 2025.04.02 04:08:19.963887 [ 27068 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:08:19.963979 [ 27068 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:08:19.970078 [ 27068 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:19.990061 [ 27068 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:19.990195 [ 27068 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:20.040076 [ 27068 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:20.051784 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:20.059113 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:20.059277 [ 27068 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9, Version: Latest, Offset: 2 2025.04.02 04:08:20.127137 [ 27068 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:08:20.127541 [ 27068 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:08:20 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325E4F3AB68EBF x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:08:20.127842 [ 27068 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:08:20.135440 [ 27068 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:20.135566 [ 27068 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 was removed from S3 2025.04.02 04:08:20.135676 [ 27068 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:08:20.135858 [ 27068 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:08:20.136049 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.136251 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.136390 [ 27068 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:20.136513 [ 27068 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:20.136645 [ 27068 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:08:20.136770 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.136881 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.137009 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.137121 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.137234 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.227452 [ 27068 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:20.247843 [ 27068 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:20.248016 [ 27068 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:20.249434 [ 27068 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:20.256710 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/bdz/vlversmvbaibkzgmqdopnfutpxsmm (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:20.260806 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/bdz/vlversmvbaibkzgmqdopnfutpxsmm (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:20.260930 [ 27068 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/bdz/vlversmvbaibkzgmqdopnfutpxsmm, Version: Latest, Offset: 2 2025.04.02 04:08:20.268956 [ 27068 ] {} deleteFileFromS3: No blob storage log, not writing blob special/bdz/vlversmvbaibkzgmqdopnfutpxsmm 2025.04.02 04:08:20.269058 [ 27068 ] {} deleteFileFromS3: Object with path special/bdz/vlversmvbaibkzgmqdopnfutpxsmm was removed from S3 2025.04.02 04:08:20.269145 [ 27068 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:08:20.269243 [ 27068 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:08:20.275339 [ 27068 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:08:20.289515 [ 27068 ] {} S3Client: Provider type: Unknown 2025.04.02 04:08:20.289601 [ 27068 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:08:20.290432 [ 27068 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9 2025.04.02 04:08:20.298107 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/abg/cmawxwyivdxlyyoeqpiytcnhynmqg (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:20.302281 [ 27068 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/abg/cmawxwyivdxlyyoeqpiytcnhynmqg (clickhouse_access_check_5fc110ef-dce6-4c9d-8a3e-ef61f0cff9f9) 2025.04.02 04:08:20.302489 [ 27068 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/abg/cmawxwyivdxlyyoeqpiytcnhynmqg, Version: Latest, Offset: 2 2025.04.02 04:08:20.310559 [ 27068 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/abg/cmawxwyivdxlyyoeqpiytcnhynmqg 2025.04.02 04:08:20.310658 [ 27068 ] {} deleteFileFromS3: Object with path test_02944/abg/cmawxwyivdxlyyoeqpiytcnhynmqg was removed from S3 2025.04.02 04:08:20.310779 [ 27068 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:08:20.310846 [ 27068 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:08:20.311031 [ 27068 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:08:20.316593 [ 27068 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:08:20.322555 [ 27068 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:08:20.322774 [ 27068 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 04:08:20.325583 [ 27068 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:08:20.325831 [ 27068 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:08:20.327217 [ 27068 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:08:20.327306 [ 27068 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:08:20.327416 [ 27068 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 04:08:20.327487 [ 27068 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 04:08:20.327553 [ 27068 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 04:08:20.328623 [ 27068 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 35 entries 2025.04.02 04:08:20.328749 [ 27068 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:08:20.328938 [ 27068 ] {} KeeperServer: Last local log idx 35 2025.04.02 04:08:20.329031 [ 27068 ] {} KeeperServer: No config in snapshot, will use config from log store with log index 35 2025.04.02 04:08:20.331224 [ 27068 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:08:20.348712 [ 27068 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:08:20.349328 [ 27068 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:08:20.349514 [ 27068 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:08:20.349628 [ 27068 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:08:20.349801 [ 27068 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:08:20.349892 [ 27068 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:08:20.350049 [ 27068 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 35 election timer allowed log store start 1, end 35 config log idx 35, prev log idx 34 -- ASYNC REPLICATION -- 2025.04.02 04:08:20.350168 [ 27068 ] {} RaftInstance: detect a configuration change that is not committed yet at index 1 2025.04.02 04:08:20.350287 [ 27068 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:08:20.350461 [ 27068 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:08:20.351216 [ 27068 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:08:20.351338 [ 27704 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:08:20.401856 [ 27687 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:08:20.402077 [ 27687 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:08:20.402215 [ 27687 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 35, state term 35, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:08:20.402291 [ 27687 ] {} RaftInstance: pre-vote term (0) is different, reset it to 35 2025.04.02 04:08:20.402832 [ 27068 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:08:20.402861 [ 27687 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:08:20.406147 [ 27687 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 36, log idx 35, log term 35, priority (target 1 / mine 1) 2025.04.02 04:08:20.406265 [ 27687 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:08:20.406338 [ 27687 ] {} RaftInstance: state machine commit index 0, precommit index 35, last log index 35 2025.04.02 04:08:20.406493 [ 27687 ] {} RaftInstance: Currently assigned config is newer than some uncomitted config. This can only happen during startup or force recovery. If that is not the case, this is a bug. 2025.04.02 04:08:20.406888 [ 27685 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:08:20.407065 [ 27687 ] {} RaftInstance: [BECOME LEADER] appended new config at 36 2025.04.02 04:08:20.407435 [ 27703 ] {} RaftInstance: config at index 1 is committed, prev config log idx 35 2025.04.02 04:08:20.407618 [ 27703 ] {} RaftInstance: skipped config 1, latest config 35 2025.04.02 04:08:20.407780 [ 27703 ] {} RaftInstance: config at index 2 is committed, prev config log idx 35 2025.04.02 04:08:20.407837 [ 27703 ] {} RaftInstance: skipped config 2, latest config 35 2025.04.02 04:08:20.407918 [ 27703 ] {} RaftInstance: config at index 3 is committed, prev config log idx 35 2025.04.02 04:08:20.407957 [ 27703 ] {} RaftInstance: skipped config 3, latest config 35 2025.04.02 04:08:20.408032 [ 27703 ] {} RaftInstance: config at index 4 is committed, prev config log idx 35 2025.04.02 04:08:20.408070 [ 27703 ] {} RaftInstance: skipped config 4, latest config 35 2025.04.02 04:08:20.408143 [ 27703 ] {} RaftInstance: config at index 5 is committed, prev config log idx 35 2025.04.02 04:08:20.408179 [ 27703 ] {} RaftInstance: skipped config 5, latest config 35 2025.04.02 04:08:20.408247 [ 27703 ] {} RaftInstance: config at index 6 is committed, prev config log idx 35 2025.04.02 04:08:20.408303 [ 27703 ] {} RaftInstance: skipped config 6, latest config 35 2025.04.02 04:08:20.408389 [ 27703 ] {} RaftInstance: config at index 7 is committed, prev config log idx 35 2025.04.02 04:08:20.408433 [ 27703 ] {} RaftInstance: skipped config 7, latest config 35 2025.04.02 04:08:20.408503 [ 27703 ] {} RaftInstance: config at index 8 is committed, prev config log idx 35 2025.04.02 04:08:20.408567 [ 27703 ] {} RaftInstance: skipped config 8, latest config 35 2025.04.02 04:08:20.408648 [ 27703 ] {} RaftInstance: config at index 9 is committed, prev config log idx 35 2025.04.02 04:08:20.408699 [ 27703 ] {} RaftInstance: skipped config 9, latest config 35 2025.04.02 04:08:20.408772 [ 27703 ] {} RaftInstance: config at index 10 is committed, prev config log idx 35 2025.04.02 04:08:20.408803 [ 27703 ] {} RaftInstance: skipped config 10, latest config 35 2025.04.02 04:08:20.408859 [ 27703 ] {} RaftInstance: config at index 11 is committed, prev config log idx 35 2025.04.02 04:08:20.408889 [ 27703 ] {} RaftInstance: skipped config 11, latest config 35 2025.04.02 04:08:20.408944 [ 27703 ] {} RaftInstance: config at index 12 is committed, prev config log idx 35 2025.04.02 04:08:20.408978 [ 27703 ] {} RaftInstance: skipped config 12, latest config 35 2025.04.02 04:08:20.409037 [ 27703 ] {} RaftInstance: config at index 13 is committed, prev config log idx 35 2025.04.02 04:08:20.409066 [ 27703 ] {} RaftInstance: skipped config 13, latest config 35 2025.04.02 04:08:20.409121 [ 27703 ] {} RaftInstance: config at index 14 is committed, prev config log idx 35 2025.04.02 04:08:20.409151 [ 27703 ] {} RaftInstance: skipped config 14, latest config 35 2025.04.02 04:08:20.409217 [ 27703 ] {} RaftInstance: config at index 15 is committed, prev config log idx 35 2025.04.02 04:08:20.409260 [ 27703 ] {} RaftInstance: skipped config 15, latest config 35 2025.04.02 04:08:20.409331 [ 27703 ] {} RaftInstance: config at index 16 is committed, prev config log idx 35 2025.04.02 04:08:20.409363 [ 27703 ] {} RaftInstance: skipped config 16, latest config 35 2025.04.02 04:08:20.409418 [ 27703 ] {} RaftInstance: config at index 17 is committed, prev config log idx 35 2025.04.02 04:08:20.409454 [ 27703 ] {} RaftInstance: skipped config 17, latest config 35 2025.04.02 04:08:20.409511 [ 27703 ] {} RaftInstance: config at index 18 is committed, prev config log idx 35 2025.04.02 04:08:20.409547 [ 27703 ] {} RaftInstance: skipped config 18, latest config 35 2025.04.02 04:08:20.409604 [ 27703 ] {} RaftInstance: config at index 19 is committed, prev config log idx 35 2025.04.02 04:08:20.409634 [ 27703 ] {} RaftInstance: skipped config 19, latest config 35 2025.04.02 04:08:20.409704 [ 27703 ] {} RaftInstance: config at index 20 is committed, prev config log idx 35 2025.04.02 04:08:20.409738 [ 27703 ] {} RaftInstance: skipped config 20, latest config 35 2025.04.02 04:08:20.409794 [ 27703 ] {} RaftInstance: config at index 21 is committed, prev config log idx 35 2025.04.02 04:08:20.409824 [ 27703 ] {} RaftInstance: skipped config 21, latest config 35 2025.04.02 04:08:20.409881 [ 27703 ] {} RaftInstance: config at index 22 is committed, prev config log idx 35 2025.04.02 04:08:20.409915 [ 27703 ] {} RaftInstance: skipped config 22, latest config 35 2025.04.02 04:08:20.409970 [ 27703 ] {} RaftInstance: config at index 23 is committed, prev config log idx 35 2025.04.02 04:08:20.410004 [ 27703 ] {} RaftInstance: skipped config 23, latest config 35 2025.04.02 04:08:20.410068 [ 27703 ] {} RaftInstance: config at index 24 is committed, prev config log idx 35 2025.04.02 04:08:20.410102 [ 27703 ] {} RaftInstance: skipped config 24, latest config 35 2025.04.02 04:08:20.410157 [ 27703 ] {} RaftInstance: config at index 25 is committed, prev config log idx 35 2025.04.02 04:08:20.410188 [ 27703 ] {} RaftInstance: skipped config 25, latest config 35 2025.04.02 04:08:20.410242 [ 27703 ] {} RaftInstance: config at index 26 is committed, prev config log idx 35 2025.04.02 04:08:20.410278 [ 27703 ] {} RaftInstance: skipped config 26, latest config 35 2025.04.02 04:08:20.410340 [ 27703 ] {} RaftInstance: config at index 27 is committed, prev config log idx 35 2025.04.02 04:08:20.410370 [ 27703 ] {} RaftInstance: skipped config 27, latest config 35 2025.04.02 04:08:20.410515 [ 27703 ] {} RaftInstance: config at index 28 is committed, prev config log idx 35 2025.04.02 04:08:20.410553 [ 27703 ] {} RaftInstance: skipped config 28, latest config 35 2025.04.02 04:08:20.410615 [ 27703 ] {} RaftInstance: config at index 29 is committed, prev config log idx 35 2025.04.02 04:08:20.410653 [ 27703 ] {} RaftInstance: skipped config 29, latest config 35 2025.04.02 04:08:20.410722 [ 27703 ] {} RaftInstance: config at index 30 is committed, prev config log idx 35 2025.04.02 04:08:20.410755 [ 27703 ] {} RaftInstance: skipped config 30, latest config 35 2025.04.02 04:08:20.410810 [ 27703 ] {} RaftInstance: config at index 31 is committed, prev config log idx 35 2025.04.02 04:08:20.410846 [ 27703 ] {} RaftInstance: skipped config 31, latest config 35 2025.04.02 04:08:20.410909 [ 27703 ] {} RaftInstance: config at index 32 is committed, prev config log idx 35 2025.04.02 04:08:20.410938 [ 27703 ] {} RaftInstance: skipped config 32, latest config 35 2025.04.02 04:08:20.410992 [ 27703 ] {} RaftInstance: config at index 33 is committed, prev config log idx 35 2025.04.02 04:08:20.411022 [ 27703 ] {} RaftInstance: skipped config 33, latest config 35 2025.04.02 04:08:20.411076 [ 27703 ] {} RaftInstance: config at index 34 is committed, prev config log idx 35 2025.04.02 04:08:20.411109 [ 27703 ] {} RaftInstance: skipped config 34, latest config 35 2025.04.02 04:08:20.411164 [ 27703 ] {} RaftInstance: config at index 35 is committed, prev config log idx 35 2025.04.02 04:08:20.411194 [ 27703 ] {} RaftInstance: skipped config 35, latest config 35 2025.04.02 04:08:20.411276 [ 27703 ] {} KeeperServer: Preprocessing 1 log entries 2025.04.02 04:08:20.411324 [ 27703 ] {} KeeperServer: Preprocessing done 2025.04.02 04:08:20.411376 [ 27703 ] {} RaftInstance: config at index 36 is committed, prev config log idx 35 2025.04.02 04:08:20.411434 [ 27703 ] {} RaftInstance: new config log idx 36, prev log idx 35, cur config log idx 35, prev log idx 34 2025.04.02 04:08:20.411527 [ 27703 ] {} RaftInstance: new configuration: log idx 36, prev log idx 35 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 36 2025.04.02 04:08:20.411767 [ 27068 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:08:20.412965 [ 27068 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:08:20.415228 [ 27068 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:08:20.415632 [ 27068 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:08:20.577675 [ 27068 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:08:20.577844 [ 27068 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:08:20.579668 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:08:20.580282 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:08:20.581254 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:08:20.581705 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:08:20.582084 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:08:20.582589 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:08:20.583104 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:08:20.583625 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:08:20.590978 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:08:20.591742 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:08:20.592360 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:08:20.593090 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:08:20.593739 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:08:20.594271 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:08:20.594989 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:08:20.595647 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:08:20.596301 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:08:20.597099 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:08:20.597785 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:08:20.613933 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:08:20.614962 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:08:20.615924 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:08:20.617637 [ 27068 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:08:20.632377 [ 27068 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:08:20.633041 [ 27068 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:08:20.646874 [ 27068 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:08:20.647099 [ 27068 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:08:20.652880 [ 27068 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:08:20.655402 [ 27068 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:08:20.656291 [ 27068 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:08:20.656816 [ 27717 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:08:20.667379 [ 27068 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:08:20.670780 [ 27068 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:08:20.677892 [ 27068 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:08:20.681629 [ 27068 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:08:20.688872 [ 27068 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:08:20.692583 [ 27068 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:08:20.695315 [ 27068 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:08:20.697660 [ 27068 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:08:20.697828 [ 27068 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:08:20.697912 [ 27078 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:08:20.699172 [ 27078 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:08:25.303222 [ 27068 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:08:25.303816 [ 27068 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:08:25.304298 [ 27068 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:08:25.304368 [ 27068 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:08:25.304522 [ 27077 ] {} CancellationChecker: Execution took 7130 ms. 2025.04.02 04:08:25.305264 [ 27068 ] {} Application: Shutting down storages. 2025.04.02 04:08:25.305334 [ 27068 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:08:25.306544 [ 27068 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:08:25.306601 [ 27068 ] {} Context: Shutting down workload entity storage 2025.04.02 04:08:25.306632 [ 27068 ] {} Context: Shutting down named sessions 2025.04.02 04:08:25.306713 [ 27068 ] {} Context: Shutting down database catalog 2025.04.02 04:08:25.306761 [ 27068 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:08:25.306835 [ 27068 ] {} Context: Shutting down merges executor 2025.04.02 04:08:25.307225 [ 27068 ] {} Context: Shutting down fetches executor 2025.04.02 04:08:25.307543 [ 27068 ] {} Context: Shutting down moves executor 2025.04.02 04:08:25.307799 [ 27068 ] {} Context: Shutting down common executor 2025.04.02 04:08:25.308040 [ 27068 ] {} Context: Shutting down DDLWorker 2025.04.02 04:08:25.308087 [ 27068 ] {} Context: Shutting down caches 2025.04.02 04:08:25.308145 [ 27068 ] {} Context: Shutting down AccessControl 2025.04.02 04:08:25.308387 [ 27068 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:08:25.311104 [ 27068 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:08:25.368345 [ 27068 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:08:25.368800 [ 27068 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:08:25.369778 [ 27068 ] {} Application: Shut down storages. 2025.04.02 04:08:25.369856 [ 27068 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:08:25.672392 [ 27068 ] {} Application: Closed all listening sockets. 2025.04.02 04:08:25.672558 [ 27068 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:08:25.673256 [ 27068 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:08:25.915259 [ 27068 ] {} RaftInstance: shutting down raft core 2025.04.02 04:08:25.915445 [ 27068 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:08:25.915575 [ 27068 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:08:25.915657 [ 27068 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:08:25.915750 [ 27068 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:08:25.915832 [ 27068 ] {} RaftInstance: reset all pointers. 2025.04.02 04:08:25.915897 [ 27068 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:08:25.916084 [ 27068 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:08:25.916104 [ 27704 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:08:25.916258 [ 27068 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:08:25.916343 [ 27068 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:08:25.916406 [ 27068 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:08:25.916912 [ 27689 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:08:25.917166 [ 27687 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:08:25.917050 [ 27691 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:08:25.917288 [ 27693 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:08:25.917288 [ 27692 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:08:25.917346 [ 27697 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:08:25.917381 [ 27696 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:08:25.917628 [ 27701 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:08:25.917626 [ 27698 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:08:25.917424 [ 27694 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:08:25.917616 [ 27695 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:08:25.917627 [ 27702 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:08:25.917388 [ 27690 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:08:25.917646 [ 27700 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:08:25.917614 [ 27688 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:08:25.917750 [ 27699 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:08:25.918281 [ 27068 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:08:25.918327 [ 27685 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:08:25.919151 [ 27068 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:08:25.919293 [ 27068 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:08:25.919344 [ 27068 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:08:25.919411 [ 27068 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:08:25.919460 [ 27068 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:08:25.919597 [ 27068 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:08:25.919642 [ 27068 ] {} Context: Destructing threadpool writer 2025.04.02 04:08:25.923467 [ 27068 ] {} Application: Destroyed global context. 2025.04.02 04:08:25.924191 [ 27068 ] {} Application: Waiting for background threads 2025.04.02 04:08:25.997786 [ 27068 ] {} Application: Background threads finished in 73 ms 2025.04.02 04:08:26.022779 [ 27068 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:08:26.022920 [ 27068 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:08:26.043162 [ 27068 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: std::runtime_error::runtime_error(String const&) @ 0x00000000227afd3d 1. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x000000001f9e9ce1 2. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000001f9e3bf9 3. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x000000001f9d7306 4. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001f9d57c3 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32692 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001f9ffd00 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 9. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ee4b 10. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 11. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4368 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 13. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fac4b6c 14. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 15. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa2ccd8 16. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 17. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa32b80 18. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 19. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa1e60a 20. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/policy.cpp:22: Azure::Core::Http::Policies::NextHttpPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x000000001fa03cb9 21. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000001fa44bcd 22. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000001fa701c1 23. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x000000001fa504ac 24. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x00000000159fc72b 25. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x0000000015a0191f 26. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x00000000169d07b8 27. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000169cc97f 28. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x00000000169cb931 29. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001691253f 30. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x00000000169479af 31. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x0000000017287719 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:08:26.043541 [ 27068 ] {} Application: shutting down 2025.04.02 04:08:26.043588 [ 27068 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:08:26.053873 [ 27071 ] {} BaseDaemon: Received signal -2 2025.04.02 04:08:26.053993 [ 27071 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:08:26.284463 [ 27066 ] {} Application: Child process exited normally with code 233.