2025.04.02 03:19:55.474232 [ 397 ] {} Application: Will watch for the process with pid 398 2025.04.02 03:19:55.474414 [ 398 ] {} Application: Forked a child process to watch 2025.04.02 03:19:55.475129 [ 398 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:19:55.585431 [ 398 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 398 2025.04.02 03:19:55.585847 [ 398 ] {} Application: starting up 2025.04.02 03:19:55.585866 [ 398 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:19:55.596211 [ 398 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:19:55.597936 [ 398 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:19:55.599786 [ 398 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:19:55.600466 [ 398 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:19:55.601537 [ 398 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:19:55.602471 [ 398 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:19:55.607326 [ 398 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:19:55.608680 [ 398 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:19:55.609331 [ 398 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:19:55.610221 [ 398 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:19:55.610961 [ 398 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:19:57.184286 [ 398 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:19:57.186343 [ 398 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:19:57.252002 [ 398 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:19:57.253378 [ 398 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:19:57.255441 [ 398 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:19:57.492715 [ 398 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:19:57.493500 [ 398 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:19:57.495541 [ 410 ] {} CancellationChecker: Started worker function 2025.04.02 03:19:57.495992 [ 398 ] {} Application: Initializing DateLUT. 2025.04.02 03:19:57.496660 [ 398 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:19:57.498232 [ 398 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:19:57.501711 [ 398 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:19:57.508763 [ 398 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:19:57.509691 [ 398 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:19:57.510528 [ 398 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:19:57.512973 [ 398 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:19:57.514036 [ 398 ] {} Application: Initializing interserver credentials. 2025.04.02 03:19:57.522311 [ 398 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:19:57.621270 [ 398 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:19:57.623546 [ 398 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:19:57.630450 [ 398 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:19:57.631076 [ 398 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:19:57.635328 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:19:57.636838 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:19:57.638277 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:19:57.639640 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:19:57.641048 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:19:57.643462 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:19:57.644770 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:19:57.646016 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:19:57.647314 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:19:57.648620 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:19:57.650010 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:19:57.651298 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:19:57.652398 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:19:57.653643 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:19:57.654971 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:19:57.656277 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:19:57.657601 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:19:57.658885 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:19:57.660137 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:19:57.661329 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:19:57.662483 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:19:57.663769 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:19:57.665126 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:19:57.666754 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:19:57.668132 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:19:57.669226 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:19:57.670741 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:19:57.671990 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:19:57.673442 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:19:57.674763 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:19:57.676052 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:19:57.677317 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:19:57.678911 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:19:57.680260 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:19:57.681832 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:19:57.683178 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:19:57.684508 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:19:57.685821 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:19:57.687256 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:19:57.688868 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:19:57.690176 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:19:57.691484 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:19:57.692747 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:19:57.694047 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:19:57.695440 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:19:57.696651 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:19:57.697921 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:19:57.699231 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:19:57.701344 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:19:57.702782 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:19:57.704461 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:19:57.705843 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:19:57.707198 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:19:57.708553 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:19:57.710015 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:19:57.711359 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:19:57.712267 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:19:57.713660 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:19:57.714961 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:19:57.716261 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:19:57.717739 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:19:57.718925 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:19:57.728222 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:19:57.747243 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:19:57.773315 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:19:57.806961 [ 398 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:19:57.982490 [ 398 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:19:58.034676 [ 398 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:19:58.902939 [ 398 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:19:58.903553 [ 398 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:19:58.904244 [ 398 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:19:59.321574 [ 398 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:19:59.322161 [ 398 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:19:59.324004 [ 398 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:19:59.326306 [ 398 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:19:59.333155 [ 398 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:19:59.339516 [ 398 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:19:59.769916 [ 398 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:19:59.771002 [ 398 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:19:59.777840 [ 398 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:19:59.782232 [ 398 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:19:59.784407 [ 398 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:19:59.786780 [ 398 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:19:59.788021 [ 398 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:19:59.800091 [ 398 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:19:59.800606 [ 398 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:19:59.801364 [ 398 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:19:59.802116 [ 398 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:19:59.802580 [ 398 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:19:59.803855 [ 398 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:19:59.804819 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:19:59.901453 [ 398 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:19:59.905612 [ 398 ] {} S3Client: Provider type: Unknown 2025.04.02 03:19:59.906248 [ 398 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:19:59.925590 [ 398 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/unn/itotcuonikglgnecgpxnedpdaeraw 2025.04.02 03:19:59.927323 [ 398 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/unn/itotcuonikglgnecgpxnedpdaeraw. 2025.04.02 03:19:59.952261 [ 989 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/unn/itotcuonikglgnecgpxnedpdaeraw, size 4 2025.04.02 03:19:59.954293 [ 398 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/unn/itotcuonikglgnecgpxnedpdaeraw. 2025.04.02 03:19:59.981641 [ 398 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/unn/itotcuonikglgnecgpxnedpdaeraw 2025.04.02 03:19:59.982272 [ 398 ] {} deleteFileFromS3: Object with path s3/unn/itotcuonikglgnecgpxnedpdaeraw was removed from S3 2025.04.02 03:19:59.982834 [ 398 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:19:59.983515 [ 398 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:20:00.002561 [ 398 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:00.006581 [ 398 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:00.007249 [ 398 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:00.056004 [ 398 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:20:00.056908 [ 398 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:20:00 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BAC00FFCCFA x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:20:00.062291 [ 398 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:20:00.079260 [ 398 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:20:00.079952 [ 398 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:20:00.080568 [ 398 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:20:00.081417 [ 398 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:20:00.082452 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.083626 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.084758 [ 398 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:00.085708 [ 398 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:00.086702 [ 398 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:20:00.094097 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.095177 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.096144 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.097239 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.098436 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.119222 [ 398 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:00.123497 [ 398 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:00.124170 [ 398 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:00.164376 [ 398 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ljm/mecjyljlaxdcjpsyndzxhyfmxyjgx 2025.04.02 03:20:00.164973 [ 398 ] {} deleteFileFromS3: Object with path special/ljm/mecjyljlaxdcjpsyndzxhyfmxyjgx was removed from S3 2025.04.02 03:20:00.165568 [ 398 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:20:00.166343 [ 398 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:20:00.228911 [ 398 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:00.233111 [ 398 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:00.233818 [ 398 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:00.434377 [ 398 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/hlr/cgyiehksskadmxqbkjbtuxvupwrzw 2025.04.02 03:20:00.446959 [ 398 ] {} deleteFileFromS3: Object with path test_02944/hlr/cgyiehksskadmxqbkjbtuxvupwrzw was removed from S3 2025.04.02 03:20:00.447657 [ 398 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:20:00.461337 [ 398 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:20:00.493583 [ 398 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:00.572295 [ 398 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:00.606093 [ 398 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:20:00.606846 [ 398 ] {} KeeperSnapshotManager: No snapshots were found on LocalSnapshotDisk 2025.04.02 03:20:00.621236 [ 398 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:20:00.621976 [ 398 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2025.04.02 03:20:00.623712 [ 398 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:20:00.624394 [ 398 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:20:00.625013 [ 398 ] {} KeeperStateMachine: Totally have 0 snapshots 2025.04.02 03:20:00.625586 [ 398 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 0 2025.04.02 03:20:00.626225 [ 398 ] {} KeeperStateMachine: No existing snapshots, last committed log index 0 2025.04.02 03:20:00.627442 [ 398 ] {} KeeperLogStore: Removing all changelogs 2025.04.02 03:20:00.630221 [ 398 ] {} Changelog: Starting new changelog changelog_1_100000.bin 2025.04.02 03:20:00.631440 [ 398 ] {} KeeperServer: Last local log idx 0 2025.04.02 03:20:00.632556 [ 398 ] {} KeeperServer: No config in log store and snapshot, probably it's initial run. Will use config from .xml on disk 2025.04.02 03:20:00.641632 [ 398 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:20:00.652743 [ 398 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:20:00.655752 [ 398 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:20:00.656581 [ 398 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:20:00.657564 [ 398 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:20:00.658739 [ 398 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:20:00.660410 [ 398 ] {} RaftInstance: === INIT RAFT SERVER === commit index 0 term 0 election timer allowed log store start 1, end 0 config log idx 0, prev log idx 0 -- ASYNC REPLICATION -- 2025.04.02 03:20:00.661484 [ 398 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:20:00.663025 [ 398 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:20:00.664143 [ 398 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:20:00.664492 [ 1020 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:20:00.716861 [ 1003 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:20:00.717898 [ 1003 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:20:00.720567 [ 398 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:20:00.720698 [ 1003 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 0, state term 0, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:20:00.725920 [ 1003 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 1, log idx 0, log term 0, priority (target 1 / mine 1) 2025.04.02 03:20:00.727112 [ 1003 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:20:00.728716 [ 1003 ] {} RaftInstance: state machine commit index 0, precommit index 0, last log index 0 2025.04.02 03:20:00.731813 [ 1003 ] {} RaftInstance: [BECOME LEADER] appended new config at 1 2025.04.02 03:20:00.735429 [ 1019 ] {} RaftInstance: config at index 1 is committed, prev config log idx 0 2025.04.02 03:20:00.736253 [ 1019 ] {} RaftInstance: new config log idx 1, prev log idx 0, cur config log idx 0, prev log idx 0 2025.04.02 03:20:00.737079 [ 1019 ] {} RaftInstance: new configuration: log idx 1, prev log idx 0 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 1 2025.04.02 03:20:00.740036 [ 398 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:20:00.741354 [ 398 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:20:00.748046 [ 398 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:20:00.748821 [ 398 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:20:00.760501 [ 398 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:20:00.761127 [ 398 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:20:00.762761 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:20:00.764040 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:20:00.764915 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:20:00.765988 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:20:00.767155 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:20:00.768235 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:20:00.769264 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:20:00.770591 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:20:00.772036 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:20:00.773380 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:20:00.774610 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:20:00.775866 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:20:00.777045 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:20:00.778231 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:20:00.779345 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:20:00.780652 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:20:00.781862 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:20:00.783078 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:20:00.784345 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:20:00.785523 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:20:00.787003 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:20:00.788208 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:20:00.789720 [ 398 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:20:00.795658 [ 398 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:20:00.796297 [ 398 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:20:01.595869 [ 398 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:20:01.596993 [ 398 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:01.598698 [ 398 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:20:01.601359 [ 398 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2025.04.02 03:20:01.602341 [ 398 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2025.04.02 03:20:01.604424 [ 398 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:20:01.652526 [ 398 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:20:01.652946 [ 1029 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:20:01.730943 [ 398 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:20:01.737257 [ 398 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:20:01.748737 [ 398 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:20:01.765084 [ 398 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:20:01.774168 [ 398 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:20:01.779982 [ 398 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:20:01.804779 [ 398 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:20:01.814785 [ 411 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:20:01.816677 [ 398 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:20:01.837301 [ 411 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:20:06.241226 [ 398 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:06.242316 [ 398 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:20:06.246667 [ 398 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:20:06.247617 [ 398 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:20:06.248695 [ 410 ] {} CancellationChecker: Execution took 8758 ms. 2025.04.02 03:20:06.251098 [ 398 ] {} Application: Shutting down storages. 2025.04.02 03:20:06.251667 [ 398 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:20:06.261625 [ 398 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:20:06.262343 [ 398 ] {} Context: Shutting down workload entity storage 2025.04.02 03:20:06.263154 [ 398 ] {} Context: Shutting down named sessions 2025.04.02 03:20:06.264867 [ 398 ] {} Context: Shutting down database catalog 2025.04.02 03:20:06.265749 [ 398 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:20:06.267129 [ 398 ] {} Context: Shutting down merges executor 2025.04.02 03:20:06.269835 [ 398 ] {} Context: Shutting down fetches executor 2025.04.02 03:20:06.272463 [ 398 ] {} Context: Shutting down moves executor 2025.04.02 03:20:06.274619 [ 398 ] {} Context: Shutting down common executor 2025.04.02 03:20:06.276745 [ 398 ] {} Context: Shutting down DDLWorker 2025.04.02 03:20:06.277395 [ 398 ] {} Context: Shutting down caches 2025.04.02 03:20:06.278697 [ 398 ] {} Context: Shutting down AccessControl 2025.04.02 03:20:06.283369 [ 398 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:20:06.290645 [ 398 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:20:06.524038 [ 398 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:20:06.529233 [ 398 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:20:06.625288 [ 398 ] {} Application: Shut down storages. 2025.04.02 03:20:06.625966 [ 398 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:20:07.007904 [ 398 ] {} Application: Closed all listening sockets. 2025.04.02 03:20:07.008842 [ 398 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:20:07.015560 [ 398 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:20:07.270438 [ 398 ] {} RaftInstance: shutting down raft core 2025.04.02 03:20:07.271907 [ 398 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:20:07.272719 [ 398 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:20:07.273757 [ 398 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:20:07.275352 [ 398 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:20:07.276623 [ 398 ] {} RaftInstance: reset all pointers. 2025.04.02 03:20:07.277945 [ 398 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:20:07.279506 [ 1020 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:20:07.279686 [ 398 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:20:07.281063 [ 398 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:20:07.282198 [ 398 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:20:07.283600 [ 398 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:20:07.284533 [ 398 ] {} RaftInstance: manually create a snapshot on 1 2025.04.02 03:20:07.287001 [ 398 ] {} RaftInstance: creating a snapshot for index 1 2025.04.02 03:20:07.288186 [ 398 ] {} RaftInstance: create snapshot idx 1 log_term 1 2025.04.02 03:20:07.289359 [ 398 ] {} KeeperStateMachine: Creating snapshot 1 2025.04.02 03:20:07.290519 [ 398 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:20:07.295389 [ 398 ] {} KeeperStateMachine: Created persistent snapshot 1 with path snapshot_1.bin.zstd 2025.04.02 03:20:07.296446 [ 398 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:20:07.297056 [ 398 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:20:07.297943 [ 398 ] {} RaftInstance: snapshot idx 1 log_term 1 created, compact the log store if needed 2025.04.02 03:20:07.300050 [ 398 ] {} RaftInstance: create snapshot idx 1 log_term 1 done: 10858 us elapsed 2025.04.02 03:20:07.301754 [ 1004 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:20:07.303598 [ 1009 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:20:07.303679 [ 1017 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:20:07.303857 [ 1011 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:20:07.303967 [ 1015 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:20:07.304028 [ 1018 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:20:07.303881 [ 1012 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:20:07.304194 [ 1010 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:20:07.304252 [ 1014 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:20:07.304640 [ 1006 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:20:07.304506 [ 1007 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:20:07.304428 [ 1016 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:20:07.305034 [ 1005 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:07.304982 [ 1008 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:07.304747 [ 1003 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:07.305089 [ 1013 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:07.305289 [ 1004 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:07.309748 [ 398 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:07.310654 [ 1002 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:20:07.313808 [ 398 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:20:07.314969 [ 398 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:20:07.315585 [ 398 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:20:07.317171 [ 398 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:20:07.318097 [ 398 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:07.319783 [ 398 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:07.320404 [ 398 ] {} Context: Destructing threadpool writer 2025.04.02 03:20:07.353800 [ 398 ] {} Application: Destroyed global context. 2025.04.02 03:20:07.355410 [ 398 ] {} Application: Waiting for background threads 2025.04.02 03:20:07.450881 [ 398 ] {} Application: Background threads finished in 95 ms 2025.04.02 03:20:07.454830 [ 398 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:20:07.455462 [ 398 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:07.483193 [ 398 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:07.484238 [ 398 ] {} Application: shutting down 2025.04.02 03:20:07.484905 [ 398 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:20:07.486659 [ 399 ] {} BaseDaemon: Received signal -2 2025.04.02 03:20:07.487518 [ 399 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:20:07.862364 [ 397 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:20:08.073270 [ 1131 ] {} Application: Will watch for the process with pid 1132 2025.04.02 03:20:08.073484 [ 1132 ] {} Application: Forked a child process to watch 2025.04.02 03:20:08.074379 [ 1132 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:20:08.180940 [ 1132 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 1132 2025.04.02 03:20:08.181444 [ 1132 ] {} Application: starting up 2025.04.02 03:20:08.181464 [ 1132 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:20:08.190843 [ 1132 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:20:08.192390 [ 1132 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:20:08.194295 [ 1132 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:20:08.195161 [ 1132 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:20:08.196175 [ 1132 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:20:08.200174 [ 1132 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:20:08.205427 [ 1132 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:20:08.206588 [ 1132 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:20:08.207217 [ 1132 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:20:08.207976 [ 1132 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:20:08.208637 [ 1132 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:20:09.444787 [ 1132 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:20:09.450588 [ 1132 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:20:09.509612 [ 1132 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:20:09.511305 [ 1132 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:20:09.513429 [ 1132 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:20:10.030595 [ 1140 ] {} CancellationChecker: Started worker function 2025.04.02 03:20:10.031665 [ 1132 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:20:10.032277 [ 1132 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:20:10.033811 [ 1132 ] {} Application: Initializing DateLUT. 2025.04.02 03:20:10.034454 [ 1132 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:20:10.035812 [ 1132 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:20:10.038462 [ 1132 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:20:10.045986 [ 1132 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:20:10.046982 [ 1132 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:20:10.047691 [ 1132 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:20:10.050047 [ 1132 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:20:10.051090 [ 1132 ] {} Application: Initializing interserver credentials. 2025.04.02 03:20:10.058627 [ 1132 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:20:10.190729 [ 1132 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:20:10.192951 [ 1132 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:20:10.199790 [ 1132 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:20:10.200399 [ 1132 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:20:10.204542 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:20:10.206130 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:20:10.207536 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:20:10.208995 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:20:10.216195 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:20:10.219325 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:20:10.220689 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:20:10.249990 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:20:10.251340 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:20:10.252833 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:20:10.254295 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:20:10.255765 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:20:10.257135 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:20:10.258559 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:20:10.259944 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:20:10.261479 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:20:10.262903 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:20:10.264393 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:20:10.265699 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:20:10.266846 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:20:10.268189 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:20:10.269655 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:20:10.271092 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:20:10.272719 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:20:10.274000 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:20:10.275100 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:20:10.276748 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:20:10.278045 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:20:10.279388 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:20:10.280585 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:20:10.290531 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:20:10.291873 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:20:10.293036 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:20:10.294326 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:20:10.295786 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:20:10.296981 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:20:10.298431 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:20:10.299795 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:20:10.301142 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:20:10.338014 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:20:10.339576 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:20:10.341124 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:20:10.342636 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:20:10.343955 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:20:10.345353 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:20:10.346673 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:20:10.347867 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:20:10.349182 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:20:10.354889 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:20:10.356282 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:20:10.358115 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:20:10.359672 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:20:10.360985 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:20:10.362380 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:20:10.363905 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:20:10.365286 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:20:10.366315 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:20:10.367666 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:20:10.368812 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:20:10.370027 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:20:10.371666 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:20:10.373040 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:20:10.374538 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:20:10.376066 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:20:10.377503 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:20:10.379619 [ 1132 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:20:10.509566 [ 1132 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:20:10.597231 [ 1132 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:20:11.261481 [ 1132 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:20:11.262061 [ 1132 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:20:11.263169 [ 1132 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:20:12.141179 [ 1132 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:20:12.141943 [ 1132 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:20:12.143702 [ 1132 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:20:12.146118 [ 1132 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:12.156067 [ 1132 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:12.188877 [ 1132 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:12.617070 [ 1132 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:20:12.618066 [ 1132 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:12.623767 [ 1132 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:20:12.628299 [ 1132 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:12.630459 [ 1132 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:12.632701 [ 1132 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:20:12.633895 [ 1132 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:20:12.644964 [ 1132 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:20:12.645675 [ 1132 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:20:12.646298 [ 1132 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:20:12.647069 [ 1132 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:20:12.647715 [ 1132 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:20:12.648698 [ 1132 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:12.649519 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.743320 [ 1132 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:12.747797 [ 1132 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:12.748511 [ 1132 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:12.758315 [ 1132 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/jzl/lthmhnkenxnxibohgfghisowrzysd 2025.04.02 03:20:12.759955 [ 1132 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/jzl/lthmhnkenxnxibohgfghisowrzysd. 2025.04.02 03:20:12.776875 [ 1723 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/jzl/lthmhnkenxnxibohgfghisowrzysd, size 4 2025.04.02 03:20:12.778564 [ 1132 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/jzl/lthmhnkenxnxibohgfghisowrzysd. 2025.04.02 03:20:12.808724 [ 1132 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/jzl/lthmhnkenxnxibohgfghisowrzysd 2025.04.02 03:20:12.809454 [ 1132 ] {} deleteFileFromS3: Object with path s3/jzl/lthmhnkenxnxibohgfghisowrzysd was removed from S3 2025.04.02 03:20:12.810127 [ 1132 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:20:12.811018 [ 1132 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:20:12.832834 [ 1132 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:12.837170 [ 1132 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:12.837969 [ 1132 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:12.886039 [ 1132 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:20:12.886945 [ 1132 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:20:12 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BAEFDBC6A1F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:20:12.889151 [ 1132 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:20:12.900513 [ 1132 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:20:12.901104 [ 1132 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:20:12.901804 [ 1132 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:20:12.902518 [ 1132 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:20:12.903725 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.905018 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.906150 [ 1132 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:12.907177 [ 1132 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:12.908326 [ 1132 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:20:12.909366 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.910500 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.911673 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.912621 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.913701 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:12.934984 [ 1132 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:12.938930 [ 1132 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:12.939569 [ 1132 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:13.091338 [ 1132 ] {} deleteFileFromS3: No blob storage log, not writing blob special/aip/wluiarnjowocmylljjccktysrfocf 2025.04.02 03:20:13.091921 [ 1132 ] {} deleteFileFromS3: Object with path special/aip/wluiarnjowocmylljjccktysrfocf was removed from S3 2025.04.02 03:20:13.092449 [ 1132 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:20:13.093319 [ 1132 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:20:13.126339 [ 1132 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:13.130859 [ 1132 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:13.131525 [ 1132 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:13.509961 [ 1132 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/zwv/vrfiqogwklyyqwikfwtvkjhpekegw 2025.04.02 03:20:13.510805 [ 1132 ] {} deleteFileFromS3: Object with path test_02944/zwv/vrfiqogwklyyqwikfwtvkjhpekegw was removed from S3 2025.04.02 03:20:13.547112 [ 1132 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:20:13.549105 [ 1132 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:20:13.550473 [ 1132 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:13.577481 [ 1132 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:13.604337 [ 1132 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:20:13.605053 [ 1132 ] {} KeeperSnapshotManager: Found snapshot_1.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:13.615851 [ 1132 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:20:13.616458 [ 1132 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:20:13.618174 [ 1132 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:20:13.618830 [ 1132 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:20:13.619490 [ 1132 ] {} KeeperStateMachine: Totally have 1 snapshots 2025.04.02 03:20:13.620021 [ 1132 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 1 2025.04.02 03:20:13.627273 [ 1132 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:20:13.628588 [ 1132 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 1 2025.04.02 03:20:13.631495 [ 1132 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 1 entries 2025.04.02 03:20:13.632500 [ 1132 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:20:13.638635 [ 1132 ] {} KeeperServer: Last local log idx 1 2025.04.02 03:20:13.639937 [ 1132 ] {} KeeperServer: Will use config from log store with log index 1 2025.04.02 03:20:13.660482 [ 1132 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:20:13.672450 [ 1132 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:20:13.676206 [ 1132 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:20:13.678736 [ 1132 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:20:13.679501 [ 1132 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:20:13.689648 [ 1132 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:20:13.691128 [ 1132 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:20:13.692888 [ 1132 ] {} RaftInstance: === INIT RAFT SERVER === commit index 1 term 1 election timer allowed log store start 1, end 1 config log idx 1, prev log idx 0 -- ASYNC REPLICATION -- 2025.04.02 03:20:13.694221 [ 1132 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:20:13.695710 [ 1132 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:20:13.697119 [ 1132 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:20:13.697467 [ 1754 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:20:13.750107 [ 1738 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:20:13.750946 [ 1738 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:20:13.751140 [ 1132 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:20:13.752407 [ 1738 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 1, state term 1, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:20:13.753159 [ 1738 ] {} RaftInstance: pre-vote term (0) is different, reset it to 1 2025.04.02 03:20:13.754415 [ 1738 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:20:13.759444 [ 1738 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 2, log idx 1, log term 1, priority (target 1 / mine 1) 2025.04.02 03:20:13.760644 [ 1738 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:20:13.771088 [ 1738 ] {} RaftInstance: state machine commit index 1, precommit index 1, last log index 1 2025.04.02 03:20:13.774482 [ 1738 ] {} RaftInstance: [BECOME LEADER] appended new config at 2 2025.04.02 03:20:13.778905 [ 1753 ] {} RaftInstance: config at index 2 is committed, prev config log idx 1 2025.04.02 03:20:13.779911 [ 1753 ] {} RaftInstance: new config log idx 2, prev log idx 1, cur config log idx 1, prev log idx 0 2025.04.02 03:20:13.780848 [ 1753 ] {} RaftInstance: new configuration: log idx 2, prev log idx 1 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 2 2025.04.02 03:20:13.784307 [ 1132 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:20:13.785600 [ 1132 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:20:13.794212 [ 1132 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:20:13.795088 [ 1132 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:20:13.892187 [ 1132 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:20:13.892973 [ 1132 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:20:13.894698 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:20:13.896101 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:20:13.897150 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:20:13.898487 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:20:13.899910 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:20:13.901245 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:20:13.902511 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:20:13.903991 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:20:13.905943 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:20:13.907336 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:20:13.908767 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:20:13.910222 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:20:13.911544 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:20:13.912793 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:20:13.914065 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:20:13.915311 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:20:13.916567 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:20:13.917831 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:20:13.919551 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:20:13.920906 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:20:13.922112 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:20:13.923318 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:20:13.924837 [ 1132 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:20:13.931043 [ 1132 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:20:13.931883 [ 1132 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:20:14.756927 [ 1132 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:20:14.758076 [ 1132 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:14.759995 [ 1132 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:20:14.762763 [ 1132 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:20:14.768332 [ 1132 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:20:14.768746 [ 1763 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:20:14.821383 [ 1132 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:20:14.881997 [ 1132 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:20:14.892088 [ 1132 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:20:14.897523 [ 1132 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:20:14.905734 [ 1132 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:20:14.911387 [ 1132 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:20:14.919845 [ 1132 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:20:14.920845 [ 1132 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:20:14.921077 [ 1141 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:20:14.938508 [ 1141 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:20:19.392607 [ 1132 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:19.393863 [ 1132 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:20:19.398150 [ 1132 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:20:19.398951 [ 1132 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:20:19.400072 [ 1140 ] {} CancellationChecker: Execution took 9370 ms. 2025.04.02 03:20:19.402263 [ 1132 ] {} Application: Shutting down storages. 2025.04.02 03:20:19.402959 [ 1132 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:20:19.485075 [ 1132 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:20:19.485944 [ 1132 ] {} Context: Shutting down workload entity storage 2025.04.02 03:20:19.486712 [ 1132 ] {} Context: Shutting down named sessions 2025.04.02 03:20:19.488493 [ 1132 ] {} Context: Shutting down database catalog 2025.04.02 03:20:19.489439 [ 1132 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:20:19.490896 [ 1132 ] {} Context: Shutting down merges executor 2025.04.02 03:20:19.493824 [ 1132 ] {} Context: Shutting down fetches executor 2025.04.02 03:20:19.496456 [ 1132 ] {} Context: Shutting down moves executor 2025.04.02 03:20:19.498490 [ 1132 ] {} Context: Shutting down common executor 2025.04.02 03:20:19.500389 [ 1132 ] {} Context: Shutting down DDLWorker 2025.04.02 03:20:19.501070 [ 1132 ] {} Context: Shutting down caches 2025.04.02 03:20:19.502283 [ 1132 ] {} Context: Shutting down AccessControl 2025.04.02 03:20:19.506645 [ 1132 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:20:19.532178 [ 1132 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:20:19.748519 [ 1132 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:20:19.753733 [ 1132 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:20:19.767275 [ 1132 ] {} Application: Shut down storages. 2025.04.02 03:20:19.767881 [ 1132 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:20:20.059592 [ 1132 ] {} Application: Closed all listening sockets. 2025.04.02 03:20:20.060549 [ 1132 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:20:20.061997 [ 1132 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:20:20.291868 [ 1132 ] {} RaftInstance: shutting down raft core 2025.04.02 03:20:20.297121 [ 1132 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:20:20.298154 [ 1132 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:20:20.299198 [ 1132 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:20:20.300521 [ 1132 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:20:20.301732 [ 1132 ] {} RaftInstance: reset all pointers. 2025.04.02 03:20:20.303118 [ 1132 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:20:20.304230 [ 1754 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:20:20.304607 [ 1132 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:20:20.306094 [ 1132 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:20:20.307193 [ 1132 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:20:20.308439 [ 1132 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:20:20.309402 [ 1132 ] {} RaftInstance: manually create a snapshot on 2 2025.04.02 03:20:20.311541 [ 1132 ] {} RaftInstance: creating a snapshot for index 2 2025.04.02 03:20:20.312821 [ 1132 ] {} RaftInstance: create snapshot idx 2 log_term 2 2025.04.02 03:20:20.313932 [ 1132 ] {} KeeperStateMachine: Creating snapshot 2 2025.04.02 03:20:20.315304 [ 1132 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:20:20.319704 [ 1132 ] {} KeeperStateMachine: Created persistent snapshot 2 with path snapshot_2.bin.zstd 2025.04.02 03:20:20.320492 [ 1132 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:20:20.321326 [ 1132 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:20:20.322243 [ 1132 ] {} RaftInstance: snapshot idx 2 log_term 2 created, compact the log store if needed 2025.04.02 03:20:20.324787 [ 1132 ] {} RaftInstance: create snapshot idx 2 log_term 2 done: 10877 us elapsed 2025.04.02 03:20:20.326730 [ 1740 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:20:20.328973 [ 1739 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:20:20.329134 [ 1742 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 03:20:20.329283 [ 1747 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:20:20.329384 [ 1744 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:20:20.329491 [ 1748 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:20:20.329590 [ 1749 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:20:20.329671 [ 1750 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:20:20.329861 [ 1746 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:20.330078 [ 1745 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:20.330238 [ 1752 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:20.330336 [ 1751 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:20.330525 [ 1741 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:20.330642 [ 1738 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:20.330803 [ 1743 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:20.330927 [ 1737 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:20.331109 [ 1740 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:20.335685 [ 1132 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:20.336857 [ 1736 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:20:20.428176 [ 1132 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:20:20.429616 [ 1132 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:20:20.430388 [ 1132 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:20:20.432261 [ 1132 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:20:20.433463 [ 1132 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:20.435299 [ 1132 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:20.436129 [ 1132 ] {} Context: Destructing threadpool writer 2025.04.02 03:20:20.474707 [ 1132 ] {} Application: Destroyed global context. 2025.04.02 03:20:20.476532 [ 1132 ] {} Application: Waiting for background threads 2025.04.02 03:20:20.581500 [ 1132 ] {} Application: Background threads finished in 104 ms 2025.04.02 03:20:20.633309 [ 1132 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:20:20.634191 [ 1132 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:20.862652 [ 1132 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:20.878566 [ 1132 ] {} Application: shutting down 2025.04.02 03:20:20.885936 [ 1132 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:20:20.887955 [ 1133 ] {} BaseDaemon: Received signal -2 2025.04.02 03:20:20.890748 [ 1133 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:20:21.018360 [ 1131 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:20:21.894872 [ 1869 ] {} Application: Will watch for the process with pid 1870 2025.04.02 03:20:21.895067 [ 1870 ] {} Application: Forked a child process to watch 2025.04.02 03:20:21.895851 [ 1870 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:20:21.998546 [ 1870 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 1870 2025.04.02 03:20:21.999088 [ 1870 ] {} Application: starting up 2025.04.02 03:20:21.999108 [ 1870 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:20:22.008136 [ 1870 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:20:22.009772 [ 1870 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:20:22.011791 [ 1870 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:20:22.012785 [ 1870 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:20:22.014140 [ 1870 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:20:22.015317 [ 1870 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:20:22.021003 [ 1870 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:20:22.022603 [ 1870 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:20:22.023324 [ 1870 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:20:22.024175 [ 1870 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:20:22.024891 [ 1870 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:20:23.814114 [ 1870 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:20:23.816581 [ 1870 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:20:23.876015 [ 1870 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:20:23.877840 [ 1870 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:20:23.880608 [ 1870 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:20:24.135437 [ 1870 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:20:24.136089 [ 1870 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:20:24.136671 [ 1882 ] {} CancellationChecker: Started worker function 2025.04.02 03:20:24.137805 [ 1870 ] {} Application: Initializing DateLUT. 2025.04.02 03:20:24.138311 [ 1870 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:20:24.139849 [ 1870 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:20:24.142171 [ 1870 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:20:24.150118 [ 1870 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:20:24.151078 [ 1870 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:20:24.151956 [ 1870 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:20:24.171075 [ 1870 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:20:24.176603 [ 1870 ] {} Application: Initializing interserver credentials. 2025.04.02 03:20:24.267837 [ 1870 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:20:24.592564 [ 1870 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:20:24.594913 [ 1870 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:20:24.601848 [ 1870 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:20:24.602492 [ 1870 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:20:24.606708 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:20:24.608207 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:20:24.609498 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:20:24.617980 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:20:24.619348 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:20:24.622040 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:20:24.623492 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:20:24.624894 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:20:24.626188 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:20:24.627523 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:20:24.629159 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:20:24.630461 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:20:24.631657 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:20:24.632766 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:20:24.634030 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:20:24.635197 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:20:24.636389 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:20:24.637625 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:20:24.638909 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:20:24.640062 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:20:24.641325 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:20:24.642571 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:20:24.643874 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:20:24.645428 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:20:24.646670 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:20:24.647661 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:20:24.649214 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:20:24.650526 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:20:24.651776 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:20:24.652971 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:20:24.654451 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:20:24.655778 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:20:24.657271 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:20:24.658582 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:20:24.659929 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:20:24.661158 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:20:24.662554 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:20:24.663861 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:20:24.665039 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:20:24.666392 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:20:24.667480 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:20:24.669032 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:20:24.670418 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:20:24.671588 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:20:24.676203 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:20:24.692331 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:20:24.709174 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:20:24.710959 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:20:24.713478 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:20:24.715021 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:20:24.716722 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:20:24.718207 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:20:24.719433 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:20:24.720941 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:20:24.722438 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:20:24.723776 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:20:24.724778 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:20:24.725999 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:20:24.727329 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:20:24.728813 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:20:24.730276 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:20:24.731629 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:20:24.732883 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:20:24.734515 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:20:24.735892 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:20:24.738122 [ 1870 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:20:24.779799 [ 1870 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:20:24.784406 [ 1870 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:20:25.548922 [ 1870 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:20:25.549557 [ 1870 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:20:25.550304 [ 1870 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:20:26.012369 [ 1870 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:20:26.013127 [ 1870 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:20:26.058159 [ 1870 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:20:26.060468 [ 1870 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:26.114077 [ 1870 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:26.155401 [ 1870 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:26.491964 [ 1870 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:20:26.492874 [ 1870 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:26.553269 [ 1870 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:20:26.559095 [ 1870 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:26.561355 [ 1870 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:26.563695 [ 1870 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:20:26.565176 [ 1870 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:20:26.585852 [ 1870 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:20:26.593455 [ 1870 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:20:26.594278 [ 1870 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:20:26.595063 [ 1870 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:20:26.595725 [ 1870 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:20:26.597100 [ 1870 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:26.598420 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:26.660814 [ 1870 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:26.665172 [ 1870 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:26.665898 [ 1870 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:26.675798 [ 1870 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/did/jjbyhcfwxvzffsldyoymegwfxppkm 2025.04.02 03:20:26.677366 [ 1870 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/did/jjbyhcfwxvzffsldyoymegwfxppkm. 2025.04.02 03:20:26.791336 [ 2461 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/did/jjbyhcfwxvzffsldyoymegwfxppkm, size 4 2025.04.02 03:20:26.793088 [ 1870 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/did/jjbyhcfwxvzffsldyoymegwfxppkm. 2025.04.02 03:20:26.819499 [ 1870 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/did/jjbyhcfwxvzffsldyoymegwfxppkm 2025.04.02 03:20:26.820188 [ 1870 ] {} deleteFileFromS3: Object with path s3/did/jjbyhcfwxvzffsldyoymegwfxppkm was removed from S3 2025.04.02 03:20:26.820821 [ 1870 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:20:26.821718 [ 1870 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:20:26.841670 [ 1870 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:26.845917 [ 1870 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:26.846618 [ 1870 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:27.018944 [ 1870 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:20:27.050359 [ 1870 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:20:27 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BB2481BE344 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:20:27.071826 [ 1870 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:20:27.209749 [ 1870 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:20:27.237649 [ 1870 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:20:27.262217 [ 1870 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:20:27.282415 [ 1870 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:20:27.283663 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.284723 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.285733 [ 1870 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:27.286685 [ 1870 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:27.287575 [ 1870 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:20:27.288632 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.289753 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.290802 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.291635 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.292774 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.312930 [ 1870 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:27.317204 [ 1870 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:27.317794 [ 1870 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:27.363313 [ 1870 ] {} deleteFileFromS3: No blob storage log, not writing blob special/tjo/tbliqpfelljqhcqaceonfjkygtnzi 2025.04.02 03:20:27.363885 [ 1870 ] {} deleteFileFromS3: Object with path special/tjo/tbliqpfelljqhcqaceonfjkygtnzi was removed from S3 2025.04.02 03:20:27.364426 [ 1870 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:20:27.365121 [ 1870 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:20:27.408875 [ 1870 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:27.412877 [ 1870 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:27.413484 [ 1870 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:27.453082 [ 1870 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/lgv/pnonmwxuqnnpzxgjjwktfvphkptao 2025.04.02 03:20:27.453876 [ 1870 ] {} deleteFileFromS3: Object with path test_02944/lgv/pnonmwxuqnnpzxgjjwktfvphkptao was removed from S3 2025.04.02 03:20:27.454495 [ 1870 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:20:27.455160 [ 1870 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:20:27.456206 [ 1870 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:27.489354 [ 1870 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:27.508708 [ 1870 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:20:27.509404 [ 1870 ] {} KeeperSnapshotManager: Found snapshot_2.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:27.510080 [ 1870 ] {} KeeperSnapshotManager: Found snapshot_1.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:27.521033 [ 1870 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:20:27.521781 [ 1870 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:20:27.523499 [ 1870 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:20:27.524270 [ 1870 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:20:27.524800 [ 1870 ] {} KeeperStateMachine: Totally have 2 snapshots 2025.04.02 03:20:27.525380 [ 1870 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 2 2025.04.02 03:20:27.535030 [ 1870 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:20:27.536266 [ 1870 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 2 2025.04.02 03:20:27.539223 [ 1870 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 2 entries 2025.04.02 03:20:27.540162 [ 1870 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:20:27.541142 [ 1870 ] {} KeeperServer: Last local log idx 2 2025.04.02 03:20:27.542461 [ 1870 ] {} KeeperServer: Will use config from log store with log index 2 2025.04.02 03:20:27.551229 [ 1870 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:20:27.561825 [ 1870 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:20:27.564985 [ 1870 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:20:27.567279 [ 1870 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:20:27.568111 [ 1870 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:20:27.569081 [ 1870 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:20:27.570311 [ 1870 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:20:27.571791 [ 1870 ] {} RaftInstance: === INIT RAFT SERVER === commit index 2 term 2 election timer allowed log store start 1, end 2 config log idx 2, prev log idx 1 -- ASYNC REPLICATION -- 2025.04.02 03:20:27.572799 [ 1870 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:20:27.574205 [ 1870 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:20:27.575272 [ 1870 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:20:27.575639 [ 2492 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:20:27.627855 [ 2475 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:20:27.628759 [ 2475 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:20:27.629022 [ 1870 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:20:27.630327 [ 2475 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 2, state term 2, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:20:27.630959 [ 2475 ] {} RaftInstance: pre-vote term (0) is different, reset it to 2 2025.04.02 03:20:27.632177 [ 2475 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:20:27.637140 [ 2475 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 3, log idx 2, log term 2, priority (target 1 / mine 1) 2025.04.02 03:20:27.638398 [ 2475 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:20:27.640268 [ 2475 ] {} RaftInstance: state machine commit index 2, precommit index 2, last log index 2 2025.04.02 03:20:27.643599 [ 2475 ] {} RaftInstance: [BECOME LEADER] appended new config at 3 2025.04.02 03:20:27.647524 [ 2491 ] {} RaftInstance: config at index 3 is committed, prev config log idx 2 2025.04.02 03:20:27.648495 [ 2491 ] {} RaftInstance: new config log idx 3, prev log idx 2, cur config log idx 2, prev log idx 1 2025.04.02 03:20:27.649161 [ 2491 ] {} RaftInstance: new configuration: log idx 3, prev log idx 2 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 3 2025.04.02 03:20:27.652114 [ 1870 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:20:27.653473 [ 1870 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:20:27.661560 [ 1870 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:20:27.662391 [ 1870 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:20:27.676494 [ 1870 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:20:27.677129 [ 1870 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:20:27.678897 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:20:27.680186 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:20:27.681079 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:20:27.682535 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:20:27.683826 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:20:27.685172 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:20:27.686509 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:20:27.687639 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:20:27.689575 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:20:27.690952 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:20:27.692218 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:20:27.693460 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:20:27.694737 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:20:27.695972 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:20:27.697149 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:20:27.698326 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:20:27.699589 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:20:27.700858 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:20:27.702260 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:20:27.703389 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:20:27.704625 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:20:27.705861 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:20:27.707189 [ 1870 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:20:27.713940 [ 1870 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:20:27.714634 [ 1870 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:20:28.491508 [ 1870 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:20:28.492716 [ 1870 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:28.514206 [ 1870 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:20:28.517070 [ 1870 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:20:28.523321 [ 1870 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:20:28.523652 [ 2501 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:20:28.578771 [ 1870 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:20:28.584185 [ 1870 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:20:28.593689 [ 1870 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:20:28.664475 [ 1870 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:20:28.756858 [ 1870 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:20:28.784240 [ 1870 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:20:28.817431 [ 1870 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:20:28.818674 [ 1883 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:20:28.819121 [ 1870 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:20:28.836033 [ 1883 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:20:33.280688 [ 1870 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:33.281865 [ 1870 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:20:33.286315 [ 1870 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:20:33.287092 [ 1870 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:20:33.288075 [ 1882 ] {} CancellationChecker: Execution took 9158 ms. 2025.04.02 03:20:33.290526 [ 1870 ] {} Application: Shutting down storages. 2025.04.02 03:20:33.291187 [ 1870 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:20:33.297807 [ 1870 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:20:33.298488 [ 1870 ] {} Context: Shutting down workload entity storage 2025.04.02 03:20:33.299140 [ 1870 ] {} Context: Shutting down named sessions 2025.04.02 03:20:33.300572 [ 1870 ] {} Context: Shutting down database catalog 2025.04.02 03:20:33.301489 [ 1870 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:20:33.302750 [ 1870 ] {} Context: Shutting down merges executor 2025.04.02 03:20:33.305329 [ 1870 ] {} Context: Shutting down fetches executor 2025.04.02 03:20:33.308056 [ 1870 ] {} Context: Shutting down moves executor 2025.04.02 03:20:33.309877 [ 1870 ] {} Context: Shutting down common executor 2025.04.02 03:20:33.311970 [ 1870 ] {} Context: Shutting down DDLWorker 2025.04.02 03:20:33.312607 [ 1870 ] {} Context: Shutting down caches 2025.04.02 03:20:33.313797 [ 1870 ] {} Context: Shutting down AccessControl 2025.04.02 03:20:33.318160 [ 1870 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:20:33.325146 [ 1870 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:20:33.995415 [ 1870 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:20:34.000704 [ 1870 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:20:34.015494 [ 1870 ] {} Application: Shut down storages. 2025.04.02 03:20:34.016102 [ 1870 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:20:34.438430 [ 1870 ] {} Application: Closed all listening sockets. 2025.04.02 03:20:34.439423 [ 1870 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:20:34.441167 [ 1870 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:20:34.678002 [ 1870 ] {} RaftInstance: shutting down raft core 2025.04.02 03:20:34.698071 [ 1870 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:20:34.699019 [ 1870 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:20:34.706022 [ 1870 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:20:34.713233 [ 1870 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:20:34.714476 [ 1870 ] {} RaftInstance: reset all pointers. 2025.04.02 03:20:34.715751 [ 1870 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:20:34.716871 [ 2492 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:20:34.717077 [ 1870 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:20:34.718395 [ 1870 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:20:34.719294 [ 1870 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:20:34.720226 [ 1870 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:20:34.720833 [ 1870 ] {} RaftInstance: manually create a snapshot on 3 2025.04.02 03:20:34.722917 [ 1870 ] {} RaftInstance: creating a snapshot for index 3 2025.04.02 03:20:34.723882 [ 1870 ] {} RaftInstance: create snapshot idx 3 log_term 3 2025.04.02 03:20:34.725035 [ 1870 ] {} KeeperStateMachine: Creating snapshot 3 2025.04.02 03:20:34.726193 [ 1870 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:20:34.773887 [ 1870 ] {} KeeperStateMachine: Created persistent snapshot 3 with path snapshot_3.bin.zstd 2025.04.02 03:20:34.775140 [ 1870 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:20:34.776122 [ 1870 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:20:34.777304 [ 1870 ] {} RaftInstance: snapshot idx 3 log_term 3 created, compact the log store if needed 2025.04.02 03:20:34.779254 [ 1870 ] {} RaftInstance: create snapshot idx 3 log_term 3 done: 54304 us elapsed 2025.04.02 03:20:34.780636 [ 2477 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:20:34.783017 [ 2485 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:20:34.783317 [ 2486 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:20:34.783420 [ 2487 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:20:34.783752 [ 2482 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:20:34.783594 [ 2484 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:20:34.783966 [ 2489 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:20:34.783997 [ 2481 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:20:34.784202 [ 2483 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:20:34.784295 [ 2488 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:20:34.784711 [ 2480 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:34.784575 [ 2479 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:34.784658 [ 2476 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:34.784395 [ 2490 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:20:34.784815 [ 2475 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:34.784875 [ 2478 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:20:34.784990 [ 2477 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:34.789688 [ 1870 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:34.790524 [ 2474 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:20:34.794046 [ 1870 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:20:34.797283 [ 1870 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:20:34.797948 [ 1870 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:20:34.799719 [ 1870 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:20:34.800786 [ 1870 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:34.802583 [ 1870 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:34.803261 [ 1870 ] {} Context: Destructing threadpool writer 2025.04.02 03:20:34.863149 [ 1870 ] {} Application: Destroyed global context. 2025.04.02 03:20:34.865148 [ 1870 ] {} Application: Waiting for background threads 2025.04.02 03:20:34.950422 [ 1870 ] {} Application: Background threads finished in 85 ms 2025.04.02 03:20:34.954678 [ 1870 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:20:34.955201 [ 1870 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:35.043837 [ 1870 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:35.044839 [ 1870 ] {} Application: shutting down 2025.04.02 03:20:35.045441 [ 1870 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:20:35.047374 [ 1871 ] {} BaseDaemon: Received signal -2 2025.04.02 03:20:35.048394 [ 1871 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:20:35.133526 [ 1869 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:20:35.709354 [ 2607 ] {} Application: Will watch for the process with pid 2608 2025.04.02 03:20:35.709588 [ 2608 ] {} Application: Forked a child process to watch 2025.04.02 03:20:35.710455 [ 2608 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:20:35.813823 [ 2608 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 2608 2025.04.02 03:20:35.814355 [ 2608 ] {} Application: starting up 2025.04.02 03:20:35.814375 [ 2608 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:20:35.823960 [ 2608 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:20:35.825412 [ 2608 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:20:35.827449 [ 2608 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:20:35.828248 [ 2608 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:20:35.829543 [ 2608 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:20:35.830772 [ 2608 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:20:35.836811 [ 2608 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:20:35.856132 [ 2608 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:20:35.857213 [ 2608 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:20:35.858310 [ 2608 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:20:35.859419 [ 2608 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:20:37.196264 [ 2608 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:20:37.229730 [ 2608 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:20:37.298348 [ 2608 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:20:37.300221 [ 2608 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:20:37.305298 [ 2608 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:20:37.723475 [ 2618 ] {} CancellationChecker: Started worker function 2025.04.02 03:20:37.724628 [ 2608 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:20:37.725362 [ 2608 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:20:37.727139 [ 2608 ] {} Application: Initializing DateLUT. 2025.04.02 03:20:37.727844 [ 2608 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:20:37.729361 [ 2608 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:20:37.732314 [ 2608 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:20:37.739165 [ 2608 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:20:37.740031 [ 2608 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:20:37.740859 [ 2608 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:20:37.743356 [ 2608 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:20:37.744509 [ 2608 ] {} Application: Initializing interserver credentials. 2025.04.02 03:20:37.752585 [ 2608 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:20:37.800662 [ 2608 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:20:37.803127 [ 2608 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:20:37.810085 [ 2608 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:20:37.810838 [ 2608 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:20:37.815014 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:20:37.816591 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:20:37.818088 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:20:37.819458 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:20:37.820742 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:20:37.823870 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:20:37.825488 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:20:37.826850 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:20:37.828087 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:20:37.829292 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:20:37.830749 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:20:37.831921 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:20:37.833140 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:20:37.834516 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:20:37.835832 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:20:37.837055 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:20:37.838381 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:20:37.844249 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:20:37.845620 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:20:37.846854 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:20:37.848215 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:20:37.849429 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:20:37.851000 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:20:37.852685 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:20:37.854087 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:20:37.855188 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:20:37.856997 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:20:37.858252 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:20:37.859560 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:20:37.860837 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:20:37.862112 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:20:37.863366 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:20:37.864798 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:20:37.866148 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:20:37.867605 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:20:37.868829 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:20:37.870291 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:20:37.871622 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:20:37.873025 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:20:37.874821 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:20:37.876291 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:20:37.877348 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:20:37.878646 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:20:37.879970 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:20:37.881498 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:20:37.883044 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:20:37.884576 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:20:37.886266 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:20:37.888633 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:20:37.890341 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:20:37.891983 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:20:37.893492 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:20:37.894932 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:20:37.896205 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:20:37.897843 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:20:37.899372 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:20:37.900325 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:20:37.901806 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:20:37.903188 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:20:37.904616 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:20:37.906033 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:20:37.907530 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:20:37.908839 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:20:37.910326 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:20:37.911816 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:20:37.913777 [ 2608 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:20:37.948547 [ 2608 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:20:37.953998 [ 2608 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:20:38.821875 [ 2608 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:20:38.822675 [ 2608 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:20:38.823471 [ 2608 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:20:39.495057 [ 2608 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:20:39.495834 [ 2608 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:20:39.497597 [ 2608 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:20:39.499650 [ 2608 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:39.507193 [ 2608 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:39.514165 [ 2608 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:39.589488 [ 2608 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:20:39.590702 [ 2608 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:39.595397 [ 2608 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:20:39.599828 [ 2608 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:39.601833 [ 2608 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:39.603882 [ 2608 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:20:39.605043 [ 2608 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:20:39.614038 [ 2608 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:20:39.614580 [ 2608 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:20:39.615233 [ 2608 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:20:39.615917 [ 2608 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:20:39.616598 [ 2608 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:20:39.617720 [ 2608 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:39.618752 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:39.747376 [ 2608 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:39.750718 [ 2608 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:39.756783 [ 2608 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:39.766987 [ 2608 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/syu/wjpqqyhceembghzslvwbcuprjrtec 2025.04.02 03:20:39.768530 [ 2608 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/syu/wjpqqyhceembghzslvwbcuprjrtec. 2025.04.02 03:20:39.784968 [ 3195 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/syu/wjpqqyhceembghzslvwbcuprjrtec, size 4 2025.04.02 03:20:39.786436 [ 2608 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/syu/wjpqqyhceembghzslvwbcuprjrtec. 2025.04.02 03:20:39.818003 [ 2608 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/syu/wjpqqyhceembghzslvwbcuprjrtec 2025.04.02 03:20:39.818545 [ 2608 ] {} deleteFileFromS3: Object with path s3/syu/wjpqqyhceembghzslvwbcuprjrtec was removed from S3 2025.04.02 03:20:39.819221 [ 2608 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:20:39.819919 [ 2608 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:20:40.053002 [ 2608 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:40.073080 [ 2608 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:40.085770 [ 2608 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:40.371993 [ 2608 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:20:40.373108 [ 2608 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:20:40 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BB56404EFE8 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:20:40.375485 [ 2608 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:20:40.388778 [ 2608 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:20:40.389582 [ 2608 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:20:40.390309 [ 2608 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:20:40.391208 [ 2608 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:20:40.392480 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.393680 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.394951 [ 2608 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:40.396069 [ 2608 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:40.397208 [ 2608 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:20:40.398295 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.399646 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.400903 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.402184 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.403325 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.425779 [ 2608 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:40.430251 [ 2608 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:40.431014 [ 2608 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:40.545174 [ 2608 ] {} deleteFileFromS3: No blob storage log, not writing blob special/wcn/bhyjqfbifmarigmpkporcwhklycpw 2025.04.02 03:20:40.546016 [ 2608 ] {} deleteFileFromS3: Object with path special/wcn/bhyjqfbifmarigmpkporcwhklycpw was removed from S3 2025.04.02 03:20:40.546798 [ 2608 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:20:40.547745 [ 2608 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:20:40.570632 [ 2608 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:40.573860 [ 2608 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:40.574620 [ 2608 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:40.617370 [ 2608 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ppv/dvxjxkzzigyqcssqhdaiycpmxokgs 2025.04.02 03:20:40.618038 [ 2608 ] {} deleteFileFromS3: Object with path test_02944/ppv/dvxjxkzzigyqcssqhdaiycpmxokgs was removed from S3 2025.04.02 03:20:40.618734 [ 2608 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:20:40.619547 [ 2608 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:20:40.620408 [ 2608 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:40.644821 [ 2608 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:40.664633 [ 2608 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:20:40.665438 [ 2608 ] {} KeeperSnapshotManager: Found snapshot_2.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:40.666195 [ 2608 ] {} KeeperSnapshotManager: Found snapshot_3.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:40.666720 [ 2608 ] {} KeeperSnapshotManager: Found snapshot_1.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:40.677681 [ 2608 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:20:40.678367 [ 2608 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:20:40.680106 [ 2608 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:20:40.680822 [ 2608 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:20:40.681451 [ 2608 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:20:40.682013 [ 2608 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 3 2025.04.02 03:20:40.689009 [ 2608 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:20:40.690169 [ 2608 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 3 2025.04.02 03:20:40.693221 [ 2608 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 3 entries 2025.04.02 03:20:40.694174 [ 2608 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:20:40.695160 [ 2608 ] {} KeeperServer: Last local log idx 3 2025.04.02 03:20:40.696275 [ 2608 ] {} KeeperServer: Will use config from log store with log index 3 2025.04.02 03:20:40.705833 [ 2608 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:20:40.722257 [ 2608 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:20:40.725566 [ 2608 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:20:40.728045 [ 2608 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:20:40.728890 [ 2608 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:20:40.730051 [ 2608 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:20:40.731444 [ 2608 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:20:40.733115 [ 2608 ] {} RaftInstance: === INIT RAFT SERVER === commit index 3 term 3 election timer allowed log store start 1, end 3 config log idx 3, prev log idx 2 -- ASYNC REPLICATION -- 2025.04.02 03:20:40.734228 [ 2608 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:20:40.735962 [ 2608 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:20:40.737331 [ 2608 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:20:40.737643 [ 3226 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:20:40.810149 [ 2608 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:20:40.809622 [ 3209 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:20:40.818109 [ 3209 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:20:40.834358 [ 3209 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 3, state term 3, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:20:40.835160 [ 3209 ] {} RaftInstance: pre-vote term (0) is different, reset it to 3 2025.04.02 03:20:40.865685 [ 3209 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:20:40.905238 [ 3209 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 4, log idx 3, log term 3, priority (target 1 / mine 1) 2025.04.02 03:20:40.921551 [ 3209 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:20:40.946711 [ 3209 ] {} RaftInstance: state machine commit index 3, precommit index 3, last log index 3 2025.04.02 03:20:40.959974 [ 3209 ] {} RaftInstance: [BECOME LEADER] appended new config at 4 2025.04.02 03:20:40.970697 [ 3225 ] {} RaftInstance: config at index 4 is committed, prev config log idx 3 2025.04.02 03:20:40.971752 [ 3225 ] {} RaftInstance: new config log idx 4, prev log idx 3, cur config log idx 3, prev log idx 2 2025.04.02 03:20:40.972598 [ 3225 ] {} RaftInstance: new configuration: log idx 4, prev log idx 3 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 4 2025.04.02 03:20:40.975714 [ 2608 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:20:40.977212 [ 2608 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:20:41.026028 [ 2608 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:20:41.041457 [ 2608 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:20:41.131544 [ 2608 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:20:41.132227 [ 2608 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:20:41.133939 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:20:41.135306 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:20:41.136224 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:20:41.137399 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:20:41.138887 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:20:41.139957 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:20:41.141281 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:20:41.142432 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:20:41.144792 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:20:41.243567 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:20:41.245288 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:20:41.246970 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:20:41.248402 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:20:41.293287 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:20:41.295100 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:20:41.296759 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:20:41.298243 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:20:41.299792 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:20:41.301376 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:20:41.302962 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:20:41.308376 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:20:41.309933 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:20:41.311463 [ 2608 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:20:41.317659 [ 2608 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:20:41.318503 [ 2608 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:20:41.984394 [ 2608 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:20:41.985348 [ 2608 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:41.987313 [ 2608 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:20:41.990058 [ 2608 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:20:41.995758 [ 2608 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:20:41.996041 [ 3239 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:20:42.046734 [ 2608 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:20:42.051903 [ 2608 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:20:42.061232 [ 2608 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:20:42.066646 [ 2608 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:20:42.075118 [ 2608 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:20:42.080564 [ 2608 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:20:42.089914 [ 2608 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:20:42.091224 [ 2608 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:20:42.091364 [ 2620 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:20:42.098853 [ 2620 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:20:46.490781 [ 2608 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:46.491700 [ 2608 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:20:46.522084 [ 2608 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:20:46.529753 [ 2608 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:20:46.532235 [ 2618 ] {} CancellationChecker: Execution took 8809 ms. 2025.04.02 03:20:46.539234 [ 2608 ] {} Application: Shutting down storages. 2025.04.02 03:20:46.542441 [ 2608 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:20:46.691199 [ 2608 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:20:46.692091 [ 2608 ] {} Context: Shutting down workload entity storage 2025.04.02 03:20:46.692775 [ 2608 ] {} Context: Shutting down named sessions 2025.04.02 03:20:46.737217 [ 2608 ] {} Context: Shutting down database catalog 2025.04.02 03:20:46.745605 [ 2608 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:20:46.746940 [ 2608 ] {} Context: Shutting down merges executor 2025.04.02 03:20:46.749849 [ 2608 ] {} Context: Shutting down fetches executor 2025.04.02 03:20:46.767346 [ 2608 ] {} Context: Shutting down moves executor 2025.04.02 03:20:46.782331 [ 2608 ] {} Context: Shutting down common executor 2025.04.02 03:20:46.788054 [ 2608 ] {} Context: Shutting down DDLWorker 2025.04.02 03:20:46.788814 [ 2608 ] {} Context: Shutting down caches 2025.04.02 03:20:46.791314 [ 2608 ] {} Context: Shutting down AccessControl 2025.04.02 03:20:46.806228 [ 2608 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:20:46.825961 [ 2608 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:20:47.059273 [ 2608 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:20:47.064640 [ 2608 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:20:47.111153 [ 2608 ] {} Application: Shut down storages. 2025.04.02 03:20:47.111764 [ 2608 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:20:47.536511 [ 2608 ] {} Application: Closed all listening sockets. 2025.04.02 03:20:47.537366 [ 2608 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:20:47.539035 [ 2608 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:20:47.984145 [ 2608 ] {} RaftInstance: shutting down raft core 2025.04.02 03:20:47.986317 [ 2608 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:20:47.987315 [ 2608 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:20:47.988343 [ 2608 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:20:47.990129 [ 2608 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:20:47.991495 [ 2608 ] {} RaftInstance: reset all pointers. 2025.04.02 03:20:47.992844 [ 2608 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:20:47.994131 [ 2608 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:20:47.994365 [ 3226 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:20:47.996136 [ 2608 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:20:47.997247 [ 2608 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:20:47.998478 [ 2608 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:20:47.999472 [ 2608 ] {} RaftInstance: manually create a snapshot on 4 2025.04.02 03:20:48.002171 [ 2608 ] {} RaftInstance: creating a snapshot for index 4 2025.04.02 03:20:48.003467 [ 2608 ] {} RaftInstance: create snapshot idx 4 log_term 4 2025.04.02 03:20:48.004831 [ 2608 ] {} KeeperStateMachine: Creating snapshot 4 2025.04.02 03:20:48.006302 [ 2608 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:20:48.010323 [ 2608 ] {} KeeperStateMachine: Created persistent snapshot 4 with path snapshot_4.bin.zstd 2025.04.02 03:20:48.011471 [ 2608 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:20:48.012365 [ 2608 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:20:48.013615 [ 2608 ] {} RaftInstance: snapshot idx 4 log_term 4 created, compact the log store if needed 2025.04.02 03:20:48.016453 [ 2608 ] {} RaftInstance: create snapshot idx 4 log_term 4 done: 11728 us elapsed 2025.04.02 03:20:48.018385 [ 3212 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:20:48.020957 [ 3213 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:20:48.021129 [ 3215 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:20:48.021391 [ 3220 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:20:48.021492 [ 3212 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:20:48.021626 [ 3221 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:20:48.021867 [ 3224 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:20:48.022060 [ 3214 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:20:48.022181 [ 3210 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:48.022282 [ 3218 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:48.022459 [ 3216 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:20:48.022571 [ 3219 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:48.022384 [ 3217 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:20:48.022680 [ 3209 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:20:48.022792 [ 3222 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:48.022906 [ 3223 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:48.023024 [ 3211 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:20:48.027918 [ 2608 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:48.029126 [ 3208 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:20:48.032919 [ 2608 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:20:48.034432 [ 2608 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:20:48.035352 [ 2608 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:20:48.037400 [ 2608 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:20:48.038469 [ 2608 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:48.040387 [ 2608 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:20:48.041243 [ 2608 ] {} Context: Destructing threadpool writer 2025.04.02 03:20:48.081281 [ 2608 ] {} Application: Destroyed global context. 2025.04.02 03:20:48.083249 [ 2608 ] {} Application: Waiting for background threads 2025.04.02 03:20:48.327024 [ 2608 ] {} Application: Background threads finished in 243 ms 2025.04.02 03:20:48.393446 [ 2608 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:20:48.401795 [ 2608 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:20:48.456636 [ 2608 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:20:48.457623 [ 2608 ] {} Application: shutting down 2025.04.02 03:20:48.458362 [ 2608 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:20:48.460214 [ 2609 ] {} BaseDaemon: Received signal -2 2025.04.02 03:20:48.461003 [ 2609 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:20:48.555014 [ 2607 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:20:49.449539 [ 3345 ] {} Application: Will watch for the process with pid 3346 2025.04.02 03:20:49.449744 [ 3346 ] {} Application: Forked a child process to watch 2025.04.02 03:20:49.450422 [ 3346 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:20:49.558954 [ 3346 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 3346 2025.04.02 03:20:49.559362 [ 3346 ] {} Application: starting up 2025.04.02 03:20:49.559380 [ 3346 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:20:49.569033 [ 3346 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:20:49.570609 [ 3346 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:20:49.572533 [ 3346 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:20:49.573538 [ 3346 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:20:49.574733 [ 3346 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:20:49.575762 [ 3346 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:20:49.580562 [ 3346 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:20:49.591789 [ 3346 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:20:49.592673 [ 3346 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:20:49.593574 [ 3346 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:20:49.594407 [ 3346 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:20:51.293862 [ 3346 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:20:51.295706 [ 3346 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:20:51.344098 [ 3346 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:20:51.345456 [ 3346 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:20:51.347515 [ 3346 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:20:51.706796 [ 3870 ] {} CancellationChecker: Started worker function 2025.04.02 03:20:51.707866 [ 3346 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:20:51.708517 [ 3346 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:20:51.710253 [ 3346 ] {} Application: Initializing DateLUT. 2025.04.02 03:20:51.710781 [ 3346 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:20:51.712240 [ 3346 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:20:51.715034 [ 3346 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:20:51.734802 [ 3346 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:20:51.735961 [ 3346 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:20:51.777345 [ 3346 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:20:51.825305 [ 3346 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:20:51.861619 [ 3346 ] {} Application: Initializing interserver credentials. 2025.04.02 03:20:51.929942 [ 3346 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:20:52.187440 [ 3346 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:20:52.189676 [ 3346 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:20:52.196884 [ 3346 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:20:52.272743 [ 3346 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:20:52.277936 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:20:52.280027 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:20:52.281971 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:20:52.283827 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:20:52.285576 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:20:52.288939 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:20:52.290455 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:20:52.292079 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:20:52.293542 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:20:52.295014 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:20:52.296668 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:20:52.298147 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:20:52.299480 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:20:52.300735 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:20:52.302273 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:20:52.303536 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:20:52.304913 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:20:52.372233 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:20:52.373874 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:20:52.375355 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:20:52.376813 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:20:52.378348 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:20:52.379719 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:20:52.381368 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:20:52.382809 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:20:52.383724 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:20:52.385345 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:20:52.386766 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:20:52.387891 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:20:52.389271 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:20:52.390522 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:20:52.391804 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:20:52.393218 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:20:52.394632 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:20:52.395924 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:20:52.397007 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:20:52.398524 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:20:52.399883 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:20:52.401327 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:20:52.402761 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:20:52.404152 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:20:52.405559 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:20:52.406995 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:20:52.408240 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:20:52.459129 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:20:52.460709 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:20:52.462553 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:20:52.464149 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:20:52.466533 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:20:52.468298 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:20:52.470031 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:20:52.471528 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:20:52.472984 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:20:52.474406 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:20:52.476081 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:20:52.477574 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:20:52.478547 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:20:52.480121 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:20:52.481709 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:20:52.483204 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:20:52.484863 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:20:52.486341 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:20:52.487830 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:20:52.489555 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:20:52.491067 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:20:52.492916 [ 3346 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:20:52.534575 [ 3346 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:20:52.540659 [ 3346 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:20:53.882110 [ 3346 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:20:53.882863 [ 3346 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:20:53.883437 [ 3346 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:20:54.268167 [ 3346 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:20:54.268882 [ 3346 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:20:54.270816 [ 3346 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:20:54.272940 [ 3346 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:54.279645 [ 3346 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:54.286419 [ 3346 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:20:54.754922 [ 3346 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:20:54.756311 [ 3346 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:54.762983 [ 3346 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:20:54.778138 [ 3346 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:54.780512 [ 3346 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:20:54.822100 [ 3346 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:20:54.824257 [ 3346 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:20:54.836414 [ 3346 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:20:54.837156 [ 3346 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:20:54.837927 [ 3346 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:20:54.847283 [ 3346 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:20:54.847963 [ 3346 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:20:54.849550 [ 3346 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:54.850830 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:54.979057 [ 3346 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:54.983498 [ 3346 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:54.984135 [ 3346 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:54.994848 [ 3346 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/mpt/wvugjnagjpjiocrykdymmqrifmemw 2025.04.02 03:20:54.996519 [ 3346 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/mpt/wvugjnagjpjiocrykdymmqrifmemw. 2025.04.02 03:20:55.013767 [ 3941 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/mpt/wvugjnagjpjiocrykdymmqrifmemw, size 4 2025.04.02 03:20:55.015095 [ 3346 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/mpt/wvugjnagjpjiocrykdymmqrifmemw. 2025.04.02 03:20:55.038942 [ 3346 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/mpt/wvugjnagjpjiocrykdymmqrifmemw 2025.04.02 03:20:55.039501 [ 3346 ] {} deleteFileFromS3: Object with path s3/mpt/wvugjnagjpjiocrykdymmqrifmemw was removed from S3 2025.04.02 03:20:55.040181 [ 3346 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:20:55.041059 [ 3346 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:20:55.060795 [ 3346 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:55.064947 [ 3346 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:55.065723 [ 3346 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:55.125525 [ 3346 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:20:55.126610 [ 3346 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:20:55 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BB8D3683EB7 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:20:55.128820 [ 3346 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:20:55.267902 [ 3346 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:20:55.268709 [ 3346 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:20:55.269444 [ 3346 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:20:55.275348 [ 3346 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:20:55.277641 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.283708 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.297675 [ 3346 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:55.329316 [ 3346 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:55.330656 [ 3346 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:20:55.331940 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.336871 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.338005 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.349228 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.364289 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.449009 [ 3346 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:55.453273 [ 3346 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:55.454015 [ 3346 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:55.496886 [ 3346 ] {} deleteFileFromS3: No blob storage log, not writing blob special/etc/ouctgctwrmlufwjbrusllfmyuzeau 2025.04.02 03:20:55.497513 [ 3346 ] {} deleteFileFromS3: Object with path special/etc/ouctgctwrmlufwjbrusllfmyuzeau was removed from S3 2025.04.02 03:20:55.498239 [ 3346 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:20:55.499300 [ 3346 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:20:55.526509 [ 3346 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:20:55.530756 [ 3346 ] {} S3Client: Provider type: Unknown 2025.04.02 03:20:55.531618 [ 3346 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:20:55.572971 [ 3346 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/lhl/xmpvzvvobxsoqxkomcfjnyobmaecl 2025.04.02 03:20:55.573751 [ 3346 ] {} deleteFileFromS3: Object with path test_02944/lhl/xmpvzvvobxsoqxkomcfjnyobmaecl was removed from S3 2025.04.02 03:20:55.574385 [ 3346 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:20:55.575205 [ 3346 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:20:55.576191 [ 3346 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:20:55.603174 [ 3346 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:20:55.622529 [ 3346 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:20:55.623132 [ 3346 ] {} KeeperSnapshotManager: Found snapshot_2.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:55.623734 [ 3346 ] {} KeeperSnapshotManager: Found snapshot_3.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:55.624182 [ 3346 ] {} KeeperSnapshotManager: Found snapshot_4.bin.zstd on LocalSnapshotDisk 2025.04.02 03:20:55.633834 [ 3346 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:20:55.634441 [ 3346 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:20:55.635874 [ 3346 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:20:55.636934 [ 3346 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:20:55.637750 [ 3346 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:20:55.638470 [ 3346 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 4 2025.04.02 03:20:55.645822 [ 3346 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:20:55.647184 [ 3346 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 4 2025.04.02 03:20:55.650572 [ 3346 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 4 entries 2025.04.02 03:20:55.651749 [ 3346 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:20:55.652802 [ 3346 ] {} KeeperServer: Last local log idx 4 2025.04.02 03:20:55.654073 [ 3346 ] {} KeeperServer: Will use config from log store with log index 4 2025.04.02 03:20:55.663245 [ 3346 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:20:55.674088 [ 3346 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:20:55.678345 [ 3346 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:20:55.680615 [ 3346 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:20:55.681506 [ 3346 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:20:55.682552 [ 3346 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:20:55.683973 [ 3346 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:20:55.685524 [ 3346 ] {} RaftInstance: === INIT RAFT SERVER === commit index 4 term 4 election timer allowed log store start 1, end 4 config log idx 4, prev log idx 3 -- ASYNC REPLICATION -- 2025.04.02 03:20:55.686570 [ 3346 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:20:55.688096 [ 3346 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:20:55.689160 [ 3346 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:20:55.689579 [ 3972 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:20:55.742655 [ 3346 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:20:55.741716 [ 3957 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:20:55.743593 [ 3957 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:20:55.745277 [ 3957 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 4, state term 4, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:20:55.745925 [ 3957 ] {} RaftInstance: pre-vote term (0) is different, reset it to 4 2025.04.02 03:20:55.747083 [ 3957 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:20:55.751758 [ 3957 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 5, log idx 4, log term 4, priority (target 1 / mine 1) 2025.04.02 03:20:55.752941 [ 3957 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:20:55.754828 [ 3957 ] {} RaftInstance: state machine commit index 4, precommit index 4, last log index 4 2025.04.02 03:20:55.758339 [ 3957 ] {} RaftInstance: [BECOME LEADER] appended new config at 5 2025.04.02 03:20:55.762210 [ 3971 ] {} RaftInstance: config at index 5 is committed, prev config log idx 4 2025.04.02 03:20:55.763222 [ 3971 ] {} RaftInstance: new config log idx 5, prev log idx 4, cur config log idx 4, prev log idx 3 2025.04.02 03:20:55.764042 [ 3971 ] {} RaftInstance: new configuration: log idx 5, prev log idx 4 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 5 2025.04.02 03:20:55.768721 [ 3346 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:20:55.770101 [ 3346 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:20:55.780183 [ 3346 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:20:55.780982 [ 3346 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:20:55.793001 [ 3346 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:20:55.793640 [ 3346 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:20:55.795204 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:20:55.796502 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:20:55.797368 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:20:55.798395 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:20:55.799571 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:20:55.800674 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:20:55.801679 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:20:55.802872 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:20:55.804817 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:20:55.806091 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:20:55.807339 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:20:55.808637 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:20:55.810011 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:20:55.811100 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:20:55.812270 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:20:55.813539 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:20:55.814577 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:20:55.815751 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:20:55.816979 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:20:55.818240 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:20:55.819519 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:20:55.820623 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:20:55.822097 [ 3346 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:20:55.828898 [ 3346 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:20:55.829811 [ 3346 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:20:56.768135 [ 3346 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:20:56.769062 [ 3346 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:20:56.770976 [ 3346 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:20:56.773672 [ 3346 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:20:56.779519 [ 3346 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:20:56.780003 [ 3981 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:20:56.891533 [ 3346 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:20:56.902391 [ 3346 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:20:56.987828 [ 3346 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:20:56.998287 [ 3346 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:20:57.022303 [ 3346 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:20:57.047916 [ 3346 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:20:57.095615 [ 3346 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:20:57.096986 [ 3359 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:20:57.097814 [ 3346 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:20:57.104347 [ 3359 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:21:01.907241 [ 3346 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:01.910954 [ 3346 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:21:01.923948 [ 3346 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:21:01.924708 [ 3346 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:21:01.927282 [ 3870 ] {} CancellationChecker: Execution took 10221 ms. 2025.04.02 03:21:01.928678 [ 3346 ] {} Application: Shutting down storages. 2025.04.02 03:21:01.929274 [ 3346 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:21:01.958245 [ 3346 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:21:01.959476 [ 3346 ] {} Context: Shutting down workload entity storage 2025.04.02 03:21:01.960159 [ 3346 ] {} Context: Shutting down named sessions 2025.04.02 03:21:01.961254 [ 3346 ] {} Context: Shutting down database catalog 2025.04.02 03:21:01.962039 [ 3346 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:21:01.963212 [ 3346 ] {} Context: Shutting down merges executor 2025.04.02 03:21:01.965660 [ 3346 ] {} Context: Shutting down fetches executor 2025.04.02 03:21:01.968091 [ 3346 ] {} Context: Shutting down moves executor 2025.04.02 03:21:01.969781 [ 3346 ] {} Context: Shutting down common executor 2025.04.02 03:21:01.971736 [ 3346 ] {} Context: Shutting down DDLWorker 2025.04.02 03:21:01.972287 [ 3346 ] {} Context: Shutting down caches 2025.04.02 03:21:01.973384 [ 3346 ] {} Context: Shutting down AccessControl 2025.04.02 03:21:01.978122 [ 3346 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:21:01.983640 [ 3346 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:21:02.138666 [ 3346 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:21:02.144108 [ 3346 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:21:02.168355 [ 3346 ] {} Application: Shut down storages. 2025.04.02 03:21:02.169010 [ 3346 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:21:02.554133 [ 3346 ] {} Application: Closed all listening sockets. 2025.04.02 03:21:02.557223 [ 3346 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:21:02.574461 [ 3346 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:21:02.775729 [ 3346 ] {} RaftInstance: shutting down raft core 2025.04.02 03:21:02.776795 [ 3346 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:21:02.777497 [ 3346 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:21:02.778005 [ 3346 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:21:02.779040 [ 3346 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:21:02.779921 [ 3346 ] {} RaftInstance: reset all pointers. 2025.04.02 03:21:02.780874 [ 3346 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:21:02.781869 [ 3972 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:21:02.782013 [ 3346 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:21:02.783154 [ 3346 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:21:02.784018 [ 3346 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:21:02.785124 [ 3346 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:21:02.785839 [ 3346 ] {} RaftInstance: manually create a snapshot on 5 2025.04.02 03:21:02.787723 [ 3346 ] {} RaftInstance: creating a snapshot for index 5 2025.04.02 03:21:02.788668 [ 3346 ] {} RaftInstance: create snapshot idx 5 log_term 5 2025.04.02 03:21:02.789597 [ 3346 ] {} KeeperStateMachine: Creating snapshot 5 2025.04.02 03:21:02.790761 [ 3346 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:21:02.794463 [ 3346 ] {} KeeperStateMachine: Created persistent snapshot 5 with path snapshot_5.bin.zstd 2025.04.02 03:21:02.795328 [ 3346 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:21:02.796029 [ 3346 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:21:02.796867 [ 3346 ] {} RaftInstance: snapshot idx 5 log_term 5 created, compact the log store if needed 2025.04.02 03:21:02.798777 [ 3346 ] {} RaftInstance: create snapshot idx 5 log_term 5 done: 9209 us elapsed 2025.04.02 03:21:02.799979 [ 3956 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:21:02.801622 [ 3963 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:21:02.801844 [ 3960 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:02.801982 [ 3961 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:02.802125 [ 3966 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:21:02.802217 [ 3964 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:02.802320 [ 3967 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:21:02.802437 [ 3969 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:21:02.802592 [ 3965 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:21:02.802745 [ 3962 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:21:02.802860 [ 3955 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:02.802946 [ 3959 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:02.803050 [ 3970 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:02.803409 [ 3958 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:02.803291 [ 3968 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:02.803154 [ 3957 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:02.803461 [ 3956 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:02.807693 [ 3346 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:02.808492 [ 3954 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:21:02.811556 [ 3346 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:21:02.812746 [ 3346 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:21:02.813294 [ 3346 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:21:02.814948 [ 3346 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:21:02.815877 [ 3346 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:02.817426 [ 3346 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:02.817990 [ 3346 ] {} Context: Destructing threadpool writer 2025.04.02 03:21:02.861444 [ 3346 ] {} Application: Destroyed global context. 2025.04.02 03:21:02.863198 [ 3346 ] {} Application: Waiting for background threads 2025.04.02 03:21:02.960473 [ 3346 ] {} Application: Background threads finished in 97 ms 2025.04.02 03:21:02.964587 [ 3346 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:21:02.965294 [ 3346 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:02.994352 [ 3346 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:02.995374 [ 3346 ] {} Application: shutting down 2025.04.02 03:21:02.995979 [ 3346 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:21:02.997820 [ 3347 ] {} BaseDaemon: Received signal -2 2025.04.02 03:21:02.998760 [ 3347 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:21:03.108340 [ 3345 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:21:03.727172 [ 4087 ] {} Application: Will watch for the process with pid 4088 2025.04.02 03:21:03.727257 [ 4088 ] {} Application: Forked a child process to watch 2025.04.02 03:21:03.727741 [ 4088 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:21:03.818726 [ 4088 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 4088 2025.04.02 03:21:03.819254 [ 4088 ] {} Application: starting up 2025.04.02 03:21:03.819273 [ 4088 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:21:03.828378 [ 4088 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:21:03.830153 [ 4088 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:21:03.831869 [ 4088 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:21:03.832964 [ 4088 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:21:03.834253 [ 4088 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:21:03.835237 [ 4088 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:21:03.841068 [ 4088 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:21:03.842865 [ 4088 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:21:03.843738 [ 4088 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:21:03.844873 [ 4088 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:21:03.845859 [ 4088 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:21:05.253274 [ 4088 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:21:05.255738 [ 4088 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:21:05.313418 [ 4088 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:21:05.318448 [ 4088 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:21:05.320814 [ 4088 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:21:05.870218 [ 4101 ] {} CancellationChecker: Started worker function 2025.04.02 03:21:05.871183 [ 4088 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:21:05.871838 [ 4088 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:21:05.885312 [ 4088 ] {} Application: Initializing DateLUT. 2025.04.02 03:21:05.886021 [ 4088 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:21:05.887598 [ 4088 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:21:05.890369 [ 4088 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:21:05.895743 [ 4088 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:21:05.896656 [ 4088 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:21:05.897611 [ 4088 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:21:05.900160 [ 4088 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:21:05.901396 [ 4088 ] {} Application: Initializing interserver credentials. 2025.04.02 03:21:05.909097 [ 4088 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:21:05.967354 [ 4088 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:21:06.014785 [ 4088 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:21:06.022208 [ 4088 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:21:06.022882 [ 4088 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:21:06.025530 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:21:06.027045 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:21:06.028434 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:21:06.029729 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:21:06.031126 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:21:06.056096 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:21:06.073376 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:21:06.090635 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:21:06.134044 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:21:06.149396 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:21:06.181314 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:21:06.213464 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:21:06.222138 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:21:06.226945 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:21:06.242633 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:21:06.273813 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:21:06.275489 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:21:06.277123 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:21:06.305940 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:21:06.337373 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:21:06.339067 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:21:06.369831 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:21:06.389565 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:21:06.405245 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:21:06.407122 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:21:06.424038 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:21:06.470809 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:21:06.472960 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:21:06.474732 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:21:06.476485 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:21:06.510127 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:21:06.512166 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:21:06.513935 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:21:06.519522 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:21:06.521422 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:21:06.523215 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:21:06.524951 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:21:06.526844 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:21:06.528491 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:21:06.530417 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:21:06.532124 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:21:06.533739 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:21:06.535314 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:21:06.536756 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:21:06.538374 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:21:06.539903 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:21:06.541611 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:21:06.550731 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:21:06.553169 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:21:06.554884 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:21:06.556652 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:21:06.558195 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:21:06.559563 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:21:06.560830 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:21:06.564696 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:21:06.566299 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:21:06.567237 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:21:06.568574 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:21:06.570073 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:21:06.571524 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:21:06.573003 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:21:06.574408 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:21:06.575703 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:21:06.577016 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:21:06.578331 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:21:06.580632 [ 4088 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:21:06.633914 [ 4088 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:21:06.639966 [ 4088 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:21:07.602250 [ 4088 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:21:07.602902 [ 4088 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:21:07.603627 [ 4088 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:21:08.424591 [ 4088 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:21:08.425301 [ 4088 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:21:08.427012 [ 4088 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:21:08.429343 [ 4088 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:08.436022 [ 4088 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:08.442474 [ 4088 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:08.601862 [ 4088 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:21:08.602950 [ 4088 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:08.609224 [ 4088 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:21:08.618072 [ 4088 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:08.620355 [ 4088 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:08.622700 [ 4088 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:21:08.623919 [ 4088 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:21:08.633803 [ 4088 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:21:08.634336 [ 4088 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:21:08.634987 [ 4088 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:21:08.635669 [ 4088 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:21:08.636263 [ 4088 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:21:08.637564 [ 4088 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:08.638499 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:08.761242 [ 4088 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:08.765643 [ 4088 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:08.777476 [ 4088 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:08.865875 [ 4088 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/evd/vbtkbmuenjcdptjwxdmbhecputybw 2025.04.02 03:21:08.874935 [ 4088 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/evd/vbtkbmuenjcdptjwxdmbhecputybw. 2025.04.02 03:21:09.035074 [ 4680 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/evd/vbtkbmuenjcdptjwxdmbhecputybw, size 4 2025.04.02 03:21:09.049969 [ 4088 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/evd/vbtkbmuenjcdptjwxdmbhecputybw. 2025.04.02 03:21:09.192110 [ 4088 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/evd/vbtkbmuenjcdptjwxdmbhecputybw 2025.04.02 03:21:09.192699 [ 4088 ] {} deleteFileFromS3: Object with path s3/evd/vbtkbmuenjcdptjwxdmbhecputybw was removed from S3 2025.04.02 03:21:09.193362 [ 4088 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:21:09.194071 [ 4088 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:21:09.218319 [ 4088 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:09.223232 [ 4088 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:09.223825 [ 4088 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:09.273644 [ 4088 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:21:09.274402 [ 4088 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:21:09 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BBC1EAD21C1 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:21:09.276324 [ 4088 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:21:09.287219 [ 4088 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:21:09.287811 [ 4088 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:21:09.288360 [ 4088 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:21:09.289223 [ 4088 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:21:09.290270 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.291253 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.292287 [ 4088 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:09.293294 [ 4088 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:09.294325 [ 4088 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:21:09.295334 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.296564 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.297768 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.298951 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.299978 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.319504 [ 4088 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:09.323824 [ 4088 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:09.324464 [ 4088 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:09.470931 [ 4088 ] {} deleteFileFromS3: No blob storage log, not writing blob special/eay/ileqchqckxhsovhylosmdmaljszce 2025.04.02 03:21:09.471709 [ 4088 ] {} deleteFileFromS3: Object with path special/eay/ileqchqckxhsovhylosmdmaljszce was removed from S3 2025.04.02 03:21:09.472190 [ 4088 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:21:09.473066 [ 4088 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:21:09.494559 [ 4088 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:09.498915 [ 4088 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:09.499659 [ 4088 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:09.541440 [ 4088 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/yyb/tjingzcekobiccfmzujuanwrdbgoz 2025.04.02 03:21:09.542182 [ 4088 ] {} deleteFileFromS3: Object with path test_02944/yyb/tjingzcekobiccfmzujuanwrdbgoz was removed from S3 2025.04.02 03:21:09.542697 [ 4088 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:21:09.543533 [ 4088 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:21:09.544506 [ 4088 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:09.570804 [ 4088 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:09.588690 [ 4088 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:21:09.589341 [ 4088 ] {} KeeperSnapshotManager: Found snapshot_5.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:09.589903 [ 4088 ] {} KeeperSnapshotManager: Found snapshot_3.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:09.590391 [ 4088 ] {} KeeperSnapshotManager: Found snapshot_4.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:09.600032 [ 4088 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:21:09.600655 [ 4088 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:21:09.602070 [ 4088 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:21:09.602697 [ 4088 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:21:09.603140 [ 4088 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:21:09.603654 [ 4088 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 5 2025.04.02 03:21:09.609913 [ 4088 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:21:09.611183 [ 4088 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 5 2025.04.02 03:21:09.613926 [ 4088 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 5 entries 2025.04.02 03:21:09.614795 [ 4088 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:21:09.615605 [ 4088 ] {} KeeperServer: Last local log idx 5 2025.04.02 03:21:09.616435 [ 4088 ] {} KeeperServer: Will use config from log store with log index 5 2025.04.02 03:21:09.624371 [ 4088 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:21:09.634002 [ 4088 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:21:09.646900 [ 4088 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:21:09.649054 [ 4088 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:21:09.649923 [ 4088 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:21:09.650862 [ 4088 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:21:09.652146 [ 4088 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:21:09.653715 [ 4088 ] {} RaftInstance: === INIT RAFT SERVER === commit index 5 term 5 election timer allowed log store start 1, end 5 config log idx 5, prev log idx 4 -- ASYNC REPLICATION -- 2025.04.02 03:21:09.654674 [ 4088 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:21:09.656041 [ 4088 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:21:09.656992 [ 4088 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:21:09.669586 [ 4690 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:21:09.711574 [ 4088 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:21:09.721414 [ 4696 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:21:09.728898 [ 4696 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:21:09.742329 [ 4696 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 5, state term 5, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:21:09.743026 [ 4696 ] {} RaftInstance: pre-vote term (0) is different, reset it to 5 2025.04.02 03:21:09.758578 [ 4696 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:21:09.777355 [ 4696 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 6, log idx 5, log term 5, priority (target 1 / mine 1) 2025.04.02 03:21:09.793970 [ 4696 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:21:09.797426 [ 4696 ] {} RaftInstance: state machine commit index 5, precommit index 5, last log index 5 2025.04.02 03:21:09.844460 [ 4696 ] {} RaftInstance: [BECOME LEADER] appended new config at 6 2025.04.02 03:21:09.871965 [ 4710 ] {} RaftInstance: config at index 6 is committed, prev config log idx 5 2025.04.02 03:21:09.873348 [ 4710 ] {} RaftInstance: new config log idx 6, prev log idx 5, cur config log idx 5, prev log idx 4 2025.04.02 03:21:09.885610 [ 4710 ] {} RaftInstance: new configuration: log idx 6, prev log idx 5 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 6 2025.04.02 03:21:09.917621 [ 4088 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:21:09.919088 [ 4088 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:21:09.946274 [ 4088 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:21:09.947219 [ 4088 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:21:09.964602 [ 4088 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:21:09.965290 [ 4088 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:21:09.967036 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:21:09.968224 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:21:09.969032 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:21:10.047677 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:21:10.049311 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:21:10.051029 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:21:10.052593 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:21:10.054154 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:21:10.055710 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:21:10.056922 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:21:10.058261 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:21:10.059480 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:21:10.060670 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:21:10.061991 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:21:10.063212 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:21:10.064476 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:21:10.065654 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:21:10.067024 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:21:10.068272 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:21:10.069615 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:21:10.070735 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:21:10.071863 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:21:10.073251 [ 4088 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:21:10.079158 [ 4088 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:21:10.079997 [ 4088 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:21:10.902436 [ 4088 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:21:10.903470 [ 4088 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:10.954496 [ 4088 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:21:10.957888 [ 4088 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:21:10.964199 [ 4088 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:21:10.964723 [ 4723 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:21:11.095650 [ 4088 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:21:11.159201 [ 4088 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:21:11.172586 [ 4088 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:21:11.177948 [ 4088 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:21:11.185569 [ 4088 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:21:11.191120 [ 4088 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:21:11.207654 [ 4088 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:21:11.208750 [ 4088 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:21:11.208911 [ 4096 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:21:11.216565 [ 4096 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:21:15.753888 [ 4088 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:15.754956 [ 4088 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:21:15.758755 [ 4088 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:21:15.759410 [ 4088 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:21:15.760388 [ 4101 ] {} CancellationChecker: Execution took 9890 ms. 2025.04.02 03:21:15.853007 [ 4088 ] {} Application: Shutting down storages. 2025.04.02 03:21:15.853728 [ 4088 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:21:15.861038 [ 4088 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:21:15.861884 [ 4088 ] {} Context: Shutting down workload entity storage 2025.04.02 03:21:15.862721 [ 4088 ] {} Context: Shutting down named sessions 2025.04.02 03:21:15.864430 [ 4088 ] {} Context: Shutting down database catalog 2025.04.02 03:21:15.865348 [ 4088 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:21:15.866700 [ 4088 ] {} Context: Shutting down merges executor 2025.04.02 03:21:15.869648 [ 4088 ] {} Context: Shutting down fetches executor 2025.04.02 03:21:15.877776 [ 4088 ] {} Context: Shutting down moves executor 2025.04.02 03:21:15.879723 [ 4088 ] {} Context: Shutting down common executor 2025.04.02 03:21:15.882021 [ 4088 ] {} Context: Shutting down DDLWorker 2025.04.02 03:21:15.882856 [ 4088 ] {} Context: Shutting down caches 2025.04.02 03:21:15.884231 [ 4088 ] {} Context: Shutting down AccessControl 2025.04.02 03:21:15.888919 [ 4088 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:21:15.902604 [ 4088 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:21:16.058942 [ 4088 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:21:16.064188 [ 4088 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:21:16.086075 [ 4088 ] {} Application: Shut down storages. 2025.04.02 03:21:16.086804 [ 4088 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:21:16.456849 [ 4088 ] {} Application: Closed all listening sockets. 2025.04.02 03:21:16.458077 [ 4088 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:21:16.459979 [ 4088 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:21:16.977820 [ 4088 ] {} RaftInstance: shutting down raft core 2025.04.02 03:21:16.993893 [ 4088 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:21:16.994782 [ 4088 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:21:17.010263 [ 4088 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:21:17.014731 [ 4088 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:21:17.015907 [ 4088 ] {} RaftInstance: reset all pointers. 2025.04.02 03:21:17.029422 [ 4088 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:21:17.036150 [ 4690 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:21:17.036330 [ 4088 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:21:17.037707 [ 4088 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:21:17.069353 [ 4088 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:21:17.085927 [ 4088 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:21:17.087271 [ 4088 ] {} RaftInstance: manually create a snapshot on 6 2025.04.02 03:21:17.106019 [ 4088 ] {} RaftInstance: creating a snapshot for index 6 2025.04.02 03:21:17.122571 [ 4088 ] {} RaftInstance: create snapshot idx 6 log_term 6 2025.04.02 03:21:17.138291 [ 4088 ] {} KeeperStateMachine: Creating snapshot 6 2025.04.02 03:21:17.139568 [ 4088 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:21:17.169417 [ 4088 ] {} KeeperStateMachine: Created persistent snapshot 6 with path snapshot_6.bin.zstd 2025.04.02 03:21:17.173257 [ 4088 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:21:17.174371 [ 4088 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:21:17.189744 [ 4088 ] {} RaftInstance: snapshot idx 6 log_term 6 created, compact the log store if needed 2025.04.02 03:21:17.205695 [ 4088 ] {} RaftInstance: create snapshot idx 6 log_term 6 done: 54492 us elapsed 2025.04.02 03:21:17.222458 [ 4695 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:21:17.222284 [ 4697 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:21:17.222677 [ 4702 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:21:17.222899 [ 4705 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:21:17.222871 [ 4704 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:21:17.223129 [ 4707 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:21:17.223298 [ 4703 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:21:17.223493 [ 4706 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:21:17.223612 [ 4694 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.223450 [ 4700 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:21:17.223816 [ 4696 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.223997 [ 4709 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.224072 [ 4698 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.224185 [ 4701 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.224343 [ 4699 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.224394 [ 4708 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:17.225083 [ 4697 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:17.228383 [ 4088 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:17.229139 [ 4693 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:21:17.253578 [ 4088 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:21:17.255116 [ 4088 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:21:17.255739 [ 4088 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:21:17.257502 [ 4088 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:21:17.258613 [ 4088 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:17.260525 [ 4088 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:17.261150 [ 4088 ] {} Context: Destructing threadpool writer 2025.04.02 03:21:17.328621 [ 4088 ] {} Application: Destroyed global context. 2025.04.02 03:21:17.330782 [ 4088 ] {} Application: Waiting for background threads 2025.04.02 03:21:17.446880 [ 4088 ] {} Application: Background threads finished in 115 ms 2025.04.02 03:21:17.451247 [ 4088 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:21:17.451844 [ 4088 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:17.583044 [ 4088 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:17.584251 [ 4088 ] {} Application: shutting down 2025.04.02 03:21:17.585179 [ 4088 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:21:17.587395 [ 4089 ] {} BaseDaemon: Received signal -2 2025.04.02 03:21:17.588428 [ 4089 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:21:17.715379 [ 4087 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:21:18.217734 [ 4829 ] {} Application: Will watch for the process with pid 4830 2025.04.02 03:21:18.217948 [ 4830 ] {} Application: Forked a child process to watch 2025.04.02 03:21:18.218808 [ 4830 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:21:18.326699 [ 4830 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 4830 2025.04.02 03:21:18.327274 [ 4830 ] {} Application: starting up 2025.04.02 03:21:18.327294 [ 4830 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:21:18.336376 [ 4830 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:21:18.337873 [ 4830 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:21:18.339572 [ 4830 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:21:18.340341 [ 4830 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:21:18.341232 [ 4830 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:21:18.342565 [ 4830 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:21:18.348060 [ 4830 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:21:18.349452 [ 4830 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:21:18.350054 [ 4830 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:21:18.350914 [ 4830 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:21:18.351508 [ 4830 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:21:19.600640 [ 4830 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:21:19.603595 [ 4830 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:21:19.662943 [ 4830 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:21:19.664879 [ 4830 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:21:19.667276 [ 4830 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:21:20.204613 [ 4838 ] {} CancellationChecker: Started worker function 2025.04.02 03:21:20.205654 [ 4830 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:21:20.206258 [ 4830 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:21:20.207774 [ 4830 ] {} Application: Initializing DateLUT. 2025.04.02 03:21:20.208436 [ 4830 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:21:20.252697 [ 4830 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:21:20.255476 [ 4830 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:21:20.308808 [ 4830 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:21:20.309879 [ 4830 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:21:20.310892 [ 4830 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:21:20.313471 [ 4830 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:21:20.314720 [ 4830 ] {} Application: Initializing interserver credentials. 2025.04.02 03:21:20.329734 [ 4830 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:21:20.393147 [ 4830 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:21:20.395442 [ 4830 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:21:20.402473 [ 4830 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:21:20.403284 [ 4830 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:21:20.407213 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:21:20.408987 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:21:20.410640 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:21:20.411966 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:21:20.413219 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:21:20.416273 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:21:20.417623 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:21:20.418916 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:21:20.420255 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:21:20.421483 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:21:20.422873 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:21:20.424248 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:21:20.425516 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:21:20.426940 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:21:20.428264 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:21:20.429674 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:21:20.430914 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:21:20.432110 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:21:20.433294 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:21:20.434470 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:21:20.435764 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:21:20.436746 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:21:20.438186 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:21:20.440069 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:21:20.441443 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:21:20.442422 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:21:20.444013 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:21:20.445320 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:21:20.446580 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:21:20.447746 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:21:20.448848 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:21:20.450036 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:21:20.451499 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:21:20.452716 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:21:20.454159 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:21:20.455527 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:21:20.456989 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:21:20.458298 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:21:20.459608 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:21:20.464381 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:21:20.466016 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:21:20.467405 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:21:20.468772 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:21:20.470146 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:21:20.471652 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:21:20.472921 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:21:20.474476 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:21:20.475769 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:21:20.478182 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:21:20.479886 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:21:20.481593 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:21:20.483137 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:21:20.484381 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:21:20.485712 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:21:20.487348 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:21:20.488691 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:21:20.489639 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:21:20.491000 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:21:20.492415 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:21:20.493736 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:21:20.495239 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:21:20.496609 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:21:20.498092 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:21:20.499571 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:21:20.501032 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:21:20.503451 [ 4830 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:21:20.618304 [ 4830 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:21:20.641482 [ 4830 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:21:21.279779 [ 4830 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:21:21.280454 [ 4830 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:21:21.281235 [ 4830 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:21:21.943806 [ 4830 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:21:21.944481 [ 4830 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:21:21.946294 [ 4830 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:21:21.948316 [ 4830 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:21.954905 [ 4830 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:21.961602 [ 4830 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:22.125710 [ 4830 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:21:22.126784 [ 4830 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:22.132185 [ 4830 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:21:22.158618 [ 4830 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:22.161009 [ 4830 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:22.163268 [ 4830 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:21:22.164507 [ 4830 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:21:22.185159 [ 4830 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:21:22.185789 [ 4830 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:21:22.186546 [ 4830 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:21:22.187297 [ 4830 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:21:22.191825 [ 4830 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:21:22.198526 [ 4830 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:22.202121 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.458380 [ 4830 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:22.468907 [ 4830 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:22.477591 [ 4830 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:22.614747 [ 4830 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/rpu/hjsndoefsyhjdqvcfuutjogenyjmz 2025.04.02 03:21:22.630527 [ 4830 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/rpu/hjsndoefsyhjdqvcfuutjogenyjmz. 2025.04.02 03:21:22.707651 [ 5420 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/rpu/hjsndoefsyhjdqvcfuutjogenyjmz, size 4 2025.04.02 03:21:22.709286 [ 4830 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/rpu/hjsndoefsyhjdqvcfuutjogenyjmz. 2025.04.02 03:21:22.744615 [ 4830 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/rpu/hjsndoefsyhjdqvcfuutjogenyjmz 2025.04.02 03:21:22.745402 [ 4830 ] {} deleteFileFromS3: Object with path s3/rpu/hjsndoefsyhjdqvcfuutjogenyjmz was removed from S3 2025.04.02 03:21:22.746029 [ 4830 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:21:22.746914 [ 4830 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:21:22.771713 [ 4830 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:22.845554 [ 4830 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:22.846422 [ 4830 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:22.895622 [ 4830 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:21:22.896586 [ 4830 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:21:22 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BBF4AA2349A x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:21:22.898581 [ 4830 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:21:22.910433 [ 4830 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:21:22.911069 [ 4830 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:21:22.911754 [ 4830 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:21:22.912508 [ 4830 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:21:22.913538 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.914673 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.915744 [ 4830 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:22.916737 [ 4830 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:22.918041 [ 4830 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:21:22.919253 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.920477 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.921572 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.922538 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.923743 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:22.946127 [ 4830 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:22.950314 [ 4830 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:22.950907 [ 4830 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:23.002303 [ 4830 ] {} deleteFileFromS3: No blob storage log, not writing blob special/rrb/wdqmnjirxipeswddjeerlcxjttqsk 2025.04.02 03:21:23.002935 [ 4830 ] {} deleteFileFromS3: Object with path special/rrb/wdqmnjirxipeswddjeerlcxjttqsk was removed from S3 2025.04.02 03:21:23.003625 [ 4830 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:21:23.004542 [ 4830 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:21:23.025801 [ 4830 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:23.029810 [ 4830 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:23.030478 [ 4830 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:23.074811 [ 4830 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/fyz/hatadouxsavcdkutqutuezlakzfrd 2025.04.02 03:21:23.075560 [ 4830 ] {} deleteFileFromS3: Object with path test_02944/fyz/hatadouxsavcdkutqutuezlakzfrd was removed from S3 2025.04.02 03:21:23.076245 [ 4830 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:21:23.077062 [ 4830 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:21:23.078079 [ 4830 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:23.104421 [ 4830 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:23.124096 [ 4830 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:21:23.124736 [ 4830 ] {} KeeperSnapshotManager: Found snapshot_5.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:23.125328 [ 4830 ] {} KeeperSnapshotManager: Found snapshot_6.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:23.125910 [ 4830 ] {} KeeperSnapshotManager: Found snapshot_4.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:23.136109 [ 4830 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:21:23.136779 [ 4830 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:21:23.138298 [ 4830 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:21:23.138985 [ 4830 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:21:23.139551 [ 4830 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:21:23.140106 [ 4830 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 6 2025.04.02 03:21:23.146902 [ 4830 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:21:23.148104 [ 4830 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 6 2025.04.02 03:21:23.150717 [ 4830 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 6 entries 2025.04.02 03:21:23.151693 [ 4830 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:21:23.152621 [ 4830 ] {} KeeperServer: Last local log idx 6 2025.04.02 03:21:23.192243 [ 4830 ] {} KeeperServer: Will use config from log store with log index 6 2025.04.02 03:21:23.211307 [ 4830 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:21:23.323469 [ 4830 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:21:23.326908 [ 4830 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:21:23.337880 [ 4830 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:21:23.357539 [ 4830 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:21:23.364108 [ 4830 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:21:23.377942 [ 4830 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:21:23.390302 [ 4830 ] {} RaftInstance: === INIT RAFT SERVER === commit index 6 term 6 election timer allowed log store start 1, end 6 config log idx 6, prev log idx 5 -- ASYNC REPLICATION -- 2025.04.02 03:21:23.401369 [ 4830 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:21:23.457511 [ 4830 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:21:23.459307 [ 4830 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:21:23.469309 [ 5451 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:21:23.515063 [ 5433 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:21:23.515792 [ 4830 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:21:23.516120 [ 5433 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:21:23.518135 [ 5433 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 6, state term 6, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:21:23.518905 [ 5433 ] {} RaftInstance: pre-vote term (0) is different, reset it to 6 2025.04.02 03:21:23.520271 [ 5433 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:21:23.553266 [ 5433 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 7, log idx 6, log term 6, priority (target 1 / mine 1) 2025.04.02 03:21:23.561972 [ 5433 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:21:23.567411 [ 5433 ] {} RaftInstance: state machine commit index 6, precommit index 6, last log index 6 2025.04.02 03:21:23.571172 [ 5433 ] {} RaftInstance: [BECOME LEADER] appended new config at 7 2025.04.02 03:21:23.575574 [ 5450 ] {} RaftInstance: config at index 7 is committed, prev config log idx 6 2025.04.02 03:21:23.576657 [ 5450 ] {} RaftInstance: new config log idx 7, prev log idx 6, cur config log idx 6, prev log idx 5 2025.04.02 03:21:23.577832 [ 5450 ] {} RaftInstance: new configuration: log idx 7, prev log idx 6 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 7 2025.04.02 03:21:23.581295 [ 4830 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:21:23.586537 [ 4830 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:21:23.594539 [ 4830 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:21:23.595466 [ 4830 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:21:23.614784 [ 4830 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:21:23.615365 [ 4830 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:21:23.617011 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:21:23.618155 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:21:23.619075 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:21:23.620167 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:21:23.621313 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:21:23.622600 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:21:23.623913 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:21:23.624935 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:21:23.626905 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:21:23.628124 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:21:23.629344 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:21:23.630607 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:21:23.631641 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:21:23.632765 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:21:23.633989 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:21:23.635224 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:21:23.636372 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:21:23.637540 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:21:23.638696 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:21:23.639855 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:21:23.640968 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:21:23.642239 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:21:23.643555 [ 4830 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:21:23.730042 [ 4830 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:21:23.731211 [ 4830 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:21:24.502380 [ 4830 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:21:24.503464 [ 4830 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:24.565927 [ 4830 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:21:24.569036 [ 4830 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:21:24.574884 [ 4830 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:21:24.575369 [ 5461 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:21:24.639671 [ 4830 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:21:24.646147 [ 4830 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:21:24.656729 [ 4830 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:21:24.748762 [ 4830 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:21:24.767457 [ 4830 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:21:24.773225 [ 4830 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:21:24.782773 [ 4830 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:21:24.784030 [ 4830 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:21:24.784110 [ 4839 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:21:24.791357 [ 4839 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:21:29.104093 [ 4830 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:29.105940 [ 4830 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:21:29.120828 [ 4830 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:21:29.121826 [ 4830 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:21:29.122710 [ 4838 ] {} CancellationChecker: Execution took 8918 ms. 2025.04.02 03:21:29.124120 [ 4830 ] {} Application: Shutting down storages. 2025.04.02 03:21:29.131534 [ 4830 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:21:29.159121 [ 4830 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:21:29.159918 [ 4830 ] {} Context: Shutting down workload entity storage 2025.04.02 03:21:29.160579 [ 4830 ] {} Context: Shutting down named sessions 2025.04.02 03:21:29.162334 [ 4830 ] {} Context: Shutting down database catalog 2025.04.02 03:21:29.163201 [ 4830 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:21:29.164675 [ 4830 ] {} Context: Shutting down merges executor 2025.04.02 03:21:29.167498 [ 4830 ] {} Context: Shutting down fetches executor 2025.04.02 03:21:29.176527 [ 4830 ] {} Context: Shutting down moves executor 2025.04.02 03:21:29.197951 [ 4830 ] {} Context: Shutting down common executor 2025.04.02 03:21:29.200142 [ 4830 ] {} Context: Shutting down DDLWorker 2025.04.02 03:21:29.200795 [ 4830 ] {} Context: Shutting down caches 2025.04.02 03:21:29.202075 [ 4830 ] {} Context: Shutting down AccessControl 2025.04.02 03:21:29.206109 [ 4830 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:21:29.212598 [ 4830 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:21:29.402037 [ 4830 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:21:29.407230 [ 4830 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:21:29.421854 [ 4830 ] {} Application: Shut down storages. 2025.04.02 03:21:29.422438 [ 4830 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:21:29.854975 [ 4830 ] {} Application: Closed all listening sockets. 2025.04.02 03:21:29.856125 [ 4830 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:21:29.877433 [ 4830 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:21:30.093352 [ 4830 ] {} RaftInstance: shutting down raft core 2025.04.02 03:21:30.095533 [ 4830 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:21:30.096493 [ 4830 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:21:30.097415 [ 4830 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:21:30.098890 [ 4830 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:21:30.100177 [ 4830 ] {} RaftInstance: reset all pointers. 2025.04.02 03:21:30.101403 [ 4830 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:21:30.102629 [ 5451 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:21:30.102892 [ 4830 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:21:30.113685 [ 4830 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:21:30.114828 [ 4830 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:21:30.116207 [ 4830 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:21:30.117181 [ 4830 ] {} RaftInstance: manually create a snapshot on 7 2025.04.02 03:21:30.119717 [ 4830 ] {} RaftInstance: creating a snapshot for index 7 2025.04.02 03:21:30.121043 [ 4830 ] {} RaftInstance: create snapshot idx 7 log_term 7 2025.04.02 03:21:30.122426 [ 4830 ] {} KeeperStateMachine: Creating snapshot 7 2025.04.02 03:21:30.123836 [ 4830 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:21:30.128011 [ 4830 ] {} KeeperStateMachine: Created persistent snapshot 7 with path snapshot_7.bin.zstd 2025.04.02 03:21:30.129309 [ 4830 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:21:30.130130 [ 4830 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:21:30.131174 [ 4830 ] {} RaftInstance: snapshot idx 7 log_term 7 created, compact the log store if needed 2025.04.02 03:21:30.133556 [ 4830 ] {} RaftInstance: create snapshot idx 7 log_term 7 done: 11207 us elapsed 2025.04.02 03:21:30.135415 [ 5434 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:21:30.137752 [ 5435 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:21:30.137801 [ 5437 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:30.138005 [ 5439 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:30.138284 [ 5442 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:21:30.138148 [ 5441 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 03:21:30.138357 [ 5446 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:21:30.138453 [ 5443 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:21:30.138879 [ 5434 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:30.138521 [ 5447 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 03:21:30.139191 [ 5436 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:30.139353 [ 5438 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:30.138914 [ 5440 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:30.139270 [ 5432 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:30.139014 [ 5433 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:30.139505 [ 5444 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:30.139658 [ 5445 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:30.144591 [ 4830 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:30.145346 [ 5430 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:21:30.149177 [ 4830 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:21:30.150499 [ 4830 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:21:30.151107 [ 4830 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:21:30.152898 [ 4830 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:21:30.154296 [ 4830 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:30.156302 [ 4830 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:30.156955 [ 4830 ] {} Context: Destructing threadpool writer 2025.04.02 03:21:30.195031 [ 4830 ] {} Application: Destroyed global context. 2025.04.02 03:21:30.196886 [ 4830 ] {} Application: Waiting for background threads 2025.04.02 03:21:30.260287 [ 4830 ] {} Application: Background threads finished in 63 ms 2025.04.02 03:21:30.263723 [ 4830 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:21:30.264208 [ 4830 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:30.342974 [ 4830 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:30.343855 [ 4830 ] {} Application: shutting down 2025.04.02 03:21:30.344444 [ 4830 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:21:30.361567 [ 4831 ] {} BaseDaemon: Received signal -2 2025.04.02 03:21:30.362403 [ 4831 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:21:30.545975 [ 4829 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:21:31.022077 [ 5563 ] {} Application: Will watch for the process with pid 5564 2025.04.02 03:21:31.022150 [ 5564 ] {} Application: Forked a child process to watch 2025.04.02 03:21:31.022565 [ 5564 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:21:31.119055 [ 5564 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 5564 2025.04.02 03:21:31.119581 [ 5564 ] {} Application: starting up 2025.04.02 03:21:31.119600 [ 5564 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:21:31.128646 [ 5564 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:21:31.130134 [ 5564 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:21:31.131867 [ 5564 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:21:31.132707 [ 5564 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:21:31.133853 [ 5564 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:21:31.135040 [ 5564 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:21:31.139788 [ 5564 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:21:31.141045 [ 5564 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:21:31.141655 [ 5564 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:21:31.142501 [ 5564 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:21:31.143217 [ 5564 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:21:32.363127 [ 5564 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:21:32.365551 [ 5564 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:21:32.425503 [ 5564 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:21:32.427043 [ 5564 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:21:32.429117 [ 5564 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:21:32.973648 [ 5572 ] {} CancellationChecker: Started worker function 2025.04.02 03:21:32.974735 [ 5564 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:21:32.975363 [ 5564 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:21:32.976935 [ 5564 ] {} Application: Initializing DateLUT. 2025.04.02 03:21:32.977478 [ 5564 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:21:32.978887 [ 5564 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:21:32.981455 [ 5564 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:21:32.987239 [ 5564 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:21:32.988213 [ 5564 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:21:32.989030 [ 5564 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:21:32.991367 [ 5564 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:21:32.992386 [ 5564 ] {} Application: Initializing interserver credentials. 2025.04.02 03:21:33.000043 [ 5564 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:21:33.042978 [ 5564 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:21:33.045060 [ 5564 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:21:33.051672 [ 5564 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:21:33.052098 [ 5564 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:21:33.056188 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:21:33.057856 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:21:33.059118 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:21:33.060384 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:21:33.061665 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:21:33.064703 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:21:33.065925 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:21:33.067215 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:21:33.068481 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:21:33.069714 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:21:33.070996 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:21:33.072133 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:21:33.073406 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:21:33.074543 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:21:33.075851 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:21:33.076905 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:21:33.078086 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:21:33.079635 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:21:33.080991 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:21:33.082267 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:21:33.083390 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:21:33.084419 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:21:33.085863 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:21:33.087493 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:21:33.088830 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:21:33.089897 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:21:33.091422 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:21:33.092514 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:21:33.093706 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:21:33.094913 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:21:33.096209 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:21:33.097505 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:21:33.098757 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:21:33.099895 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:21:33.101174 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:21:33.102442 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:21:33.103707 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:21:33.104930 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:21:33.106184 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:21:33.107833 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:21:33.109101 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:21:33.110319 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:21:33.111743 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:21:33.121537 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:21:33.122894 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:21:33.124244 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:21:33.125378 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:21:33.126776 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:21:33.128770 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:21:33.130242 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:21:33.131847 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:21:33.133165 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:21:33.134362 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:21:33.135649 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:21:33.137117 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:21:33.138402 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:21:33.139425 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:21:33.140733 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:21:33.142042 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:21:33.143140 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:21:33.144537 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:21:33.145808 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:21:33.147215 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:21:33.148658 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:21:33.149818 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:21:33.151653 [ 5564 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:21:33.241065 [ 5564 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:21:33.246482 [ 5564 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:21:33.976419 [ 5564 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:21:33.977112 [ 5564 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:21:33.977831 [ 5564 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:21:34.717384 [ 5564 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:21:34.718053 [ 5564 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:21:34.719661 [ 5564 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:21:34.721638 [ 5564 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:34.727782 [ 5564 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:34.741830 [ 5564 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:34.905498 [ 5564 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:21:34.906468 [ 5564 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:34.920961 [ 5564 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:21:34.964096 [ 5564 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:34.966156 [ 5564 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:34.968165 [ 5564 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:21:34.969221 [ 5564 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:21:34.979499 [ 5564 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:21:34.980064 [ 5564 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:21:34.980590 [ 5564 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:21:34.981283 [ 5564 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:21:34.981953 [ 5564 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:21:34.983160 [ 5564 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:34.984094 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.043863 [ 5564 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:35.047004 [ 5564 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:35.047730 [ 5564 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:35.108978 [ 5564 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/jus/nrrsjneibajmfvyopfdbdegyqrwfv 2025.04.02 03:21:35.110685 [ 5564 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/jus/nrrsjneibajmfvyopfdbdegyqrwfv. 2025.04.02 03:21:35.127647 [ 6151 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/jus/nrrsjneibajmfvyopfdbdegyqrwfv, size 4 2025.04.02 03:21:35.129236 [ 5564 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/jus/nrrsjneibajmfvyopfdbdegyqrwfv. 2025.04.02 03:21:35.213330 [ 5564 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/jus/nrrsjneibajmfvyopfdbdegyqrwfv 2025.04.02 03:21:35.214073 [ 5564 ] {} deleteFileFromS3: Object with path s3/jus/nrrsjneibajmfvyopfdbdegyqrwfv was removed from S3 2025.04.02 03:21:35.229632 [ 5564 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:21:35.261783 [ 5564 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:21:35.453432 [ 5564 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:35.505383 [ 5564 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:35.510247 [ 5564 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:35.598721 [ 5564 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:21:35.599810 [ 5564 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:21:35 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BC23FCD5C1F x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:21:35.601960 [ 5564 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:21:35.612781 [ 5564 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:21:35.613457 [ 5564 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:21:35.614001 [ 5564 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:21:35.614666 [ 5564 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:21:35.615628 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.616662 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.671079 [ 5564 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:35.672310 [ 5564 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:35.772514 [ 5564 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:21:35.774300 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.776303 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.778106 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.779519 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.780978 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:35.849581 [ 5564 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:35.854093 [ 5564 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:35.854829 [ 5564 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:35.902616 [ 5564 ] {} deleteFileFromS3: No blob storage log, not writing blob special/lls/xlhndxahjbfgjodjqliieucswpnyt 2025.04.02 03:21:35.903008 [ 5564 ] {} deleteFileFromS3: Object with path special/lls/xlhndxahjbfgjodjqliieucswpnyt was removed from S3 2025.04.02 03:21:35.903613 [ 5564 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:21:35.904312 [ 5564 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:21:35.925162 [ 5564 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:35.928328 [ 5564 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:35.928976 [ 5564 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:35.971131 [ 5564 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/ost/anppkszetmigzwfhbjtocnzqygnbo 2025.04.02 03:21:35.973215 [ 5564 ] {} deleteFileFromS3: Object with path test_02944/ost/anppkszetmigzwfhbjtocnzqygnbo was removed from S3 2025.04.02 03:21:35.973946 [ 5564 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:21:35.974754 [ 5564 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:21:35.975646 [ 5564 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:36.008561 [ 5564 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:36.225501 [ 5564 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:21:36.241369 [ 5564 ] {} KeeperSnapshotManager: Found snapshot_5.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:36.257545 [ 5564 ] {} KeeperSnapshotManager: Found snapshot_6.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:36.258548 [ 5564 ] {} KeeperSnapshotManager: Found snapshot_7.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:36.417934 [ 5564 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:21:36.418819 [ 5564 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:21:36.420788 [ 5564 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:21:36.421797 [ 5564 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:21:36.422515 [ 5564 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:21:36.423125 [ 5564 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 7 2025.04.02 03:21:36.430625 [ 5564 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:21:36.432025 [ 5564 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 7 2025.04.02 03:21:36.434985 [ 5564 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 7 entries 2025.04.02 03:21:36.435949 [ 5564 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:21:36.442852 [ 5564 ] {} KeeperServer: Last local log idx 7 2025.04.02 03:21:36.444188 [ 5564 ] {} KeeperServer: Will use config from log store with log index 7 2025.04.02 03:21:36.452958 [ 5564 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:21:36.463042 [ 5564 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:21:36.465974 [ 5564 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:21:36.467945 [ 5564 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:21:36.468558 [ 5564 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:21:36.469629 [ 5564 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:21:36.471009 [ 5564 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:21:36.472587 [ 5564 ] {} RaftInstance: === INIT RAFT SERVER === commit index 7 term 7 election timer allowed log store start 1, end 7 config log idx 7, prev log idx 6 -- ASYNC REPLICATION -- 2025.04.02 03:21:36.473477 [ 5564 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:21:36.474803 [ 5564 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:21:36.476047 [ 5564 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:21:36.476324 [ 6186 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:21:36.528536 [ 6171 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:21:36.529515 [ 6171 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:21:36.529658 [ 5564 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:21:36.530886 [ 6171 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 7, state term 7, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:21:36.531576 [ 6171 ] {} RaftInstance: pre-vote term (0) is different, reset it to 7 2025.04.02 03:21:36.532887 [ 6171 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:21:36.537684 [ 6171 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 8, log idx 7, log term 7, priority (target 1 / mine 1) 2025.04.02 03:21:36.538948 [ 6171 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:21:36.540463 [ 6171 ] {} RaftInstance: state machine commit index 7, precommit index 7, last log index 7 2025.04.02 03:21:36.544077 [ 6171 ] {} RaftInstance: [BECOME LEADER] appended new config at 8 2025.04.02 03:21:36.547967 [ 6185 ] {} RaftInstance: config at index 8 is committed, prev config log idx 7 2025.04.02 03:21:36.549030 [ 6185 ] {} RaftInstance: new config log idx 8, prev log idx 7, cur config log idx 7, prev log idx 6 2025.04.02 03:21:36.549878 [ 6185 ] {} RaftInstance: new configuration: log idx 8, prev log idx 7 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 8 2025.04.02 03:21:36.553018 [ 5564 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:21:36.554070 [ 5564 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:21:36.569461 [ 5564 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:21:36.570187 [ 5564 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:21:36.581869 [ 5564 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:21:36.582642 [ 5564 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:21:36.584196 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:21:36.585338 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:21:36.586233 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:21:36.587483 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:21:36.588584 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:21:36.589674 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:21:36.590877 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:21:36.592047 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:21:36.594027 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:21:36.595233 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:21:36.596427 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:21:36.597819 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:21:36.599220 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:21:36.600361 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:21:36.601522 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:21:36.602863 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:21:36.604035 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:21:36.605265 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:21:36.606442 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:21:36.607658 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:21:36.608887 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:21:36.610106 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:21:36.611707 [ 5564 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:21:36.705467 [ 5564 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:21:36.706325 [ 5564 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:21:37.535648 [ 5564 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:21:37.536776 [ 5564 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:37.538889 [ 5564 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:21:37.541771 [ 5564 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:21:37.547837 [ 5564 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:21:37.548454 [ 6195 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:21:37.605365 [ 5564 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:21:37.610906 [ 5564 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:21:37.621143 [ 5564 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:21:37.627274 [ 5564 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:21:37.635497 [ 5564 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:21:37.641504 [ 5564 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:21:37.650710 [ 5564 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:21:37.652000 [ 5564 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:21:37.652022 [ 5573 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:21:37.669548 [ 5573 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:21:41.950517 [ 5564 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:41.951891 [ 5564 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:21:41.956677 [ 5564 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:21:41.957509 [ 5564 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:21:41.958659 [ 5572 ] {} CancellationChecker: Execution took 8985 ms. 2025.04.02 03:21:41.960406 [ 5564 ] {} Application: Shutting down storages. 2025.04.02 03:21:41.961064 [ 5564 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:21:41.982893 [ 5564 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:21:41.983559 [ 5564 ] {} Context: Shutting down workload entity storage 2025.04.02 03:21:41.997378 [ 5564 ] {} Context: Shutting down named sessions 2025.04.02 03:21:42.029666 [ 5564 ] {} Context: Shutting down database catalog 2025.04.02 03:21:42.045282 [ 5564 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:21:42.047032 [ 5564 ] {} Context: Shutting down merges executor 2025.04.02 03:21:42.064196 [ 5564 ] {} Context: Shutting down fetches executor 2025.04.02 03:21:42.093782 [ 5564 ] {} Context: Shutting down moves executor 2025.04.02 03:21:42.095948 [ 5564 ] {} Context: Shutting down common executor 2025.04.02 03:21:42.140518 [ 5564 ] {} Context: Shutting down DDLWorker 2025.04.02 03:21:42.141267 [ 5564 ] {} Context: Shutting down caches 2025.04.02 03:21:42.142836 [ 5564 ] {} Context: Shutting down AccessControl 2025.04.02 03:21:42.147453 [ 5564 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:21:42.245395 [ 5564 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:21:42.441653 [ 5564 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:21:42.447417 [ 5564 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:21:42.461921 [ 5564 ] {} Application: Shut down storages. 2025.04.02 03:21:42.462513 [ 5564 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:21:42.578665 [ 5564 ] {} Application: Closed all listening sockets. 2025.04.02 03:21:42.579435 [ 5564 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:21:42.580799 [ 5564 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:21:43.099904 [ 5564 ] {} RaftInstance: shutting down raft core 2025.04.02 03:21:43.115008 [ 5564 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:21:43.129645 [ 5564 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:21:43.145669 [ 5564 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:21:43.153423 [ 5564 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:21:43.154310 [ 5564 ] {} RaftInstance: reset all pointers. 2025.04.02 03:21:43.180044 [ 5564 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:21:43.181497 [ 6186 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:21:43.181685 [ 5564 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:21:43.183277 [ 5564 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:21:43.184388 [ 5564 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:21:43.185398 [ 5564 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:21:43.186243 [ 5564 ] {} RaftInstance: manually create a snapshot on 8 2025.04.02 03:21:43.188605 [ 5564 ] {} RaftInstance: creating a snapshot for index 8 2025.04.02 03:21:43.189638 [ 5564 ] {} RaftInstance: create snapshot idx 8 log_term 8 2025.04.02 03:21:43.191045 [ 5564 ] {} KeeperStateMachine: Creating snapshot 8 2025.04.02 03:21:43.192528 [ 5564 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:21:43.195761 [ 5564 ] {} KeeperStateMachine: Created persistent snapshot 8 with path snapshot_8.bin.zstd 2025.04.02 03:21:43.196658 [ 5564 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:21:43.197429 [ 5564 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:21:43.198466 [ 5564 ] {} RaftInstance: snapshot idx 8 log_term 8 created, compact the log store if needed 2025.04.02 03:21:43.200719 [ 5564 ] {} RaftInstance: create snapshot idx 8 log_term 8 done: 9826 us elapsed 2025.04.02 03:21:43.202630 [ 6172 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:21:43.204971 [ 6170 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:21:43.205329 [ 6174 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:21:43.205535 [ 6179 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 03:21:43.205696 [ 6175 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:21:43.205822 [ 6182 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:21:43.205939 [ 6183 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:43.206135 [ 6177 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.206251 [ 6176 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.205984 [ 6181 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:21:43.206384 [ 6180 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.206580 [ 6184 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 03:21:43.206487 [ 6178 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.206958 [ 6173 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.207032 [ 6172 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:43.206708 [ 6171 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.206835 [ 6169 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:43.211514 [ 5564 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:43.212105 [ 6168 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:21:43.215431 [ 5564 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:21:43.216561 [ 5564 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:21:43.217133 [ 5564 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:21:43.226448 [ 5564 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:21:43.227442 [ 5564 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:43.229090 [ 5564 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:43.229755 [ 5564 ] {} Context: Destructing threadpool writer 2025.04.02 03:21:43.263679 [ 5564 ] {} Application: Destroyed global context. 2025.04.02 03:21:43.265546 [ 5564 ] {} Application: Waiting for background threads 2025.04.02 03:21:43.382031 [ 5564 ] {} Application: Background threads finished in 116 ms 2025.04.02 03:21:43.385901 [ 5564 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:21:43.386413 [ 5564 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:43.483689 [ 5564 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:43.484789 [ 5564 ] {} Application: shutting down 2025.04.02 03:21:43.485413 [ 5564 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:21:43.487136 [ 5565 ] {} BaseDaemon: Received signal -2 2025.04.02 03:21:43.488119 [ 5565 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:21:43.595728 [ 5563 ] {} Application: Child process exited normally with code 233. 2025.04.02 03:21:44.152107 [ 6297 ] {} Application: Will watch for the process with pid 6298 2025.04.02 03:21:44.152298 [ 6298 ] {} Application: Forked a child process to watch 2025.04.02 03:21:44.153013 [ 6298 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 03:21:44.250816 [ 6298 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 6298 2025.04.02 03:21:44.251303 [ 6298 ] {} Application: starting up 2025.04.02 03:21:44.251323 [ 6298 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 03:21:44.260510 [ 6298 ] {} Context: ThreadFuzzer is enabled. Application will run slowly and unstable. 2025.04.02 03:21:44.262350 [ 6298 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 03:21:44.264381 [ 6298 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 03:21:44.265354 [ 6298 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 03:21:44.266586 [ 6298 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 03:21:44.267710 [ 6298 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 03:21:44.281654 [ 6298 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 03:21:44.283201 [ 6298 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 03:21:44.283958 [ 6298 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 03:21:44.284837 [ 6298 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 03:21:44.285739 [ 6298 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 03:21:46.255316 [ 6298 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 03:21:46.258049 [ 6298 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 03:21:46.317652 [ 6298 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 03:21:46.319186 [ 6298 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 03:21:46.321229 [ 6298 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 03:21:46.634002 [ 6310 ] {} CancellationChecker: Started worker function 2025.04.02 03:21:46.636419 [ 6298 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 03:21:46.639176 [ 6298 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 03:21:46.645009 [ 6298 ] {} Application: Initializing DateLUT. 2025.04.02 03:21:46.646469 [ 6298 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 03:21:46.665378 [ 6298 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 03:21:46.697570 [ 6298 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 03:21:46.729283 [ 6298 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 03:21:46.730649 [ 6298 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 03:21:46.754040 [ 6298 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 03:21:46.770432 [ 6298 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 03:21:46.801628 [ 6298 ] {} Application: Initializing interserver credentials. 2025.04.02 03:21:46.909453 [ 6298 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 03:21:47.339478 [ 6298 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 03:21:47.342291 [ 6298 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 03:21:47.349367 [ 6298 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 03:21:47.350012 [ 6298 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 03:21:47.353995 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 03:21:47.355683 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 03:21:47.357050 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 03:21:47.358649 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 03:21:47.359890 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 03:21:47.362952 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 03:21:47.374168 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 03:21:47.375645 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 03:21:47.377344 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 03:21:47.378762 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 03:21:47.380202 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 03:21:47.381341 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 03:21:47.382924 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 03:21:47.384266 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 03:21:47.385606 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 03:21:47.386975 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 03:21:47.388386 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 03:21:47.389784 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 03:21:47.391260 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 03:21:47.392615 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 03:21:47.394000 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 03:21:47.395292 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 03:21:47.396800 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 03:21:47.398503 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 03:21:47.399875 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 03:21:47.400933 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 03:21:47.448924 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 03:21:47.450756 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 03:21:47.452259 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 03:21:47.453736 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 03:21:47.455297 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 03:21:47.456829 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 03:21:47.458327 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 03:21:47.459607 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 03:21:47.461057 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 03:21:47.462548 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 03:21:47.463978 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 03:21:47.465518 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 03:21:47.466904 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 03:21:47.468597 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 03:21:47.473409 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 03:21:47.474879 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 03:21:47.476417 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 03:21:47.477933 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 03:21:47.479401 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 03:21:47.480853 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 03:21:47.482313 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 03:21:47.483578 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 03:21:47.485926 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 03:21:47.487697 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 03:21:47.489697 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 03:21:47.491301 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 03:21:47.492837 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 03:21:47.564168 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 03:21:47.566090 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 03:21:47.567793 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 03:21:47.568887 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 03:21:47.570430 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 03:21:47.571792 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 03:21:47.574651 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 03:21:47.576157 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 03:21:47.577634 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 03:21:47.579224 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 03:21:47.580682 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 03:21:47.603224 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 03:21:47.605638 [ 6298 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 03:21:47.662294 [ 6298 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 03:21:47.668435 [ 6298 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 03:21:48.333711 [ 6298 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 03:21:48.334338 [ 6298 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 03:21:48.335015 [ 6298 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 03:21:48.602175 [ 6298 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 03:21:48.602910 [ 6298 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 03:21:48.604515 [ 6298 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 03:21:48.606650 [ 6298 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:48.612727 [ 6298 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:48.618747 [ 6298 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 03:21:48.777764 [ 6298 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 03:21:48.778694 [ 6298 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:48.784049 [ 6298 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 03:21:48.788583 [ 6298 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:48.790749 [ 6298 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 03:21:48.792886 [ 6298 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 03:21:48.794272 [ 6298 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 03:21:48.830087 [ 6298 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 03:21:48.830770 [ 6298 ] {} KeeperContext: Keeper feature flag MULTI_READ: disabled 2025.04.02 03:21:48.831480 [ 6298 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: disabled 2025.04.02 03:21:48.832137 [ 6298 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: enabled 2025.04.02 03:21:48.832843 [ 6298 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 03:21:48.834353 [ 6298 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:48.835470 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:48.894246 [ 6298 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:48.898554 [ 6298 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:48.899200 [ 6298 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:48.908489 [ 6298 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/xvu/vlvuoqlxipsuipbxsefmcaycbbckm 2025.04.02 03:21:48.910007 [ 6298 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/xvu/vlvuoqlxipsuipbxsefmcaycbbckm. 2025.04.02 03:21:48.936740 [ 6921 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/xvu/vlvuoqlxipsuipbxsefmcaycbbckm, size 4 2025.04.02 03:21:48.938182 [ 6298 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/xvu/vlvuoqlxipsuipbxsefmcaycbbckm. 2025.04.02 03:21:48.961027 [ 6298 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/xvu/vlvuoqlxipsuipbxsefmcaycbbckm 2025.04.02 03:21:48.961733 [ 6298 ] {} deleteFileFromS3: Object with path s3/xvu/vlvuoqlxipsuipbxsefmcaycbbckm was removed from S3 2025.04.02 03:21:48.962395 [ 6298 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 03:21:48.963028 [ 6298 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 03:21:48.980964 [ 6298 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:48.983661 [ 6298 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:48.984241 [ 6298 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:49.029309 [ 6298 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 03:21:49.030241 [ 6298 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 01:21:49 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18325BC56051A170 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 03:21:49.032182 [ 6298 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 03:21:49.043266 [ 6298 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 03:21:49.043844 [ 6298 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 03:21:49.044372 [ 6298 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 03:21:49.045152 [ 6298 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 03:21:49.046158 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.047108 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.048145 [ 6298 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:49.049047 [ 6298 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:49.049932 [ 6298 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 03:21:49.050805 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.051805 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.052671 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.053608 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.054581 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.074753 [ 6298 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:49.079016 [ 6298 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:49.079610 [ 6298 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:49.120443 [ 6298 ] {} deleteFileFromS3: No blob storage log, not writing blob special/tnv/omwfhukaneusslmghusrictabnnmv 2025.04.02 03:21:49.120993 [ 6298 ] {} deleteFileFromS3: Object with path special/tnv/omwfhukaneusslmghusrictabnnmv was removed from S3 2025.04.02 03:21:49.121622 [ 6298 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 03:21:49.122352 [ 6298 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 03:21:49.152018 [ 6298 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 03:21:49.156256 [ 6298 ] {} S3Client: Provider type: Unknown 2025.04.02 03:21:49.156930 [ 6298 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 03:21:49.251897 [ 6298 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/flq/whsnpgklucfzpaumfvhwfbabiabjh 2025.04.02 03:21:49.252836 [ 6298 ] {} deleteFileFromS3: Object with path test_02944/flq/whsnpgklucfzpaumfvhwfbabiabjh was removed from S3 2025.04.02 03:21:49.274848 [ 6298 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 03:21:49.276056 [ 6298 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 03:21:49.277363 [ 6298 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 03:21:49.301949 [ 6298 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 03:21:49.352437 [ 6298 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 03:21:49.353300 [ 6298 ] {} KeeperSnapshotManager: Found snapshot_8.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:49.353912 [ 6298 ] {} KeeperSnapshotManager: Found snapshot_6.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:49.354448 [ 6298 ] {} KeeperSnapshotManager: Found snapshot_7.bin.zstd on LocalSnapshotDisk 2025.04.02 03:21:49.364260 [ 6298 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 03:21:49.364908 [ 6298 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 03:21:49.366486 [ 6298 ] {} KeeperLogStore: force_sync disabled 2025.04.02 03:21:49.367231 [ 6298 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 03:21:49.367851 [ 6298 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 03:21:49.368349 [ 6298 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 8 2025.04.02 03:21:49.374555 [ 6298 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 03:21:49.375778 [ 6298 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 8 2025.04.02 03:21:49.378882 [ 6298 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 8 entries 2025.04.02 03:21:49.379812 [ 6298 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 03:21:49.383763 [ 6298 ] {} KeeperServer: Last local log idx 8 2025.04.02 03:21:49.384973 [ 6298 ] {} KeeperServer: Will use config from log store with log index 8 2025.04.02 03:21:49.393836 [ 6298 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 03:21:49.403892 [ 6298 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 03:21:49.406822 [ 6298 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 03:21:49.409089 [ 6298 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 03:21:49.410112 [ 6298 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 03:21:49.411091 [ 6298 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 03:21:49.412419 [ 6298 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 03:21:49.413942 [ 6298 ] {} RaftInstance: === INIT RAFT SERVER === commit index 8 term 8 election timer allowed log store start 1, end 8 config log idx 8, prev log idx 7 -- ASYNC REPLICATION -- 2025.04.02 03:21:49.414993 [ 6298 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 03:21:49.416487 [ 6298 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 03:21:49.417705 [ 6298 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 03:21:49.417991 [ 6948 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 03:21:49.470236 [ 6932 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 03:21:49.471103 [ 6932 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 03:21:49.472587 [ 6298 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 03:21:49.472688 [ 6932 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 8, state term 8, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 03:21:49.491950 [ 6932 ] {} RaftInstance: pre-vote term (0) is different, reset it to 8 2025.04.02 03:21:49.493219 [ 6932 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 03:21:49.502889 [ 6932 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 9, log idx 8, log term 8, priority (target 1 / mine 1) 2025.04.02 03:21:49.503956 [ 6932 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 03:21:49.505532 [ 6932 ] {} RaftInstance: state machine commit index 8, precommit index 8, last log index 8 2025.04.02 03:21:49.515363 [ 6932 ] {} RaftInstance: [BECOME LEADER] appended new config at 9 2025.04.02 03:21:49.519161 [ 6947 ] {} RaftInstance: config at index 9 is committed, prev config log idx 8 2025.04.02 03:21:49.519924 [ 6947 ] {} RaftInstance: new config log idx 9, prev log idx 8, cur config log idx 8, prev log idx 7 2025.04.02 03:21:49.520729 [ 6947 ] {} RaftInstance: new configuration: log idx 9, prev log idx 8 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 9 2025.04.02 03:21:49.523549 [ 6298 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 03:21:49.524687 [ 6298 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 03:21:49.531636 [ 6298 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 03:21:49.532356 [ 6298 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 03:21:49.541826 [ 6298 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 03:21:49.542422 [ 6298 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 03:21:49.543865 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 03:21:49.545098 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 03:21:49.545892 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 03:21:49.546942 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 03:21:49.548038 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 03:21:49.549118 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 03:21:49.550426 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 03:21:49.551520 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 03:21:49.553268 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 03:21:49.554449 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 03:21:49.555560 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 03:21:49.556656 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 03:21:49.557756 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 03:21:49.558948 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 03:21:49.559974 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 03:21:49.565465 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 03:21:49.566686 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 03:21:49.567777 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 03:21:49.568825 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 03:21:49.569921 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 03:21:49.571121 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 03:21:49.572350 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 03:21:49.573571 [ 6298 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 03:21:49.579467 [ 6298 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 03:21:49.580143 [ 6298 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 03:21:50.036546 [ 6298 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 03:21:50.037590 [ 6298 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 03:21:50.039480 [ 6298 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 03:21:50.046367 [ 6298 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 03:21:50.051666 [ 6298 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 03:21:50.052384 [ 6953 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 03:21:50.115170 [ 6298 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 03:21:50.120402 [ 6298 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 03:21:50.129544 [ 6298 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 03:21:50.134723 [ 6298 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 03:21:50.142550 [ 6298 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 03:21:50.148007 [ 6298 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 03:21:50.156648 [ 6298 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 03:21:50.157768 [ 6298 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 03:21:50.157910 [ 6311 ] {} DNSResolver: Updating DNS cache 2025.04.02 03:21:50.164938 [ 6311 ] {} DNSResolver: Updated DNS cache 2025.04.02 03:21:54.655474 [ 6298 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:54.656807 [ 6298 ] {} Application: Stopping AsyncLoader. 2025.04.02 03:21:54.661529 [ 6298 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 03:21:54.662364 [ 6298 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 03:21:54.663391 [ 6310 ] {} CancellationChecker: Execution took 8030 ms. 2025.04.02 03:21:54.664906 [ 6298 ] {} Application: Shutting down storages. 2025.04.02 03:21:54.665501 [ 6298 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 03:21:54.685948 [ 6298 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 03:21:54.686791 [ 6298 ] {} Context: Shutting down workload entity storage 2025.04.02 03:21:54.687394 [ 6298 ] {} Context: Shutting down named sessions 2025.04.02 03:21:54.689201 [ 6298 ] {} Context: Shutting down database catalog 2025.04.02 03:21:54.690072 [ 6298 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 03:21:54.691442 [ 6298 ] {} Context: Shutting down merges executor 2025.04.02 03:21:54.694461 [ 6298 ] {} Context: Shutting down fetches executor 2025.04.02 03:21:54.697117 [ 6298 ] {} Context: Shutting down moves executor 2025.04.02 03:21:54.699031 [ 6298 ] {} Context: Shutting down common executor 2025.04.02 03:21:54.701102 [ 6298 ] {} Context: Shutting down DDLWorker 2025.04.02 03:21:54.701834 [ 6298 ] {} Context: Shutting down caches 2025.04.02 03:21:54.702950 [ 6298 ] {} Context: Shutting down AccessControl 2025.04.02 03:21:54.707154 [ 6298 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 03:21:54.713366 [ 6298 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 03:21:54.884378 [ 6298 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 03:21:54.889736 [ 6298 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 03:21:54.903269 [ 6298 ] {} Application: Shut down storages. 2025.04.02 03:21:54.903736 [ 6298 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 03:21:55.291324 [ 6298 ] {} Application: Closed all listening sockets. 2025.04.02 03:21:55.292469 [ 6298 ] {} Application: Closed connections to servers for tables. 2025.04.02 03:21:55.297793 [ 6298 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 03:21:55.532148 [ 6298 ] {} RaftInstance: shutting down raft core 2025.04.02 03:21:55.534409 [ 6298 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 03:21:55.535357 [ 6298 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 03:21:55.536404 [ 6298 ] {} RaftInstance: commit thread stopped. 2025.04.02 03:21:55.538052 [ 6298 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 03:21:55.539036 [ 6298 ] {} RaftInstance: reset all pointers. 2025.04.02 03:21:55.540495 [ 6298 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 03:21:55.541944 [ 6948 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 03:21:55.542175 [ 6298 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 03:21:55.543442 [ 6298 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 03:21:55.544697 [ 6298 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 03:21:55.546058 [ 6298 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 03:21:55.547267 [ 6298 ] {} RaftInstance: manually create a snapshot on 9 2025.04.02 03:21:55.550148 [ 6298 ] {} RaftInstance: creating a snapshot for index 9 2025.04.02 03:21:55.551632 [ 6298 ] {} RaftInstance: create snapshot idx 9 log_term 9 2025.04.02 03:21:55.552807 [ 6298 ] {} KeeperStateMachine: Creating snapshot 9 2025.04.02 03:21:55.554214 [ 6298 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 03:21:55.557869 [ 6298 ] {} KeeperStateMachine: Created persistent snapshot 9 with path snapshot_9.bin.zstd 2025.04.02 03:21:55.558935 [ 6298 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 03:21:55.560018 [ 6298 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 03:21:55.561012 [ 6298 ] {} RaftInstance: snapshot idx 9 log_term 9 created, compact the log store if needed 2025.04.02 03:21:55.563155 [ 6298 ] {} RaftInstance: create snapshot idx 9 log_term 9 done: 10574 us elapsed 2025.04.02 03:21:55.564618 [ 6934 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 03:21:55.566805 [ 6936 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 03:21:55.566881 [ 6933 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 03:21:55.567050 [ 6946 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:55.567140 [ 6943 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 03:21:55.567376 [ 6941 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 03:21:55.567559 [ 6937 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:21:55.567634 [ 6944 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 03:21:55.567691 [ 6939 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 03:21:55.567899 [ 6940 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:21:55.567996 [ 6932 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:21:55.568283 [ 6938 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:55.568205 [ 6942 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 03:21:55.568475 [ 6935 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 03:21:55.568093 [ 6931 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 03:21:55.568494 [ 6945 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:55.568600 [ 6934 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 03:21:55.573166 [ 6298 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:55.573958 [ 6930 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 03:21:55.577555 [ 6298 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 03:21:55.578903 [ 6298 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 03:21:55.579489 [ 6298 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 03:21:55.581352 [ 6298 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 03:21:55.582481 [ 6298 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:55.593539 [ 6298 ] {} Context: Destructing local fs threadpool reader 2025.04.02 03:21:55.594356 [ 6298 ] {} Context: Destructing threadpool writer 2025.04.02 03:21:55.642503 [ 6298 ] {} Application: Destroyed global context. 2025.04.02 03:21:55.644332 [ 6298 ] {} Application: Waiting for background threads 2025.04.02 03:21:55.711277 [ 6298 ] {} Application: Background threads finished in 66 ms 2025.04.02 03:21:55.714806 [ 6298 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 03:21:55.715333 [ 6298 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 03:21:55.734259 [ 6298 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 03:21:55.735136 [ 6298 ] {} Application: shutting down 2025.04.02 03:21:55.735674 [ 6298 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 03:21:55.737357 [ 6299 ] {} BaseDaemon: Received signal -2 2025.04.02 03:21:55.738051 [ 6299 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 03:21:55.953519 [ 6297 ] {} Application: Child process exited normally with code 233.