2025.04.02 04:47:45.417494 [ 20312 ] {} Application: Will watch for the process with pid 20313 2025.04.02 04:47:45.417721 [ 20313 ] {} Application: Forked a child process to watch 2025.04.02 04:47:45.418637 [ 20313 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:47:45.522065 [ 20313 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 20313 2025.04.02 04:47:45.522469 [ 20313 ] {} Application: starting up 2025.04.02 04:47:45.522489 [ 20313 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:47:45.530885 [ 20313 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:47:45.530966 [ 20313 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:47:45.531018 [ 20313 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:47:45.531031 [ 20313 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:47:45.531058 [ 20313 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:47:45.532087 [ 20313 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:47:45.532466 [ 20313 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:47:45.532492 [ 20313 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:47:45.532599 [ 20313 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:47:45.532615 [ 20313 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:47:45.833297 [ 20313 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:47:45.833470 [ 20313 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:47:45.860206 [ 20313 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:47:45.860288 [ 20313 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:47:45.860422 [ 20313 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:47:45.897623 [ 20323 ] {} CancellationChecker: Started worker function 2025.04.02 04:47:45.897725 [ 20313 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:47:45.897783 [ 20313 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:47:45.897803 [ 20313 ] {} Application: Initializing DateLUT. 2025.04.02 04:47:45.897815 [ 20313 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:47:45.898003 [ 20313 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:47:45.898196 [ 20313 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:47:45.903339 [ 20313 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:47:45.903380 [ 20313 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:47:45.903422 [ 20313 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:47:45.903911 [ 20313 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:47:45.903978 [ 20313 ] {} Application: Initializing interserver credentials. 2025.04.02 04:47:45.904588 [ 20313 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:47:45.906880 [ 20313 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:47:45.906960 [ 20313 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:47:45.907000 [ 20313 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:47:45.907192 [ 20313 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:47:45.911279 [ 20313 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:47:45.911305 [ 20313 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:47:45.914138 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:47:45.914612 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:47:45.914825 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:47:45.915067 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:47:45.915332 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:47:45.917178 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:47:45.917476 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:47:45.917718 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:47:45.917917 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:47:45.918121 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:47:45.918411 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:47:45.918615 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:47:45.918825 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:47:45.919019 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:47:45.919324 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:47:45.919550 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:47:45.919757 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:47:45.919969 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:47:45.920199 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:47:45.920464 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:47:45.920712 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:47:45.920934 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:47:45.921341 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:47:45.921867 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:47:45.922092 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:47:45.922503 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:47:45.923045 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:47:45.923310 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:47:45.923512 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:47:45.923736 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:47:45.923967 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:47:45.924209 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:47:45.924499 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:47:45.924716 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:47:45.925028 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:47:45.925371 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:47:45.925663 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:47:45.925959 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:47:45.926212 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:47:45.926643 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:47:45.926881 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:47:45.927050 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:47:45.927228 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:47:45.927423 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:47:45.927601 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:47:45.927817 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:47:45.928003 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:47:45.928186 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:47:45.928394 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:47:45.929161 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:47:45.929504 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:47:45.929894 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:47:45.930137 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:47:45.930335 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:47:45.930502 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:47:45.930757 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:47:45.930948 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:47:45.931156 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:47:45.931349 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:47:45.931539 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:47:45.931715 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:47:45.931976 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:47:45.932150 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:47:45.932388 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:47:45.932643 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:47:45.932837 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:47:45.933559 [ 20313 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:47:45.955970 [ 20313 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:47:45.956580 [ 20313 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:47:45.967688 [ 20313 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:47:45.967703 [ 20313 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:47:45.967708 [ 20313 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:47:45.971194 [ 20313 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:47:45.971208 [ 20313 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:47:45.971222 [ 20313 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:47:45.971257 [ 20313 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:45.972038 [ 20313 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:45.972874 [ 20313 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:45.975219 [ 20313 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:47:45.975305 [ 20313 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:47:45.975332 [ 20313 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:47:45.975950 [ 20313 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:47:45.976082 [ 20313 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:47:45.976179 [ 20313 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:47:45.976635 [ 20313 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:47:45.976660 [ 20313 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:47:45.977005 [ 20313 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:47:45.977012 [ 20313 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:47:45.977016 [ 20313 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:47:45.977024 [ 20313 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:47:45.977029 [ 20313 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:47:45.977069 [ 20313 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:45.977080 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:45.987133 [ 20313 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:45.988659 [ 20313 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:45.988670 [ 20313 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:45.988973 [ 20313 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:45.989060 [ 20313 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu 2025.04.02 04:47:45.989097 [ 20313 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu 2025.04.02 04:47:45.989107 [ 20313 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu, size 4 2025.04.02 04:47:45.989312 [ 20313 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu. 2025.04.02 04:47:45.989417 [ 20887 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu 2025.04.02 04:47:45.996167 [ 20887 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu, size 4 2025.04.02 04:47:45.996428 [ 20313 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/hub/xpndlcpztalyhrqdoocckbpweyvqu. 2025.04.02 04:47:45.996621 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/hub/xpndlcpztalyhrqdoocckbpweyvqu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:45.998485 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/hub/xpndlcpztalyhrqdoocckbpweyvqu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:45.998514 [ 20313 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/hub/xpndlcpztalyhrqdoocckbpweyvqu, Version: Latest, Offset: 2 2025.04.02 04:47:46.002495 [ 20313 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/hub/xpndlcpztalyhrqdoocckbpweyvqu 2025.04.02 04:47:46.002514 [ 20313 ] {} deleteFileFromS3: Object with path s3/hub/xpndlcpztalyhrqdoocckbpweyvqu was removed from S3 2025.04.02 04:47:46.002551 [ 20313 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:47:46.002562 [ 20313 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:47:46.003405 [ 20313 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:46.005532 [ 20313 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:46.005549 [ 20313 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:46.005733 [ 20313 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:46.011710 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:46.014617 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:46.014641 [ 20313 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:47:46.018513 [ 20313 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:47:46.018568 [ 20313 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:47:46 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832607614D8BDB6 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:47:46.018610 [ 20313 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:47:46.021936 [ 20313 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:46.021954 [ 20313 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:47:46.021966 [ 20313 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:47:46.021975 [ 20313 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:47:46.022010 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022028 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022044 [ 20313 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:46.022060 [ 20313 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:46.022075 [ 20313 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:47:46.022098 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022114 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022129 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022145 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022161 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.022983 [ 20313 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:46.025080 [ 20313 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:46.025094 [ 20313 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:46.025330 [ 20313 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:46.029429 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/lzt/jzjjjobcfpkpcrziwhqoeqliewahm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:46.030924 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/lzt/jzjjjobcfpkpcrziwhqoeqliewahm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:46.030946 [ 20313 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/lzt/jzjjjobcfpkpcrziwhqoeqliewahm, Version: Latest, Offset: 2 2025.04.02 04:47:46.034676 [ 20313 ] {} deleteFileFromS3: No blob storage log, not writing blob special/lzt/jzjjjobcfpkpcrziwhqoeqliewahm 2025.04.02 04:47:46.034704 [ 20313 ] {} deleteFileFromS3: Object with path special/lzt/jzjjjobcfpkpcrziwhqoeqliewahm was removed from S3 2025.04.02 04:47:46.034722 [ 20313 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:47:46.034735 [ 20313 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:47:46.035824 [ 20313 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:46.037941 [ 20313 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:46.037956 [ 20313 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:46.038151 [ 20313 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:46.041799 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gcn/uetxtckrdkxsvqntjtuiwawrfkepm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:46.043380 [ 20313 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gcn/uetxtckrdkxsvqntjtuiwawrfkepm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:46.043413 [ 20313 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/gcn/uetxtckrdkxsvqntjtuiwawrfkepm, Version: Latest, Offset: 2 2025.04.02 04:47:46.047169 [ 20313 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/gcn/uetxtckrdkxsvqntjtuiwawrfkepm 2025.04.02 04:47:46.047197 [ 20313 ] {} deleteFileFromS3: Object with path test_02944/gcn/uetxtckrdkxsvqntjtuiwawrfkepm was removed from S3 2025.04.02 04:47:46.047215 [ 20313 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:47:46.047228 [ 20313 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:47:46.047284 [ 20313 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:46.049450 [ 20313 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:46.051429 [ 20313 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:47:46.051530 [ 20313 ] {} KeeperSnapshotManager: Found snapshot_24.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:46.051558 [ 20313 ] {} KeeperSnapshotManager: Found snapshot_25.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:46.051570 [ 20313 ] {} KeeperSnapshotManager: Found snapshot_23.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:46.052313 [ 20313 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:47:46.052394 [ 20313 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:47:46.052727 [ 20313 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:47:46.052747 [ 20313 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:47:46.052788 [ 20313 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:47:46.052800 [ 20313 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 25 2025.04.02 04:47:46.053267 [ 20313 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:47:46.053349 [ 20313 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 25 2025.04.02 04:47:46.053633 [ 20313 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 25 entries 2025.04.02 04:47:46.053661 [ 20313 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:47:46.053721 [ 20313 ] {} KeeperServer: Last local log idx 25 2025.04.02 04:47:46.053738 [ 20313 ] {} KeeperServer: Will use config from log store with log index 25 2025.04.02 04:47:46.054312 [ 20313 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:47:46.056845 [ 20313 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:47:46.057176 [ 20313 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:47:46.057272 [ 20313 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:47:46.057293 [ 20313 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:47:46.057314 [ 20313 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:47:46.057326 [ 20313 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:47:46.057349 [ 20313 ] {} RaftInstance: === INIT RAFT SERVER === commit index 25 term 25 election timer allowed log store start 1, end 25 config log idx 25, prev log idx 24 -- ASYNC REPLICATION -- 2025.04.02 04:47:46.057378 [ 20313 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:47:46.057430 [ 20313 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:47:46.057582 [ 20313 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:47:46.057637 [ 20914 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:47:46.107852 [ 20313 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:47:46.107852 [ 20897 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:47:46.107895 [ 20897 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:47:46.107968 [ 20897 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 25, state term 25, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:47:46.107982 [ 20897 ] {} RaftInstance: pre-vote term (0) is different, reset it to 25 2025.04.02 04:47:46.108080 [ 20897 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:47:46.110755 [ 20897 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 26, log idx 25, log term 25, priority (target 1 / mine 1) 2025.04.02 04:47:46.110787 [ 20897 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:47:46.110799 [ 20897 ] {} RaftInstance: state machine commit index 25, precommit index 25, last log index 25 2025.04.02 04:47:46.111052 [ 20895 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:47:46.111163 [ 20897 ] {} RaftInstance: [BECOME LEADER] appended new config at 26 2025.04.02 04:47:46.111347 [ 20913 ] {} RaftInstance: config at index 26 is committed, prev config log idx 25 2025.04.02 04:47:46.111413 [ 20913 ] {} RaftInstance: new config log idx 26, prev log idx 25, cur config log idx 25, prev log idx 24 2025.04.02 04:47:46.111440 [ 20913 ] {} RaftInstance: new configuration: log idx 26, prev log idx 25 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 26 2025.04.02 04:47:46.111519 [ 20313 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:47:46.111698 [ 20313 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:47:46.113217 [ 20313 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:47:46.113366 [ 20313 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:47:46.117329 [ 20313 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:47:46.117356 [ 20313 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:47:46.117837 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:47:46.117995 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:47:46.118198 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:47:46.118334 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:47:46.118435 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:47:46.118532 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:47:46.118639 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:47:46.118773 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:47:46.119906 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:47:46.120090 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:47:46.120275 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:47:46.120455 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:47:46.120629 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:47:46.120839 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:47:46.121014 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:47:46.121245 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:47:46.121444 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:47:46.121671 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:47:46.121885 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:47:46.122076 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:47:46.122281 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:47:46.122494 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:47:46.122851 [ 20313 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:47:46.127567 [ 20313 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:47:46.127669 [ 20313 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:47:46.131082 [ 20313 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:47:46.131127 [ 20313 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:47:46.131636 [ 20313 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:47:46.131971 [ 20313 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:47:46.132194 [ 20313 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:47:46.132459 [ 20919 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:47:46.134453 [ 20313 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:47:46.135014 [ 20313 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:47:46.136133 [ 20313 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:47:46.136658 [ 20313 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:47:46.137961 [ 20313 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:47:46.138632 [ 20313 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:47:46.139246 [ 20313 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:47:46.139831 [ 20313 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:47:46.139867 [ 20313 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:47:46.139906 [ 20320 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:47:46.140202 [ 20320 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:47:50.683163 [ 20313 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:47:50.683329 [ 20313 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:47:50.683611 [ 20313 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:47:50.683628 [ 20313 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:47:50.683759 [ 20323 ] {} CancellationChecker: Execution took 4786 ms. 2025.04.02 04:47:50.683963 [ 20313 ] {} Application: Shutting down storages. 2025.04.02 04:47:50.683978 [ 20313 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:47:50.685617 [ 20313 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:47:50.685636 [ 20313 ] {} Context: Shutting down workload entity storage 2025.04.02 04:47:50.685644 [ 20313 ] {} Context: Shutting down named sessions 2025.04.02 04:47:50.685672 [ 20313 ] {} Context: Shutting down database catalog 2025.04.02 04:47:50.685681 [ 20313 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:47:50.685725 [ 20313 ] {} Context: Shutting down merges executor 2025.04.02 04:47:50.686004 [ 20313 ] {} Context: Shutting down fetches executor 2025.04.02 04:47:50.686236 [ 20313 ] {} Context: Shutting down moves executor 2025.04.02 04:47:50.686394 [ 20313 ] {} Context: Shutting down common executor 2025.04.02 04:47:50.686579 [ 20313 ] {} Context: Shutting down DDLWorker 2025.04.02 04:47:50.686588 [ 20313 ] {} Context: Shutting down caches 2025.04.02 04:47:50.686597 [ 20313 ] {} Context: Shutting down AccessControl 2025.04.02 04:47:50.686921 [ 20313 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:47:50.689214 [ 20313 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:47:50.689514 [ 20313 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:47:50.689665 [ 20313 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:47:50.689872 [ 20313 ] {} Application: Shut down storages. 2025.04.02 04:47:50.689884 [ 20313 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:47:50.870202 [ 20313 ] {} Application: Closed all listening sockets. 2025.04.02 04:47:50.870234 [ 20313 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:47:50.870247 [ 20313 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:47:51.113913 [ 20313 ] {} RaftInstance: shutting down raft core 2025.04.02 04:47:51.114008 [ 20313 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:47:51.114020 [ 20313 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:47:51.114115 [ 20313 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:47:51.114128 [ 20313 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:47:51.114155 [ 20313 ] {} RaftInstance: reset all pointers. 2025.04.02 04:47:51.114170 [ 20313 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:47:51.114328 [ 20313 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:47:51.114339 [ 20914 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:47:51.114460 [ 20313 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:47:51.114474 [ 20313 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:47:51.114485 [ 20313 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:47:51.114496 [ 20313 ] {} RaftInstance: manually create a snapshot on 26 2025.04.02 04:47:51.114509 [ 20313 ] {} RaftInstance: creating a snapshot for index 26 2025.04.02 04:47:51.114520 [ 20313 ] {} RaftInstance: create snapshot idx 26 log_term 26 2025.04.02 04:47:51.114555 [ 20313 ] {} KeeperStateMachine: Creating snapshot 26 2025.04.02 04:47:51.114624 [ 20313 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:47:51.117496 [ 20313 ] {} KeeperStateMachine: Created persistent snapshot 26 with path snapshot_26.bin.zstd 2025.04.02 04:47:51.117522 [ 20313 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:47:51.117533 [ 20313 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:47:51.117568 [ 20313 ] {} RaftInstance: snapshot idx 26 log_term 26 created, compact the log store if needed 2025.04.02 04:47:51.117584 [ 20313 ] {} RaftInstance: create snapshot idx 26 log_term 26 done: 3036 us elapsed 2025.04.02 04:47:51.117931 [ 20897 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:47:51.117974 [ 20900 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:47:51.118035 [ 20912 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:47:51.118358 [ 20903 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:47:51.118411 [ 20902 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:47:51.117998 [ 20906 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:47:51.118460 [ 20911 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:47:51.118017 [ 20901 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:47:51.118108 [ 20904 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:47:51.117959 [ 20899 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:47:51.118160 [ 20905 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:47:51.118261 [ 20910 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:47:51.118336 [ 20908 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:47:51.117975 [ 20898 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:47:51.117939 [ 20907 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:47:51.118386 [ 20909 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:47:51.119571 [ 20313 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:47:51.119644 [ 20895 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:47:51.119960 [ 20313 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:47:51.120039 [ 20313 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:47:51.120052 [ 20313 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:47:51.120069 [ 20313 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:47:51.120083 [ 20313 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:47:51.120337 [ 20313 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:47:51.120383 [ 20313 ] {} Context: Destructing threadpool writer 2025.04.02 04:47:51.122254 [ 20313 ] {} Application: Destroyed global context. 2025.04.02 04:47:51.122507 [ 20313 ] {} Application: Waiting for background threads 2025.04.02 04:47:51.138255 [ 20313 ] {} Application: Background threads finished in 15 ms 2025.04.02 04:47:51.138846 [ 20313 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:47:51.138864 [ 20313 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:47:51.143366 [ 20313 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:47:51.143475 [ 20313 ] {} Application: shutting down 2025.04.02 04:47:51.143487 [ 20313 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:47:51.144424 [ 20314 ] {} BaseDaemon: Received signal -2 2025.04.02 04:47:51.144469 [ 20314 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:47:51.224811 [ 20312 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:47:51.455325 [ 21014 ] {} Application: Will watch for the process with pid 21015 2025.04.02 04:47:51.455536 [ 21015 ] {} Application: Forked a child process to watch 2025.04.02 04:47:51.456431 [ 21015 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:47:51.562803 [ 21015 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 21015 2025.04.02 04:47:51.563237 [ 21015 ] {} Application: starting up 2025.04.02 04:47:51.563260 [ 21015 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:47:51.571761 [ 21015 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:47:51.571843 [ 21015 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:47:51.571896 [ 21015 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:47:51.571918 [ 21015 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:47:51.571944 [ 21015 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:47:51.572792 [ 21015 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:47:51.572978 [ 21015 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:47:51.572992 [ 21015 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:47:51.573067 [ 21015 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:47:51.573081 [ 21015 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:47:51.872722 [ 21015 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:47:51.872893 [ 21015 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:47:51.899892 [ 21015 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:47:51.899964 [ 21015 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:47:51.900097 [ 21015 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:47:51.929389 [ 21024 ] {} CancellationChecker: Started worker function 2025.04.02 04:47:51.929443 [ 21015 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:47:51.929486 [ 21015 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:47:51.929498 [ 21015 ] {} Application: Initializing DateLUT. 2025.04.02 04:47:51.929504 [ 21015 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:47:51.929605 [ 21015 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:47:51.929710 [ 21015 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:47:51.932089 [ 21015 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:47:51.932106 [ 21015 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:47:51.932123 [ 21015 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:47:51.932411 [ 21015 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:47:51.932437 [ 21015 ] {} Application: Initializing interserver credentials. 2025.04.02 04:47:51.932727 [ 21015 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:47:51.933799 [ 21015 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:47:51.933829 [ 21015 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:47:51.933848 [ 21015 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:47:51.933947 [ 21015 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:47:51.936084 [ 21015 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:47:51.936097 [ 21015 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:47:51.937410 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:47:51.937607 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:47:51.937713 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:47:51.937824 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:47:51.937933 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:47:51.938773 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:47:51.938882 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:47:51.938989 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:47:51.939078 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:47:51.939169 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:47:51.939301 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:47:51.939394 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:47:51.939487 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:47:51.939576 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:47:51.939701 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:47:51.939793 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:47:51.939887 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:47:51.939981 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:47:51.940085 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:47:51.940183 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:47:51.940297 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:47:51.940399 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:47:51.940561 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:47:51.940796 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:47:51.940897 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:47:51.941082 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:47:51.941349 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:47:51.941468 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:47:51.941558 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:47:51.941666 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:47:51.941770 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:47:51.941880 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:47:51.942002 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:47:51.942099 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:47:51.942239 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:47:51.942352 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:47:51.942475 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:47:51.942605 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:47:51.942720 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:47:51.942965 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:47:51.943122 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:47:51.943235 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:47:51.943363 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:47:51.943485 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:47:51.943600 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:47:51.943747 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:47:51.943869 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:47:51.943987 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:47:51.944110 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:47:51.944620 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:47:51.944811 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:47:51.945032 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:47:51.945239 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:47:51.945377 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:47:51.945489 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:47:51.945655 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:47:51.945780 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:47:51.945916 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:47:51.946027 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:47:51.946144 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:47:51.946259 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:47:51.946450 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:47:51.946568 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:47:51.946705 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:47:51.946870 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:47:51.946997 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:47:51.947444 [ 21015 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:47:51.962343 [ 21015 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:47:51.962650 [ 21015 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:47:51.973253 [ 21015 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:47:51.973267 [ 21015 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:47:51.973272 [ 21015 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:47:51.976829 [ 21015 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:47:51.976843 [ 21015 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:47:51.976857 [ 21015 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:47:51.976880 [ 21015 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:51.977765 [ 21015 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:51.978663 [ 21015 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:51.980897 [ 21015 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:47:51.981014 [ 21015 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:47:51.981045 [ 21015 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:47:51.981664 [ 21015 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:47:51.981801 [ 21015 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:47:51.981905 [ 21015 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:47:51.982360 [ 21015 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:47:51.982392 [ 21015 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:47:51.982734 [ 21015 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:47:51.982741 [ 21015 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:47:51.982745 [ 21015 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:47:51.982753 [ 21015 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:47:51.982758 [ 21015 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:47:51.982798 [ 21015 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:51.982809 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:51.992798 [ 21015 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:51.994263 [ 21015 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:51.994274 [ 21015 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:51.994593 [ 21015 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:51.994685 [ 21015 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae 2025.04.02 04:47:51.994724 [ 21015 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae 2025.04.02 04:47:51.994735 [ 21015 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae, size 4 2025.04.02 04:47:51.994883 [ 21015 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae. 2025.04.02 04:47:51.995034 [ 21589 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae 2025.04.02 04:47:52.001558 [ 21589 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae, size 4 2025.04.02 04:47:52.001748 [ 21015 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae. 2025.04.02 04:47:52.001891 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.003937 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.003953 [ 21015 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae, Version: Latest, Offset: 2 2025.04.02 04:47:52.007134 [ 21015 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae 2025.04.02 04:47:52.007147 [ 21015 ] {} deleteFileFromS3: Object with path s3/gvp/pbpqjjfpsbsuomgbtcpasnqwgxqae was removed from S3 2025.04.02 04:47:52.007172 [ 21015 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:47:52.007179 [ 21015 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:47:52.007726 [ 21015 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:52.009101 [ 21015 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:52.009109 [ 21015 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:52.009275 [ 21015 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:52.014633 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.017259 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.017275 [ 21015 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:47:52.020797 [ 21015 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:47:52.020833 [ 21015 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:47:52 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 183260777A9D8821 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:47:52.020860 [ 21015 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:47:52.023880 [ 21015 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:52.023899 [ 21015 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:47:52.023911 [ 21015 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:47:52.023920 [ 21015 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:47:52.023949 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.023967 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.023984 [ 21015 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:52.024001 [ 21015 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:52.024016 [ 21015 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:47:52.024032 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.024048 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.024065 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.024081 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.024097 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.024932 [ 21015 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:52.027023 [ 21015 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:52.027037 [ 21015 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:52.027238 [ 21015 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:52.031943 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/xhq/aphxlqhpqrjtjpyoqyahkwipxnhba (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.033592 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/xhq/aphxlqhpqrjtjpyoqyahkwipxnhba (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.033615 [ 21015 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/xhq/aphxlqhpqrjtjpyoqyahkwipxnhba, Version: Latest, Offset: 2 2025.04.02 04:47:52.036950 [ 21015 ] {} deleteFileFromS3: No blob storage log, not writing blob special/xhq/aphxlqhpqrjtjpyoqyahkwipxnhba 2025.04.02 04:47:52.036968 [ 21015 ] {} deleteFileFromS3: Object with path special/xhq/aphxlqhpqrjtjpyoqyahkwipxnhba was removed from S3 2025.04.02 04:47:52.036980 [ 21015 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:47:52.036989 [ 21015 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:47:52.037846 [ 21015 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:52.039899 [ 21015 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:52.039913 [ 21015 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:52.040110 [ 21015 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:52.044406 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/imj/gdywrsvhiwxmnzgwvnqyfglediwtw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.045997 [ 21015 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/imj/gdywrsvhiwxmnzgwvnqyfglediwtw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:52.046019 [ 21015 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/imj/gdywrsvhiwxmnzgwvnqyfglediwtw, Version: Latest, Offset: 2 2025.04.02 04:47:52.049516 [ 21015 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/imj/gdywrsvhiwxmnzgwvnqyfglediwtw 2025.04.02 04:47:52.049536 [ 21015 ] {} deleteFileFromS3: Object with path test_02944/imj/gdywrsvhiwxmnzgwvnqyfglediwtw was removed from S3 2025.04.02 04:47:52.049548 [ 21015 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:47:52.049557 [ 21015 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:47:52.049586 [ 21015 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:52.051090 [ 21015 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:52.052476 [ 21015 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:47:52.052554 [ 21015 ] {} KeeperSnapshotManager: Found snapshot_24.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:52.052575 [ 21015 ] {} KeeperSnapshotManager: Found snapshot_26.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:52.052584 [ 21015 ] {} KeeperSnapshotManager: Found snapshot_25.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:52.053090 [ 21015 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:47:52.053179 [ 21015 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:47:52.053400 [ 21015 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:47:52.053418 [ 21015 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:47:52.053448 [ 21015 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:47:52.053457 [ 21015 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 26 2025.04.02 04:47:52.053767 [ 21015 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:47:52.053823 [ 21015 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 26 2025.04.02 04:47:52.054029 [ 21015 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 26 entries 2025.04.02 04:47:52.054050 [ 21015 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:47:52.054096 [ 21015 ] {} KeeperServer: Last local log idx 26 2025.04.02 04:47:52.054110 [ 21015 ] {} KeeperServer: Will use config from log store with log index 26 2025.04.02 04:47:52.054492 [ 21015 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:47:52.056465 [ 21015 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:47:52.056682 [ 21015 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:47:52.056711 [ 21015 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:47:52.056724 [ 21015 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:47:52.056738 [ 21015 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:47:52.056747 [ 21015 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:47:52.056764 [ 21015 ] {} RaftInstance: === INIT RAFT SERVER === commit index 26 term 26 election timer allowed log store start 1, end 26 config log idx 26, prev log idx 25 -- ASYNC REPLICATION -- 2025.04.02 04:47:52.056782 [ 21015 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:47:52.056818 [ 21015 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:47:52.056925 [ 21015 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:47:52.057006 [ 21615 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:47:52.107194 [ 21015 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:47:52.107212 [ 21599 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:47:52.107275 [ 21599 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:47:52.107384 [ 21599 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 26, state term 26, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:47:52.107399 [ 21599 ] {} RaftInstance: pre-vote term (0) is different, reset it to 26 2025.04.02 04:47:52.107545 [ 21599 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:47:52.110208 [ 21599 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 27, log idx 26, log term 26, priority (target 1 / mine 1) 2025.04.02 04:47:52.110242 [ 21599 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:47:52.110255 [ 21599 ] {} RaftInstance: state machine commit index 26, precommit index 26, last log index 26 2025.04.02 04:47:52.110491 [ 21597 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:47:52.110578 [ 21599 ] {} RaftInstance: [BECOME LEADER] appended new config at 27 2025.04.02 04:47:52.110753 [ 21616 ] {} RaftInstance: config at index 27 is committed, prev config log idx 26 2025.04.02 04:47:52.110842 [ 21616 ] {} RaftInstance: new config log idx 27, prev log idx 26, cur config log idx 26, prev log idx 25 2025.04.02 04:47:52.110873 [ 21616 ] {} RaftInstance: new configuration: log idx 27, prev log idx 26 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 27 2025.04.02 04:47:52.110940 [ 21015 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:47:52.111120 [ 21015 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:47:52.112660 [ 21015 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:47:52.112765 [ 21015 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:47:52.116747 [ 21015 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:47:52.116773 [ 21015 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:47:52.117312 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:47:52.117482 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:47:52.117688 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:47:52.117804 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:47:52.117904 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:47:52.117999 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:47:52.118102 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:47:52.118232 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:47:52.119408 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:47:52.119599 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:47:52.119768 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:47:52.119945 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:47:52.120118 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:47:52.120304 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:47:52.120481 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:47:52.120680 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:47:52.120856 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:47:52.121075 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:47:52.121316 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:47:52.121524 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:47:52.121761 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:47:52.121984 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:47:52.122383 [ 21015 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:47:52.127125 [ 21015 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:47:52.127200 [ 21015 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:47:52.130469 [ 21015 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:47:52.130512 [ 21015 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:47:52.130956 [ 21015 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:47:52.131209 [ 21015 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:47:52.131429 [ 21015 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:47:52.131686 [ 21621 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:47:52.133689 [ 21015 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:47:52.134253 [ 21015 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:47:52.135253 [ 21015 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:47:52.135852 [ 21015 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:47:52.137233 [ 21015 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:47:52.137890 [ 21015 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:47:52.138574 [ 21015 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:47:52.139129 [ 21015 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:47:52.139164 [ 21015 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:47:52.139225 [ 21023 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:47:52.139549 [ 21023 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:47:56.371115 [ 21015 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:47:56.371269 [ 21015 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:47:56.371552 [ 21015 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:47:56.371571 [ 21015 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:47:56.371904 [ 21024 ] {} CancellationChecker: Execution took 4442 ms. 2025.04.02 04:47:56.372138 [ 21015 ] {} Application: Shutting down storages. 2025.04.02 04:47:56.372159 [ 21015 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:47:56.373624 [ 21015 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:47:56.373650 [ 21015 ] {} Context: Shutting down workload entity storage 2025.04.02 04:47:56.373661 [ 21015 ] {} Context: Shutting down named sessions 2025.04.02 04:47:56.373693 [ 21015 ] {} Context: Shutting down database catalog 2025.04.02 04:47:56.373704 [ 21015 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:47:56.373762 [ 21015 ] {} Context: Shutting down merges executor 2025.04.02 04:47:56.374019 [ 21015 ] {} Context: Shutting down fetches executor 2025.04.02 04:47:56.374308 [ 21015 ] {} Context: Shutting down moves executor 2025.04.02 04:47:56.374513 [ 21015 ] {} Context: Shutting down common executor 2025.04.02 04:47:56.374674 [ 21015 ] {} Context: Shutting down DDLWorker 2025.04.02 04:47:56.374689 [ 21015 ] {} Context: Shutting down caches 2025.04.02 04:47:56.374704 [ 21015 ] {} Context: Shutting down AccessControl 2025.04.02 04:47:56.375204 [ 21015 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:47:56.378587 [ 21015 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:47:56.378949 [ 21015 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:47:56.379107 [ 21015 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:47:56.379401 [ 21015 ] {} Application: Shut down storages. 2025.04.02 04:47:56.379420 [ 21015 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:47:56.869363 [ 21015 ] {} Application: Closed all listening sockets. 2025.04.02 04:47:56.869408 [ 21015 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:47:56.869419 [ 21015 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:47:57.113475 [ 21015 ] {} RaftInstance: shutting down raft core 2025.04.02 04:47:57.113529 [ 21015 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:47:57.113539 [ 21015 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:47:57.113639 [ 21015 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:47:57.113655 [ 21015 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:47:57.113668 [ 21015 ] {} RaftInstance: reset all pointers. 2025.04.02 04:47:57.113678 [ 21015 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:47:57.113779 [ 21015 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:47:57.113805 [ 21615 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:47:57.113905 [ 21015 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:47:57.113915 [ 21015 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:47:57.113922 [ 21015 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:47:57.113930 [ 21015 ] {} RaftInstance: manually create a snapshot on 27 2025.04.02 04:47:57.113939 [ 21015 ] {} RaftInstance: creating a snapshot for index 27 2025.04.02 04:47:57.113958 [ 21015 ] {} RaftInstance: create snapshot idx 27 log_term 27 2025.04.02 04:47:57.113974 [ 21015 ] {} KeeperStateMachine: Creating snapshot 27 2025.04.02 04:47:57.114013 [ 21015 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:47:57.118103 [ 21015 ] {} KeeperStateMachine: Created persistent snapshot 27 with path snapshot_27.bin.zstd 2025.04.02 04:47:57.118121 [ 21015 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:47:57.118128 [ 21015 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:47:57.118153 [ 21015 ] {} RaftInstance: snapshot idx 27 log_term 27 created, compact the log store if needed 2025.04.02 04:47:57.118165 [ 21015 ] {} RaftInstance: create snapshot idx 27 log_term 27 done: 4196 us elapsed 2025.04.02 04:47:57.118473 [ 21599 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:47:57.118505 [ 21600 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:47:57.118558 [ 21612 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:47:57.118609 [ 21608 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:47:57.118474 [ 21601 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:47:57.118685 [ 21605 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:47:57.118484 [ 21602 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:47:57.118616 [ 21603 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:47:57.118615 [ 21607 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:47:57.118505 [ 21604 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:47:57.118657 [ 21609 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:47:57.118530 [ 21606 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:47:57.118706 [ 21610 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:47:57.118720 [ 21611 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:47:57.118729 [ 21613 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:47:57.118787 [ 21614 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:47:57.119790 [ 21015 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:47:57.119869 [ 21597 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:47:57.120354 [ 21015 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:47:57.120495 [ 21015 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:47:57.120509 [ 21015 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:47:57.120525 [ 21015 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:47:57.120539 [ 21015 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:47:57.120803 [ 21015 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:47:57.120850 [ 21015 ] {} Context: Destructing threadpool writer 2025.04.02 04:47:57.122639 [ 21015 ] {} Application: Destroyed global context. 2025.04.02 04:47:57.122875 [ 21015 ] {} Application: Waiting for background threads 2025.04.02 04:47:57.139107 [ 21015 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:47:57.139749 [ 21015 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:47:57.139784 [ 21015 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:47:57.143558 [ 21015 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:47:57.143637 [ 21015 ] {} Application: shutting down 2025.04.02 04:47:57.143646 [ 21015 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:47:57.144421 [ 21016 ] {} BaseDaemon: Received signal -2 2025.04.02 04:47:57.144499 [ 21016 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:47:57.207360 [ 21014 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:47:57.447441 [ 21716 ] {} Application: Will watch for the process with pid 21717 2025.04.02 04:47:57.447626 [ 21717 ] {} Application: Forked a child process to watch 2025.04.02 04:47:57.448422 [ 21717 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:47:57.553749 [ 21717 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 21717 2025.04.02 04:47:57.554292 [ 21717 ] {} Application: starting up 2025.04.02 04:47:57.554313 [ 21717 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:47:57.562622 [ 21717 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:47:57.562703 [ 21717 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:47:57.562755 [ 21717 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:47:57.562767 [ 21717 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:47:57.562793 [ 21717 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:47:57.563559 [ 21717 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:47:57.563735 [ 21717 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:47:57.563749 [ 21717 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:47:57.563820 [ 21717 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:47:57.563833 [ 21717 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:47:57.872596 [ 21717 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:47:57.872763 [ 21717 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:47:57.899430 [ 21717 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:47:57.899507 [ 21717 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:47:57.899629 [ 21717 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:47:57.926038 [ 22234 ] {} CancellationChecker: Started worker function 2025.04.02 04:47:57.926139 [ 21717 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:47:57.926179 [ 21717 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:47:57.926189 [ 21717 ] {} Application: Initializing DateLUT. 2025.04.02 04:47:57.926195 [ 21717 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:47:57.926304 [ 21717 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:47:57.926419 [ 21717 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:47:57.928763 [ 21717 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:47:57.928779 [ 21717 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:47:57.928796 [ 21717 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:47:57.929064 [ 21717 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:47:57.929089 [ 21717 ] {} Application: Initializing interserver credentials. 2025.04.02 04:47:57.929409 [ 21717 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:47:57.930445 [ 21717 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:47:57.930479 [ 21717 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:47:57.930497 [ 21717 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:47:57.930594 [ 21717 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:47:57.932741 [ 21717 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:47:57.932754 [ 21717 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:47:57.934083 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:47:57.934283 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:47:57.934400 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:47:57.934514 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:47:57.934625 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:47:57.935477 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:47:57.935586 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:47:57.935693 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:47:57.935782 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:47:57.935875 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:47:57.935999 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:47:57.936110 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:47:57.936205 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:47:57.936295 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:47:57.936434 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:47:57.936527 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:47:57.936623 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:47:57.936719 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:47:57.936826 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:47:57.936927 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:47:57.937034 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:47:57.937135 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:47:57.937337 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:47:57.937579 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:47:57.937680 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:47:57.937873 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:47:57.938122 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:47:57.938235 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:47:57.938338 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:47:57.938443 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:47:57.938550 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:47:57.938661 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:47:57.938786 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:47:57.938888 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:47:57.939027 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:47:57.939131 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:47:57.939254 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:47:57.939396 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:47:57.939521 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:47:57.939773 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:47:57.939932 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:47:57.940048 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:47:57.940167 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:47:57.940290 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:47:57.940417 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:47:57.940564 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:47:57.940690 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:47:57.940812 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:47:57.940935 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:47:57.941509 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:47:57.941716 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:47:57.941941 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:47:57.942098 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:47:57.942219 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:47:57.942338 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:47:57.942511 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:47:57.942638 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:47:57.942774 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:47:57.942887 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:47:57.943007 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:47:57.943132 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:47:57.943309 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:47:57.943438 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:47:57.943581 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:47:57.943750 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:47:57.943887 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:47:57.944351 [ 21717 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:47:57.962801 [ 21717 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:47:57.963107 [ 21717 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:47:57.973394 [ 21717 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:47:57.973407 [ 21717 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:47:57.973412 [ 21717 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:47:57.976847 [ 21717 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:47:57.976859 [ 21717 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:47:57.976877 [ 21717 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:47:57.976900 [ 21717 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:57.977700 [ 21717 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:57.978330 [ 21717 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:47:57.980514 [ 21717 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:47:57.980587 [ 21717 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:47:57.980609 [ 21717 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:47:57.981168 [ 21717 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:47:57.981318 [ 21717 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:47:57.981421 [ 21717 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:47:57.981833 [ 21717 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:47:57.981857 [ 21717 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:47:57.982193 [ 21717 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:47:57.982200 [ 21717 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:47:57.982204 [ 21717 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:47:57.982212 [ 21717 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:47:57.982217 [ 21717 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:47:57.982256 [ 21717 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:57.982266 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:57.992103 [ 21717 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:57.993579 [ 21717 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:57.993592 [ 21717 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:57.993907 [ 21717 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:57.993997 [ 21717 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp 2025.04.02 04:47:57.994033 [ 21717 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp 2025.04.02 04:47:57.994042 [ 21717 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp, size 4 2025.04.02 04:47:57.994191 [ 21717 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp. 2025.04.02 04:47:57.994313 [ 22291 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp 2025.04.02 04:47:58.000541 [ 22291 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp, size 4 2025.04.02 04:47:58.000715 [ 21717 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/epq/iwzbrlannirpqlfxlyxuieigzkamp. 2025.04.02 04:47:58.000852 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/epq/iwzbrlannirpqlfxlyxuieigzkamp (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.002602 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/epq/iwzbrlannirpqlfxlyxuieigzkamp (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.002618 [ 21717 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/epq/iwzbrlannirpqlfxlyxuieigzkamp, Version: Latest, Offset: 2 2025.04.02 04:47:58.005918 [ 21717 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/epq/iwzbrlannirpqlfxlyxuieigzkamp 2025.04.02 04:47:58.005931 [ 21717 ] {} deleteFileFromS3: Object with path s3/epq/iwzbrlannirpqlfxlyxuieigzkamp was removed from S3 2025.04.02 04:47:58.005956 [ 21717 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:47:58.005963 [ 21717 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:47:58.006539 [ 21717 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:58.007925 [ 21717 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:58.007934 [ 21717 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:58.008059 [ 21717 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:58.013469 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.016501 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.016536 [ 21717 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:47:58.020613 [ 21717 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:47:58.020709 [ 21717 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:47:58 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326078E0390311 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:47:58.020788 [ 21717 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:47:58.024271 [ 21717 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:58.024299 [ 21717 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:47:58.024317 [ 21717 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:47:58.024346 [ 21717 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:47:58.024395 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.024421 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.024445 [ 21717 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:58.024468 [ 21717 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:58.024491 [ 21717 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:47:58.024514 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.024538 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.024560 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.024584 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.024608 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.025880 [ 21717 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:58.028985 [ 21717 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:58.029005 [ 21717 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:58.029347 [ 21717 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:58.033421 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/tlf/xcarbjgudcvkkzuflabrwluczelue (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.035043 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/tlf/xcarbjgudcvkkzuflabrwluczelue (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.035074 [ 21717 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/tlf/xcarbjgudcvkkzuflabrwluczelue, Version: Latest, Offset: 2 2025.04.02 04:47:58.038307 [ 21717 ] {} deleteFileFromS3: No blob storage log, not writing blob special/tlf/xcarbjgudcvkkzuflabrwluczelue 2025.04.02 04:47:58.038353 [ 21717 ] {} deleteFileFromS3: Object with path special/tlf/xcarbjgudcvkkzuflabrwluczelue was removed from S3 2025.04.02 04:47:58.038371 [ 21717 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:47:58.038384 [ 21717 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:47:58.039637 [ 21717 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:47:58.042789 [ 21717 ] {} S3Client: Provider type: Unknown 2025.04.02 04:47:58.042817 [ 21717 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:47:58.043119 [ 21717 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:47:58.047398 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dxw/juiqpbiggwppqdcevhidefepqheoh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.048906 [ 21717 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dxw/juiqpbiggwppqdcevhidefepqheoh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:47:58.048938 [ 21717 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/dxw/juiqpbiggwppqdcevhidefepqheoh, Version: Latest, Offset: 2 2025.04.02 04:47:58.052624 [ 21717 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/dxw/juiqpbiggwppqdcevhidefepqheoh 2025.04.02 04:47:58.052651 [ 21717 ] {} deleteFileFromS3: Object with path test_02944/dxw/juiqpbiggwppqdcevhidefepqheoh was removed from S3 2025.04.02 04:47:58.052668 [ 21717 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:47:58.052681 [ 21717 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:47:58.052718 [ 21717 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:47:58.054902 [ 21717 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:47:58.056810 [ 21717 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:47:58.056911 [ 21717 ] {} KeeperSnapshotManager: Found snapshot_26.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:58.056939 [ 21717 ] {} KeeperSnapshotManager: Found snapshot_25.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:58.056951 [ 21717 ] {} KeeperSnapshotManager: Found snapshot_27.bin.zstd on LocalSnapshotDisk 2025.04.02 04:47:58.057777 [ 21717 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:47:58.057896 [ 21717 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:47:58.058109 [ 21717 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:47:58.058128 [ 21717 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:47:58.058174 [ 21717 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:47:58.058186 [ 21717 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 27 2025.04.02 04:47:58.058584 [ 21717 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:47:58.058665 [ 21717 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 27 2025.04.02 04:47:58.058980 [ 21717 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 27 entries 2025.04.02 04:47:58.059007 [ 21717 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:47:58.059064 [ 21717 ] {} KeeperServer: Last local log idx 27 2025.04.02 04:47:58.059082 [ 21717 ] {} KeeperServer: Will use config from log store with log index 27 2025.04.02 04:47:58.059638 [ 21717 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:47:58.062276 [ 21717 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:47:58.062565 [ 21717 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:47:58.062602 [ 21717 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:47:58.062622 [ 21717 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:47:58.062642 [ 21717 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:47:58.062665 [ 21717 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:47:58.062694 [ 21717 ] {} RaftInstance: === INIT RAFT SERVER === commit index 27 term 27 election timer allowed log store start 1, end 27 config log idx 27, prev log idx 26 -- ASYNC REPLICATION -- 2025.04.02 04:47:58.062714 [ 21717 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:47:58.062764 [ 21717 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:47:58.062909 [ 21717 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:47:58.063032 [ 22318 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:47:58.113141 [ 22301 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:47:58.113176 [ 21717 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:47:58.113210 [ 22301 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:47:58.113375 [ 22301 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 27, state term 27, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:47:58.113391 [ 22301 ] {} RaftInstance: pre-vote term (0) is different, reset it to 27 2025.04.02 04:47:58.113496 [ 22301 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:47:58.117164 [ 22301 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 28, log idx 27, log term 27, priority (target 1 / mine 1) 2025.04.02 04:47:58.117215 [ 22301 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:47:58.117229 [ 22301 ] {} RaftInstance: state machine commit index 27, precommit index 27, last log index 27 2025.04.02 04:47:58.117457 [ 22299 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:47:58.117543 [ 22301 ] {} RaftInstance: [BECOME LEADER] appended new config at 28 2025.04.02 04:47:58.117655 [ 22317 ] {} RaftInstance: config at index 28 is committed, prev config log idx 27 2025.04.02 04:47:58.117696 [ 22317 ] {} RaftInstance: new config log idx 28, prev log idx 27, cur config log idx 27, prev log idx 26 2025.04.02 04:47:58.117721 [ 22317 ] {} RaftInstance: new configuration: log idx 28, prev log idx 27 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 28 2025.04.02 04:47:58.117793 [ 21717 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:47:58.117967 [ 21717 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:47:58.119547 [ 21717 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:47:58.119657 [ 21717 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:47:58.123698 [ 21717 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:47:58.123728 [ 21717 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:47:58.124237 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:47:58.124422 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:47:58.124641 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:47:58.124758 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:47:58.124879 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:47:58.124987 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:47:58.125097 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:47:58.125264 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:47:58.126480 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:47:58.126691 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:47:58.126875 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:47:58.127066 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:47:58.127245 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:47:58.127455 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:47:58.127641 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:47:58.127841 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:47:58.128040 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:47:58.128268 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:47:58.128500 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:47:58.128712 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:47:58.128905 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:47:58.129125 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:47:58.129568 [ 21717 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:47:58.135407 [ 21717 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:47:58.135486 [ 21717 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:47:58.138813 [ 21717 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:47:58.138858 [ 21717 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:47:58.139354 [ 21717 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:47:58.139608 [ 21717 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:47:58.139815 [ 21717 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:47:58.140012 [ 22323 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:47:58.142119 [ 21717 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:47:58.142683 [ 21717 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:47:58.143720 [ 21717 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:47:58.144357 [ 21717 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:47:58.145484 [ 21717 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:47:58.146384 [ 21717 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:47:58.146992 [ 21717 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:47:58.147559 [ 21717 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:47:58.147593 [ 21717 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:47:58.147691 [ 21725 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:47:58.148015 [ 21725 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:02.704118 [ 21717 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:02.704276 [ 21717 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:02.704537 [ 21717 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:02.704557 [ 21717 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:02.704688 [ 22234 ] {} CancellationChecker: Execution took 4778 ms. 2025.04.02 04:48:02.704881 [ 21717 ] {} Application: Shutting down storages. 2025.04.02 04:48:02.704894 [ 21717 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:02.706160 [ 21717 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:02.706175 [ 21717 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:02.706183 [ 21717 ] {} Context: Shutting down named sessions 2025.04.02 04:48:02.706205 [ 21717 ] {} Context: Shutting down database catalog 2025.04.02 04:48:02.706214 [ 21717 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:02.706253 [ 21717 ] {} Context: Shutting down merges executor 2025.04.02 04:48:02.706552 [ 21717 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:02.706842 [ 21717 ] {} Context: Shutting down moves executor 2025.04.02 04:48:02.707014 [ 21717 ] {} Context: Shutting down common executor 2025.04.02 04:48:02.707240 [ 21717 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:02.707248 [ 21717 ] {} Context: Shutting down caches 2025.04.02 04:48:02.707258 [ 21717 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:02.707580 [ 21717 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:02.709896 [ 21717 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:02.710150 [ 21717 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:02.710290 [ 21717 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:02.710503 [ 21717 ] {} Application: Shut down storages. 2025.04.02 04:48:02.710516 [ 21717 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:03.126545 [ 21717 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:03.126588 [ 21717 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:03.126600 [ 21717 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:03.620582 [ 21717 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:03.620660 [ 21717 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:03.620673 [ 21717 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:03.620746 [ 21717 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:03.620757 [ 21717 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:03.620784 [ 21717 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:03.620796 [ 21717 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:03.620907 [ 21717 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:03.620929 [ 22318 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:03.621097 [ 21717 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:03.621127 [ 21717 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:03.621137 [ 21717 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:03.621148 [ 21717 ] {} RaftInstance: manually create a snapshot on 28 2025.04.02 04:48:03.621160 [ 21717 ] {} RaftInstance: creating a snapshot for index 28 2025.04.02 04:48:03.621171 [ 21717 ] {} RaftInstance: create snapshot idx 28 log_term 28 2025.04.02 04:48:03.621227 [ 21717 ] {} KeeperStateMachine: Creating snapshot 28 2025.04.02 04:48:03.621295 [ 21717 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:03.624581 [ 21717 ] {} KeeperStateMachine: Created persistent snapshot 28 with path snapshot_28.bin.zstd 2025.04.02 04:48:03.624606 [ 21717 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:03.624617 [ 21717 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:03.624654 [ 21717 ] {} RaftInstance: snapshot idx 28 log_term 28 created, compact the log store if needed 2025.04.02 04:48:03.624670 [ 21717 ] {} RaftInstance: create snapshot idx 28 log_term 28 done: 3448 us elapsed 2025.04.02 04:48:03.625030 [ 22301 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:03.625073 [ 22303 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:03.625083 [ 22304 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:03.625161 [ 22309 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:03.625228 [ 22312 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:03.625100 [ 22302 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:03.625277 [ 22316 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:03.625170 [ 22308 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:03.625240 [ 22313 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:03.625451 [ 22314 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:03.625245 [ 22311 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:03.625237 [ 22306 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:03.625253 [ 22310 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:03.625282 [ 22315 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:03.625099 [ 22307 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:03.625181 [ 22305 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:03.626214 [ 21717 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:03.626249 [ 22299 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:03.626738 [ 21717 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:03.626892 [ 21717 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:03.626904 [ 21717 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:03.626918 [ 21717 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:03.626931 [ 21717 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:03.627187 [ 21717 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:03.627221 [ 21717 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:03.629080 [ 21717 ] {} Application: Destroyed global context. 2025.04.02 04:48:03.629286 [ 21717 ] {} Application: Waiting for background threads 2025.04.02 04:48:03.644641 [ 21717 ] {} Application: Background threads finished in 15 ms 2025.04.02 04:48:03.645263 [ 21717 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:03.645287 [ 21717 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:03.649928 [ 21717 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:03.650046 [ 21717 ] {} Application: shutting down 2025.04.02 04:48:03.650057 [ 21717 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:03.650956 [ 21718 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:03.651018 [ 21718 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:03.726700 [ 21716 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:04.284685 [ 22422 ] {} Application: Will watch for the process with pid 22423 2025.04.02 04:48:04.284914 [ 22423 ] {} Application: Forked a child process to watch 2025.04.02 04:48:04.285869 [ 22423 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:04.389467 [ 22423 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 22423 2025.04.02 04:48:04.389974 [ 22423 ] {} Application: starting up 2025.04.02 04:48:04.389997 [ 22423 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:04.398167 [ 22423 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:04.398244 [ 22423 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:04.398297 [ 22423 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:04.398308 [ 22423 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:04.398335 [ 22423 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:04.399133 [ 22423 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:04.399322 [ 22423 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:04.399335 [ 22423 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:04.399420 [ 22423 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:04.399435 [ 22423 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:04.698602 [ 22423 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:04.698770 [ 22423 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:04.725621 [ 22423 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:04.725685 [ 22423 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:04.725804 [ 22423 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:04.754617 [ 22423 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:04.754664 [ 22423 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:04.754610 [ 22433 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:04.754674 [ 22423 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:04.754733 [ 22423 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:04.754843 [ 22423 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:04.754938 [ 22423 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:04.757322 [ 22423 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:04.757349 [ 22423 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:04.757385 [ 22423 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:04.757657 [ 22423 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:04.757681 [ 22423 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:04.757967 [ 22423 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:04.759013 [ 22423 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:04.759045 [ 22423 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:04.759064 [ 22423 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:04.759161 [ 22423 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:04.761245 [ 22423 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:04.761257 [ 22423 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:04.762538 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:04.762732 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:04.762830 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:04.762941 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:04.763058 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:04.763886 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:04.763995 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:04.764102 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:04.764191 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:04.764284 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:04.764420 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:04.764516 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:04.764610 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:04.764702 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:04.764827 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:04.764920 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:04.765016 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:04.765112 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:04.765232 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:04.765347 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:04.765466 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:04.765568 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:04.765732 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:04.765966 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:04.766075 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:04.766264 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:04.766519 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:04.766636 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:04.766727 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:04.766831 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:04.766937 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:04.767049 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:04.767173 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:04.767272 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:04.767424 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:04.767529 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:04.767652 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:04.767784 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:04.767901 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:04.768150 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:04.768307 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:04.768433 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:04.768555 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:04.768678 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:04.768797 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:04.768942 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:04.769072 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:04.769217 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:04.769347 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:04.769853 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:04.770045 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:04.770267 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:04.770454 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:04.770578 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:04.770690 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:04.770860 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:04.770988 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:04.771119 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:04.771232 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:04.771353 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:04.771484 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:04.771661 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:04.771777 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:04.771918 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:04.772083 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:04.772214 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:04.772663 [ 22423 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:04.788823 [ 22423 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:04.789120 [ 22423 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:04.799409 [ 22423 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:04.799424 [ 22423 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:04.799430 [ 22423 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:04.802880 [ 22423 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:04.802893 [ 22423 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:04.802911 [ 22423 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:04.802932 [ 22423 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:04.803492 [ 22423 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:04.804215 [ 22423 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:04.806409 [ 22423 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:04.806490 [ 22423 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:04.806516 [ 22423 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:04.807055 [ 22423 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:04.807188 [ 22423 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:04.807281 [ 22423 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:04.807708 [ 22423 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:04.807734 [ 22423 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:04.808064 [ 22423 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:04.808071 [ 22423 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:04.808075 [ 22423 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:04.808083 [ 22423 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:04.808087 [ 22423 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:04.808126 [ 22423 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:04.808137 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.818111 [ 22423 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:04.819568 [ 22423 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:04.819578 [ 22423 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:04.819884 [ 22423 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:04.819972 [ 22423 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp 2025.04.02 04:48:04.820011 [ 22423 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp 2025.04.02 04:48:04.820021 [ 22423 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp, size 4 2025.04.02 04:48:04.820168 [ 22423 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp. 2025.04.02 04:48:04.820295 [ 22997 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp 2025.04.02 04:48:04.826831 [ 22997 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp, size 4 2025.04.02 04:48:04.827019 [ 22423 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/eog/rzknptxefkwocupbigegrnfbryawp. 2025.04.02 04:48:04.827154 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eog/rzknptxefkwocupbigegrnfbryawp (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.828900 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/eog/rzknptxefkwocupbigegrnfbryawp (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.828916 [ 22423 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/eog/rzknptxefkwocupbigegrnfbryawp, Version: Latest, Offset: 2 2025.04.02 04:48:04.832321 [ 22423 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/eog/rzknptxefkwocupbigegrnfbryawp 2025.04.02 04:48:04.832333 [ 22423 ] {} deleteFileFromS3: Object with path s3/eog/rzknptxefkwocupbigegrnfbryawp was removed from S3 2025.04.02 04:48:04.832358 [ 22423 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:04.832375 [ 22423 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:04.832902 [ 22423 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:04.834293 [ 22423 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:04.834301 [ 22423 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:04.834434 [ 22423 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:04.840388 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.842831 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.842847 [ 22423 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:04.846250 [ 22423 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:04.846287 [ 22423 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:04 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832607A77130896 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:04.846314 [ 22423 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:04.849171 [ 22423 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:04.849215 [ 22423 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:04.849232 [ 22423 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:04.849243 [ 22423 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:04.849279 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.849300 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.849320 [ 22423 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:04.849351 [ 22423 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:04.849393 [ 22423 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:04.849410 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.849426 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.849442 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.849458 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.849474 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.850287 [ 22423 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:04.852380 [ 22423 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:04.852392 [ 22423 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:04.852588 [ 22423 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:04.857476 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/eol/fkedfitezyecxdndilxwuqlphoxan (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.858829 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/eol/fkedfitezyecxdndilxwuqlphoxan (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.858851 [ 22423 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/eol/fkedfitezyecxdndilxwuqlphoxan, Version: Latest, Offset: 2 2025.04.02 04:48:04.861952 [ 22423 ] {} deleteFileFromS3: No blob storage log, not writing blob special/eol/fkedfitezyecxdndilxwuqlphoxan 2025.04.02 04:48:04.861970 [ 22423 ] {} deleteFileFromS3: Object with path special/eol/fkedfitezyecxdndilxwuqlphoxan was removed from S3 2025.04.02 04:48:04.861983 [ 22423 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:04.861992 [ 22423 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:04.862829 [ 22423 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:04.864899 [ 22423 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:04.864910 [ 22423 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:04.865105 [ 22423 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:04.869630 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mpk/feqiwdrqnciisilvngkypqrewwksh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.871005 [ 22423 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mpk/feqiwdrqnciisilvngkypqrewwksh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:04.871027 [ 22423 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/mpk/feqiwdrqnciisilvngkypqrewwksh, Version: Latest, Offset: 2 2025.04.02 04:48:04.874063 [ 22423 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/mpk/feqiwdrqnciisilvngkypqrewwksh 2025.04.02 04:48:04.874082 [ 22423 ] {} deleteFileFromS3: Object with path test_02944/mpk/feqiwdrqnciisilvngkypqrewwksh was removed from S3 2025.04.02 04:48:04.874094 [ 22423 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:04.874102 [ 22423 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:04.874136 [ 22423 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:04.875770 [ 22423 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:04.877330 [ 22423 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:04.877423 [ 22423 ] {} KeeperSnapshotManager: Found snapshot_26.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:04.877446 [ 22423 ] {} KeeperSnapshotManager: Found snapshot_27.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:04.877457 [ 22423 ] {} KeeperSnapshotManager: Found snapshot_28.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:04.877955 [ 22423 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:04.878009 [ 22423 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:04.878152 [ 22423 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:04.878165 [ 22423 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:04.878209 [ 22423 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:04.878218 [ 22423 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 28 2025.04.02 04:48:04.878585 [ 22423 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:04.878639 [ 22423 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 28 2025.04.02 04:48:04.878898 [ 22423 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 28 entries 2025.04.02 04:48:04.878918 [ 22423 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:04.878959 [ 22423 ] {} KeeperServer: Last local log idx 28 2025.04.02 04:48:04.878972 [ 22423 ] {} KeeperServer: Will use config from log store with log index 28 2025.04.02 04:48:04.879331 [ 22423 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:04.881411 [ 22423 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:04.881688 [ 22423 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:04.881717 [ 22423 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:04.881731 [ 22423 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:04.881744 [ 22423 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:04.881753 [ 22423 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:04.881769 [ 22423 ] {} RaftInstance: === INIT RAFT SERVER === commit index 28 term 28 election timer allowed log store start 1, end 28 config log idx 28, prev log idx 27 -- ASYNC REPLICATION -- 2025.04.02 04:48:04.881787 [ 22423 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:04.881824 [ 22423 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:04.881935 [ 22423 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:04.881997 [ 23024 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:04.932175 [ 22423 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:04.932154 [ 23007 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:04.932264 [ 23007 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:04.932337 [ 23007 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 28, state term 28, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:04.932351 [ 23007 ] {} RaftInstance: pre-vote term (0) is different, reset it to 28 2025.04.02 04:48:04.932486 [ 23007 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:04.935400 [ 23007 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 29, log idx 28, log term 28, priority (target 1 / mine 1) 2025.04.02 04:48:04.935427 [ 23007 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:04.935439 [ 23007 ] {} RaftInstance: state machine commit index 28, precommit index 28, last log index 28 2025.04.02 04:48:04.935646 [ 23005 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:04.935746 [ 23007 ] {} RaftInstance: [BECOME LEADER] appended new config at 29 2025.04.02 04:48:04.935902 [ 23023 ] {} RaftInstance: config at index 29 is committed, prev config log idx 28 2025.04.02 04:48:04.935942 [ 23023 ] {} RaftInstance: new config log idx 29, prev log idx 28, cur config log idx 28, prev log idx 27 2025.04.02 04:48:04.935973 [ 23023 ] {} RaftInstance: new configuration: log idx 29, prev log idx 28 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 29 2025.04.02 04:48:04.936036 [ 22423 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:04.936195 [ 22423 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:04.937728 [ 22423 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:04.937829 [ 22423 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:04.941773 [ 22423 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:04.941798 [ 22423 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:04.942270 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:04.942443 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:04.942653 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:04.942769 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:04.942868 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:04.942966 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:04.943070 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:04.943200 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:04.944327 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:04.944528 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:04.944697 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:04.944887 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:04.945063 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:04.945275 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:04.945484 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:04.945688 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:04.945866 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:04.946085 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:04.946270 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:04.946478 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:04.946669 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:04.946868 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:04.947224 [ 22423 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:04.951988 [ 22423 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:04.952061 [ 22423 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:04.955257 [ 22423 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:04.955298 [ 22423 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:04.955737 [ 22423 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:04.955984 [ 22423 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:04.956175 [ 22423 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:04.956465 [ 23029 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:04.958264 [ 22423 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:04.958782 [ 22423 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:04.959896 [ 22423 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:04.960383 [ 22423 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:04.961568 [ 22423 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:04.962159 [ 22423 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:04.962812 [ 22423 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:04.963386 [ 22423 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:04.963418 [ 22423 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:04.963509 [ 22430 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:04.963808 [ 22430 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:09.257091 [ 22423 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:09.257259 [ 22423 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:09.257519 [ 22423 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:09.257535 [ 22423 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:09.257677 [ 22433 ] {} CancellationChecker: Execution took 4503 ms. 2025.04.02 04:48:09.257872 [ 22423 ] {} Application: Shutting down storages. 2025.04.02 04:48:09.257885 [ 22423 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:09.259107 [ 22423 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:09.259127 [ 22423 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:09.259137 [ 22423 ] {} Context: Shutting down named sessions 2025.04.02 04:48:09.259175 [ 22423 ] {} Context: Shutting down database catalog 2025.04.02 04:48:09.259186 [ 22423 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:09.259240 [ 22423 ] {} Context: Shutting down merges executor 2025.04.02 04:48:09.259544 [ 22423 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:09.259739 [ 22423 ] {} Context: Shutting down moves executor 2025.04.02 04:48:09.259916 [ 22423 ] {} Context: Shutting down common executor 2025.04.02 04:48:09.260136 [ 22423 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:09.260149 [ 22423 ] {} Context: Shutting down caches 2025.04.02 04:48:09.260163 [ 22423 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:09.260586 [ 22423 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:09.263488 [ 22423 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:09.263813 [ 22423 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:09.263970 [ 22423 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:09.264195 [ 22423 ] {} Application: Shut down storages. 2025.04.02 04:48:09.264211 [ 22423 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:09.444019 [ 22423 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:09.444058 [ 22423 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:09.444070 [ 22423 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:09.938235 [ 22423 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:09.938294 [ 22423 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:09.938305 [ 22423 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:09.938377 [ 22423 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:09.938388 [ 22423 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:09.938425 [ 22423 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:09.938437 [ 22423 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:09.938534 [ 22423 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:09.938556 [ 23024 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:09.938656 [ 22423 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:09.938670 [ 22423 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:09.938679 [ 22423 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:09.938690 [ 22423 ] {} RaftInstance: manually create a snapshot on 29 2025.04.02 04:48:09.938702 [ 22423 ] {} RaftInstance: creating a snapshot for index 29 2025.04.02 04:48:09.938713 [ 22423 ] {} RaftInstance: create snapshot idx 29 log_term 29 2025.04.02 04:48:09.938735 [ 22423 ] {} KeeperStateMachine: Creating snapshot 29 2025.04.02 04:48:09.938790 [ 22423 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:09.941367 [ 22423 ] {} KeeperStateMachine: Created persistent snapshot 29 with path snapshot_29.bin.zstd 2025.04.02 04:48:09.941411 [ 22423 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:09.941423 [ 22423 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:09.941459 [ 22423 ] {} RaftInstance: snapshot idx 29 log_term 29 created, compact the log store if needed 2025.04.02 04:48:09.941475 [ 22423 ] {} RaftInstance: create snapshot idx 29 log_term 29 done: 2747 us elapsed 2025.04.02 04:48:09.941875 [ 23009 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:09.941916 [ 23014 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:09.941895 [ 23013 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:09.941895 [ 23011 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:09.942079 [ 23017 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:09.941895 [ 23008 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:09.941932 [ 23010 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:09.941974 [ 23012 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:09.941980 [ 23015 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:09.941994 [ 23019 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:09.942019 [ 23022 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:09.942041 [ 23018 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:09.941906 [ 23007 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:09.942081 [ 23021 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:09.942083 [ 23016 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:09.942088 [ 23020 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:09.943131 [ 22423 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:09.943157 [ 23005 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:09.943580 [ 22423 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:09.943666 [ 22423 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:09.943678 [ 22423 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:09.943693 [ 22423 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:09.943706 [ 22423 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:09.943909 [ 22423 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:09.943946 [ 22423 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:09.945719 [ 22423 ] {} Application: Destroyed global context. 2025.04.02 04:48:09.945933 [ 22423 ] {} Application: Waiting for background threads 2025.04.02 04:48:09.962140 [ 22423 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:09.962795 [ 22423 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:09.962815 [ 22423 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:09.967385 [ 22423 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:09.967520 [ 22423 ] {} Application: shutting down 2025.04.02 04:48:09.967532 [ 22423 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:09.968536 [ 22424 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:09.968583 [ 22424 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:10.050141 [ 22422 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:10.308275 [ 23124 ] {} Application: Will watch for the process with pid 23125 2025.04.02 04:48:10.308520 [ 23125 ] {} Application: Forked a child process to watch 2025.04.02 04:48:10.309412 [ 23125 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:10.413357 [ 23125 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 23125 2025.04.02 04:48:10.413803 [ 23125 ] {} Application: starting up 2025.04.02 04:48:10.413821 [ 23125 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:10.422306 [ 23125 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:10.422387 [ 23125 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:10.422458 [ 23125 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:10.422474 [ 23125 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:10.422503 [ 23125 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:10.423347 [ 23125 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:10.423535 [ 23125 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:10.423553 [ 23125 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:10.423624 [ 23125 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:10.423638 [ 23125 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:10.720573 [ 23125 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:10.720743 [ 23125 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:10.747510 [ 23125 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:10.747575 [ 23125 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:10.747705 [ 23125 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:10.782725 [ 23134 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:10.782856 [ 23125 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:10.782884 [ 23125 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:10.782900 [ 23125 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:10.782911 [ 23125 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:10.783102 [ 23125 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:10.783298 [ 23125 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:10.788598 [ 23125 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:10.788643 [ 23125 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:10.788688 [ 23125 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:10.789162 [ 23125 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:10.789248 [ 23125 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:10.789874 [ 23125 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:10.792244 [ 23125 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:10.792320 [ 23125 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:10.792366 [ 23125 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:10.792608 [ 23125 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:10.796808 [ 23125 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:10.796834 [ 23125 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:10.799849 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:10.800274 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:10.800536 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:10.800799 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:10.801046 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:10.803048 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:10.803295 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:10.803551 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:10.803751 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:10.803954 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:10.804229 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:10.804460 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:10.804697 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:10.804894 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:10.805170 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:10.805446 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:10.805706 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:10.805939 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:10.806172 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:10.806390 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:10.806637 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:10.806861 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:10.807225 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:10.807769 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:10.807997 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:10.808380 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:10.808979 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:10.809341 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:10.809614 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:10.809876 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:10.810108 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:10.810351 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:10.810641 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:10.810860 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:10.811177 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:10.811421 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:10.811695 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:10.811987 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:10.812243 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:10.812819 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:10.813172 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:10.813476 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:10.813747 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:10.814018 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:10.814281 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:10.814624 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:10.814904 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:10.815174 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:10.815523 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:10.816295 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:10.816624 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:10.817009 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:10.817310 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:10.817544 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:10.817738 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:10.818042 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:10.818256 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:10.818497 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:10.818690 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:10.818891 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:10.819086 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:10.819382 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:10.819603 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:10.819842 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:10.820127 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:10.820348 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:10.821121 [ 23125 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:10.854752 [ 23125 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:10.855063 [ 23125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:10.865504 [ 23125 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:10.865517 [ 23125 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:10.865522 [ 23125 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:10.868972 [ 23125 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:10.868984 [ 23125 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:10.869001 [ 23125 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:10.869024 [ 23125 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:10.869949 [ 23125 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:10.870727 [ 23125 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:10.874061 [ 23125 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:10.874173 [ 23125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:10.874214 [ 23125 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:10.875082 [ 23125 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:10.875279 [ 23125 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:10.875442 [ 23125 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:10.876049 [ 23125 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:10.876084 [ 23125 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:10.876599 [ 23125 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:10.876610 [ 23125 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:10.876617 [ 23125 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:10.876628 [ 23125 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:10.876635 [ 23125 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:10.876691 [ 23125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:10.876708 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.891691 [ 23125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:10.893878 [ 23125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:10.893897 [ 23125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:10.894326 [ 23125 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:10.894465 [ 23125 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz 2025.04.02 04:48:10.894515 [ 23125 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz 2025.04.02 04:48:10.894528 [ 23125 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz, size 4 2025.04.02 04:48:10.894723 [ 23125 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz. 2025.04.02 04:48:10.894897 [ 23699 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz 2025.04.02 04:48:10.901983 [ 23699 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz, size 4 2025.04.02 04:48:10.902233 [ 23125 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz. 2025.04.02 04:48:10.902447 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.904517 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.904539 [ 23125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz, Version: Latest, Offset: 2 2025.04.02 04:48:10.908073 [ 23125 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz 2025.04.02 04:48:10.908091 [ 23125 ] {} deleteFileFromS3: Object with path s3/hfw/ptuixvinzxyfcyyqbqwsxupqykeyz was removed from S3 2025.04.02 04:48:10.908128 [ 23125 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:10.908138 [ 23125 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:10.908942 [ 23125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:10.911050 [ 23125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:10.911067 [ 23125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:10.911252 [ 23125 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:10.917562 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.920250 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.920272 [ 23125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:10.924666 [ 23125 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:10.924756 [ 23125 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:10 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832607BE15CC2E9 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:10.924818 [ 23125 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:10.928603 [ 23125 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:10.928630 [ 23125 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:10.928645 [ 23125 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:10.928655 [ 23125 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:10.928723 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.928741 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.928757 [ 23125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:10.928774 [ 23125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:10.928790 [ 23125 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:10.928806 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.928822 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.928838 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.928854 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.928870 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.930046 [ 23125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:10.932304 [ 23125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:10.932323 [ 23125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:10.932581 [ 23125 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:10.937468 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/lnu/xrbbuqonjbxzgycnsbxgjckeegclh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.939105 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/lnu/xrbbuqonjbxzgycnsbxgjckeegclh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.939138 [ 23125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/lnu/xrbbuqonjbxzgycnsbxgjckeegclh, Version: Latest, Offset: 2 2025.04.02 04:48:10.943103 [ 23125 ] {} deleteFileFromS3: No blob storage log, not writing blob special/lnu/xrbbuqonjbxzgycnsbxgjckeegclh 2025.04.02 04:48:10.943130 [ 23125 ] {} deleteFileFromS3: Object with path special/lnu/xrbbuqonjbxzgycnsbxgjckeegclh was removed from S3 2025.04.02 04:48:10.943148 [ 23125 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:10.943161 [ 23125 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:10.944378 [ 23125 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:10.947366 [ 23125 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:10.947386 [ 23125 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:10.947686 [ 23125 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:10.952193 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jdc/xkzuttfrjefjggjmrwnupussmtiom (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.953926 [ 23125 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jdc/xkzuttfrjefjggjmrwnupussmtiom (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:10.953956 [ 23125 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/jdc/xkzuttfrjefjggjmrwnupussmtiom, Version: Latest, Offset: 2 2025.04.02 04:48:10.957479 [ 23125 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/jdc/xkzuttfrjefjggjmrwnupussmtiom 2025.04.02 04:48:10.957506 [ 23125 ] {} deleteFileFromS3: Object with path test_02944/jdc/xkzuttfrjefjggjmrwnupussmtiom was removed from S3 2025.04.02 04:48:10.957524 [ 23125 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:10.957537 [ 23125 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:10.957577 [ 23125 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:10.960021 [ 23125 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:10.962345 [ 23125 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:10.962486 [ 23125 ] {} KeeperSnapshotManager: Found snapshot_29.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:10.962516 [ 23125 ] {} KeeperSnapshotManager: Found snapshot_27.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:10.962528 [ 23125 ] {} KeeperSnapshotManager: Found snapshot_28.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:10.963254 [ 23125 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:10.963335 [ 23125 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:10.963557 [ 23125 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:10.963582 [ 23125 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:10.963638 [ 23125 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:10.963658 [ 23125 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 29 2025.04.02 04:48:10.964088 [ 23125 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:10.964171 [ 23125 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 29 2025.04.02 04:48:10.964504 [ 23125 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 29 entries 2025.04.02 04:48:10.964531 [ 23125 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:10.964588 [ 23125 ] {} KeeperServer: Last local log idx 29 2025.04.02 04:48:10.964607 [ 23125 ] {} KeeperServer: Will use config from log store with log index 29 2025.04.02 04:48:10.965137 [ 23125 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:10.967635 [ 23125 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:10.967980 [ 23125 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:10.968022 [ 23125 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:10.968053 [ 23125 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:10.968073 [ 23125 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:10.968085 [ 23125 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:10.968109 [ 23125 ] {} RaftInstance: === INIT RAFT SERVER === commit index 29 term 29 election timer allowed log store start 1, end 29 config log idx 29, prev log idx 28 -- ASYNC REPLICATION -- 2025.04.02 04:48:10.968134 [ 23125 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:10.968185 [ 23125 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:10.968334 [ 23125 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:10.968427 [ 23726 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:11.018609 [ 23125 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:11.018601 [ 23709 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:11.018673 [ 23709 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:11.018755 [ 23709 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 29, state term 29, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:11.018768 [ 23709 ] {} RaftInstance: pre-vote term (0) is different, reset it to 29 2025.04.02 04:48:11.018903 [ 23709 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:11.021533 [ 23709 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 30, log idx 29, log term 29, priority (target 1 / mine 1) 2025.04.02 04:48:11.021563 [ 23709 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:11.021575 [ 23709 ] {} RaftInstance: state machine commit index 29, precommit index 29, last log index 29 2025.04.02 04:48:11.021778 [ 23707 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:11.021864 [ 23709 ] {} RaftInstance: [BECOME LEADER] appended new config at 30 2025.04.02 04:48:11.021969 [ 23725 ] {} RaftInstance: config at index 30 is committed, prev config log idx 29 2025.04.02 04:48:11.022003 [ 23725 ] {} RaftInstance: new config log idx 30, prev log idx 29, cur config log idx 29, prev log idx 28 2025.04.02 04:48:11.022026 [ 23725 ] {} RaftInstance: new configuration: log idx 30, prev log idx 29 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 30 2025.04.02 04:48:11.022129 [ 23125 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:11.022354 [ 23125 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:11.023982 [ 23125 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:11.024085 [ 23125 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:11.028103 [ 23125 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:11.028129 [ 23125 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:11.028628 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:11.028787 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:11.028995 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:11.029111 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:11.029257 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:11.029383 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:11.029512 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:11.029647 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:11.030790 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:11.030975 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:11.031141 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:11.031315 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:11.031506 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:11.031677 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:11.031846 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:11.032042 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:11.032217 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:11.032453 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:11.032640 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:11.032833 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:11.033031 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:11.033292 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:11.033700 [ 23125 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:11.040002 [ 23125 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:11.040077 [ 23125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:11.043449 [ 23125 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:11.043493 [ 23125 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:11.043903 [ 23125 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:11.044149 [ 23125 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:11.044340 [ 23125 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:11.044641 [ 23731 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:11.046465 [ 23125 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:11.046995 [ 23125 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:11.048159 [ 23125 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:11.048713 [ 23125 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:11.049981 [ 23125 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:11.050639 [ 23125 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:11.051227 [ 23125 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:11.051797 [ 23125 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:11.051830 [ 23125 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:11.051922 [ 23133 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:11.052221 [ 23133 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:15.675378 [ 23125 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:15.675537 [ 23125 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:15.675821 [ 23125 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:15.675835 [ 23125 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:15.675947 [ 23134 ] {} CancellationChecker: Execution took 4893 ms. 2025.04.02 04:48:15.676121 [ 23125 ] {} Application: Shutting down storages. 2025.04.02 04:48:15.676134 [ 23125 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:15.677818 [ 23125 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:15.677832 [ 23125 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:15.677840 [ 23125 ] {} Context: Shutting down named sessions 2025.04.02 04:48:15.677862 [ 23125 ] {} Context: Shutting down database catalog 2025.04.02 04:48:15.677870 [ 23125 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:15.677911 [ 23125 ] {} Context: Shutting down merges executor 2025.04.02 04:48:15.678561 [ 23125 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:15.678812 [ 23125 ] {} Context: Shutting down moves executor 2025.04.02 04:48:15.679063 [ 23125 ] {} Context: Shutting down common executor 2025.04.02 04:48:15.679219 [ 23125 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:15.679235 [ 23125 ] {} Context: Shutting down caches 2025.04.02 04:48:15.679248 [ 23125 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:15.679736 [ 23125 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:15.682934 [ 23125 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:15.683321 [ 23125 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:15.683537 [ 23125 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:15.683760 [ 23125 ] {} Application: Shut down storages. 2025.04.02 04:48:15.683775 [ 23125 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:15.780620 [ 23125 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:15.780648 [ 23125 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:15.780660 [ 23125 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:16.024779 [ 23125 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:16.024833 [ 23125 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:16.024846 [ 23125 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:16.024921 [ 23125 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:16.024939 [ 23125 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:16.024956 [ 23125 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:16.024968 [ 23125 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:16.025298 [ 23125 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:16.025293 [ 23726 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:16.025392 [ 23125 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:16.025406 [ 23125 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:16.025450 [ 23125 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:16.025462 [ 23125 ] {} RaftInstance: manually create a snapshot on 30 2025.04.02 04:48:16.025474 [ 23125 ] {} RaftInstance: creating a snapshot for index 30 2025.04.02 04:48:16.025485 [ 23125 ] {} RaftInstance: create snapshot idx 30 log_term 30 2025.04.02 04:48:16.025506 [ 23125 ] {} KeeperStateMachine: Creating snapshot 30 2025.04.02 04:48:16.025552 [ 23125 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:16.029025 [ 23125 ] {} KeeperStateMachine: Created persistent snapshot 30 with path snapshot_30.bin.zstd 2025.04.02 04:48:16.029050 [ 23125 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:16.029061 [ 23125 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:16.029096 [ 23125 ] {} RaftInstance: snapshot idx 30 log_term 30 created, compact the log store if needed 2025.04.02 04:48:16.029112 [ 23125 ] {} RaftInstance: create snapshot idx 30 log_term 30 done: 3612 us elapsed 2025.04.02 04:48:16.029517 [ 23709 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:16.029564 [ 23711 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:16.029648 [ 23717 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:16.029664 [ 23718 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:16.029720 [ 23716 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:16.029746 [ 23720 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:16.029613 [ 23713 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:16.029518 [ 23710 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:16.029691 [ 23722 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:16.029696 [ 23724 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:16.029701 [ 23715 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:16.029574 [ 23712 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:16.029797 [ 23721 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:16.029798 [ 23723 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:16.029612 [ 23714 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:16.029696 [ 23719 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:16.030579 [ 23125 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:16.030658 [ 23707 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:16.031105 [ 23125 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:16.031204 [ 23125 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:16.031217 [ 23125 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:16.031231 [ 23125 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:16.031244 [ 23125 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:16.031455 [ 23125 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:16.031487 [ 23125 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:16.033076 [ 23125 ] {} Application: Destroyed global context. 2025.04.02 04:48:16.033312 [ 23125 ] {} Application: Waiting for background threads 2025.04.02 04:48:16.049452 [ 23125 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:16.050134 [ 23125 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:16.050154 [ 23125 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:16.055242 [ 23125 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:16.055379 [ 23125 ] {} Application: shutting down 2025.04.02 04:48:16.055390 [ 23125 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:16.056396 [ 23126 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:16.056460 [ 23126 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:16.135809 [ 23124 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:16.327872 [ 23826 ] {} Application: Will watch for the process with pid 23827 2025.04.02 04:48:16.328016 [ 23827 ] {} Application: Forked a child process to watch 2025.04.02 04:48:16.328613 [ 23827 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:16.398693 [ 23827 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 23827 2025.04.02 04:48:16.399119 [ 23827 ] {} Application: starting up 2025.04.02 04:48:16.399139 [ 23827 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:16.407298 [ 23827 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:16.407372 [ 23827 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:16.407423 [ 23827 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:16.407443 [ 23827 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:16.407471 [ 23827 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:16.408348 [ 23827 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:16.408538 [ 23827 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:16.408552 [ 23827 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:16.408618 [ 23827 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:16.408632 [ 23827 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:16.704850 [ 23827 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:16.705025 [ 23827 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:16.731768 [ 23827 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:16.731872 [ 23827 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:16.732011 [ 23827 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:16.767164 [ 23835 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:16.767310 [ 23827 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:16.767367 [ 23827 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:16.767385 [ 23827 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:16.767397 [ 23827 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:16.767598 [ 23827 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:16.767788 [ 23827 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:16.772998 [ 23827 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:16.773035 [ 23827 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:16.773072 [ 23827 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:16.773575 [ 23827 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:16.773630 [ 23827 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:16.774236 [ 23827 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:16.776584 [ 23827 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:16.776656 [ 23827 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:16.776695 [ 23827 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:16.776887 [ 23827 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:16.781287 [ 23827 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:16.781320 [ 23827 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:16.784343 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:16.784799 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:16.785017 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:16.785300 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:16.785573 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:16.787515 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:16.787757 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:16.787997 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:16.788195 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:16.788420 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:16.788720 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:16.788929 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:16.789143 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:16.789380 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:16.789685 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:16.789899 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:16.790115 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:16.790331 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:16.790590 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:16.790822 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:16.791059 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:16.791288 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:16.791690 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:16.792053 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:16.792210 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:16.792495 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:16.792873 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:16.793045 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:16.793183 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:16.793363 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:16.793537 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:16.793708 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:16.793898 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:16.794047 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:16.794262 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:16.794419 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:16.794632 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:16.794835 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:16.795033 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:16.795468 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:16.795720 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:16.795896 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:16.796078 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:16.796265 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:16.796457 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:16.796678 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:16.796867 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:16.797052 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:16.797305 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:16.798100 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:16.798394 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:16.798749 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:16.798987 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:16.799170 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:16.799340 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:16.799614 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:16.799810 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:16.800009 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:16.800179 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:16.800361 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:16.800553 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:16.800825 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:16.801004 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:16.801258 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:16.801534 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:16.801734 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:16.802471 [ 23827 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:16.828386 [ 23827 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:16.828693 [ 23827 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:16.838999 [ 23827 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:16.839011 [ 23827 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:16.839016 [ 23827 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:16.842547 [ 23827 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:16.842560 [ 23827 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:16.842575 [ 23827 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:16.842598 [ 23827 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:16.843398 [ 23827 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:16.844163 [ 23827 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:16.846349 [ 23827 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:16.846462 [ 23827 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:16.846488 [ 23827 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:16.847078 [ 23827 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:16.847210 [ 23827 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:16.847309 [ 23827 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:16.847745 [ 23827 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:16.847774 [ 23827 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:16.848104 [ 23827 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:16.848111 [ 23827 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:16.848116 [ 23827 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:16.848124 [ 23827 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:16.848128 [ 23827 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:16.848169 [ 23827 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:16.848180 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.858399 [ 23827 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:16.859823 [ 23827 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:16.859835 [ 23827 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:16.860132 [ 23827 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:16.860223 [ 23827 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa 2025.04.02 04:48:16.860258 [ 23827 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa 2025.04.02 04:48:16.860267 [ 23827 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa, size 4 2025.04.02 04:48:16.860411 [ 23827 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa. 2025.04.02 04:48:16.860530 [ 24401 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa 2025.04.02 04:48:16.867619 [ 24401 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa, size 4 2025.04.02 04:48:16.867850 [ 23827 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa. 2025.04.02 04:48:16.868040 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.870127 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.870149 [ 23827 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa, Version: Latest, Offset: 2 2025.04.02 04:48:16.874155 [ 23827 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa 2025.04.02 04:48:16.874174 [ 23827 ] {} deleteFileFromS3: Object with path s3/axt/cqfhcuqiegaztxxwrntoouusjnjsa was removed from S3 2025.04.02 04:48:16.874212 [ 23827 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:16.874222 [ 23827 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:16.875040 [ 23827 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:16.877025 [ 23827 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:16.877037 [ 23827 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:16.877252 [ 23827 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:16.883815 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.886488 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.886512 [ 23827 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:16.889992 [ 23827 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:16.890047 [ 23827 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:16 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832607D44EF6F32 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:16.890091 [ 23827 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:16.893537 [ 23827 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:16.893586 [ 23827 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:16.893615 [ 23827 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:16.893631 [ 23827 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:16.893739 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.893766 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.893790 [ 23827 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:16.893815 [ 23827 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:16.893838 [ 23827 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:16.893862 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.893885 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.893908 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.893931 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.893954 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.895305 [ 23827 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:16.898341 [ 23827 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:16.898365 [ 23827 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:16.898695 [ 23827 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:16.903687 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ymp/vwbtetcmkqvymewpbcwriuhamgdvm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.905527 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ymp/vwbtetcmkqvymewpbcwriuhamgdvm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.905560 [ 23827 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ymp/vwbtetcmkqvymewpbcwriuhamgdvm, Version: Latest, Offset: 2 2025.04.02 04:48:16.909121 [ 23827 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ymp/vwbtetcmkqvymewpbcwriuhamgdvm 2025.04.02 04:48:16.909147 [ 23827 ] {} deleteFileFromS3: Object with path special/ymp/vwbtetcmkqvymewpbcwriuhamgdvm was removed from S3 2025.04.02 04:48:16.909166 [ 23827 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:16.909180 [ 23827 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:16.910543 [ 23827 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:16.913558 [ 23827 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:16.913578 [ 23827 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:16.913873 [ 23827 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:16.918355 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/zlx/jozphohenvynsblhgsndebrkegdwb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.920080 [ 23827 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/zlx/jozphohenvynsblhgsndebrkegdwb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:16.920112 [ 23827 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/zlx/jozphohenvynsblhgsndebrkegdwb, Version: Latest, Offset: 2 2025.04.02 04:48:16.924049 [ 23827 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/zlx/jozphohenvynsblhgsndebrkegdwb 2025.04.02 04:48:16.924082 [ 23827 ] {} deleteFileFromS3: Object with path test_02944/zlx/jozphohenvynsblhgsndebrkegdwb was removed from S3 2025.04.02 04:48:16.924104 [ 23827 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:16.924120 [ 23827 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:16.924172 [ 23827 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:16.926685 [ 23827 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:16.928660 [ 23827 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:16.928769 [ 23827 ] {} KeeperSnapshotManager: Found snapshot_30.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:16.928799 [ 23827 ] {} KeeperSnapshotManager: Found snapshot_29.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:16.928812 [ 23827 ] {} KeeperSnapshotManager: Found snapshot_28.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:16.929629 [ 23827 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:16.929715 [ 23827 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:16.929926 [ 23827 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:16.929944 [ 23827 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:16.929983 [ 23827 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:16.929995 [ 23827 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 30 2025.04.02 04:48:16.930356 [ 23827 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:16.930432 [ 23827 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 30 2025.04.02 04:48:16.930745 [ 23827 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 30 entries 2025.04.02 04:48:16.930771 [ 23827 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:16.930829 [ 23827 ] {} KeeperServer: Last local log idx 30 2025.04.02 04:48:16.930847 [ 23827 ] {} KeeperServer: Will use config from log store with log index 30 2025.04.02 04:48:16.931385 [ 23827 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:16.934058 [ 23827 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:16.934345 [ 23827 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:16.934384 [ 23827 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:16.934414 [ 23827 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:16.934435 [ 23827 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:16.934470 [ 23827 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:16.934495 [ 23827 ] {} RaftInstance: === INIT RAFT SERVER === commit index 30 term 30 election timer allowed log store start 1, end 30 config log idx 30, prev log idx 29 -- ASYNC REPLICATION -- 2025.04.02 04:48:16.934520 [ 23827 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:16.934572 [ 23827 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:16.934714 [ 23827 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:16.934786 [ 24428 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:16.984992 [ 23827 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:16.984975 [ 24411 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:16.985054 [ 24411 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:16.985123 [ 24411 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 30, state term 30, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:16.985136 [ 24411 ] {} RaftInstance: pre-vote term (0) is different, reset it to 30 2025.04.02 04:48:16.985306 [ 24411 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:16.987932 [ 24411 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 31, log idx 30, log term 30, priority (target 1 / mine 1) 2025.04.02 04:48:16.987959 [ 24411 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:16.987971 [ 24411 ] {} RaftInstance: state machine commit index 30, precommit index 30, last log index 30 2025.04.02 04:48:16.988215 [ 24409 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:16.988325 [ 24411 ] {} RaftInstance: [BECOME LEADER] appended new config at 31 2025.04.02 04:48:16.988412 [ 24427 ] {} RaftInstance: config at index 31 is committed, prev config log idx 30 2025.04.02 04:48:16.988457 [ 24427 ] {} RaftInstance: new config log idx 31, prev log idx 30, cur config log idx 30, prev log idx 29 2025.04.02 04:48:16.988480 [ 24427 ] {} RaftInstance: new configuration: log idx 31, prev log idx 30 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 31 2025.04.02 04:48:16.988578 [ 23827 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:16.988778 [ 23827 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:16.990344 [ 23827 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:16.990481 [ 23827 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:16.994418 [ 23827 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:16.994456 [ 23827 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:16.994957 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:16.995114 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:16.995319 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:16.995433 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:16.995559 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:16.995657 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:16.995764 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:16.995897 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:16.997047 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:16.997263 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:16.997461 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:16.997644 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:16.997821 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:16.997994 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:16.998200 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:16.998469 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:16.998662 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:16.998884 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:16.999071 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:16.999268 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:16.999473 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:16.999681 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:17.000043 [ 23827 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:17.005700 [ 23827 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:17.005775 [ 23827 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:17.009010 [ 23827 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:17.009050 [ 23827 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:17.009615 [ 23827 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:17.009866 [ 23827 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:17.010064 [ 23827 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:17.010281 [ 24433 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:17.012015 [ 23827 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:17.012519 [ 23827 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:17.013434 [ 23827 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:17.013965 [ 23827 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:17.015143 [ 23827 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:17.015760 [ 23827 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:17.016363 [ 23827 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:17.016935 [ 23827 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:17.016969 [ 23827 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:17.017025 [ 23837 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:17.017405 [ 23837 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:21.327503 [ 23827 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:21.327638 [ 23827 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:21.327902 [ 23827 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:21.327919 [ 23827 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:21.328028 [ 23835 ] {} CancellationChecker: Execution took 4560 ms. 2025.04.02 04:48:21.328246 [ 23827 ] {} Application: Shutting down storages. 2025.04.02 04:48:21.328260 [ 23827 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:21.329782 [ 23827 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:21.329800 [ 23827 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:21.329807 [ 23827 ] {} Context: Shutting down named sessions 2025.04.02 04:48:21.329836 [ 23827 ] {} Context: Shutting down database catalog 2025.04.02 04:48:21.329845 [ 23827 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:21.329887 [ 23827 ] {} Context: Shutting down merges executor 2025.04.02 04:48:21.330258 [ 23827 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:21.330585 [ 23827 ] {} Context: Shutting down moves executor 2025.04.02 04:48:21.330744 [ 23827 ] {} Context: Shutting down common executor 2025.04.02 04:48:21.330917 [ 23827 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:21.330929 [ 23827 ] {} Context: Shutting down caches 2025.04.02 04:48:21.330942 [ 23827 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:21.331375 [ 23827 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:21.334414 [ 23827 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:21.334756 [ 23827 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:21.334935 [ 23827 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:21.335203 [ 23827 ] {} Application: Shut down storages. 2025.04.02 04:48:21.335219 [ 23827 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:21.747033 [ 23827 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:21.747097 [ 23827 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:21.747116 [ 23827 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:21.991372 [ 23827 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:21.991440 [ 23827 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:21.991452 [ 23827 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:21.991572 [ 23827 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:21.992499 [ 23827 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:21.992532 [ 23827 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:21.992545 [ 23827 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:21.992699 [ 23827 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:21.992695 [ 24428 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:21.992797 [ 23827 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:21.992811 [ 23827 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:21.992821 [ 23827 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:21.992831 [ 23827 ] {} RaftInstance: manually create a snapshot on 31 2025.04.02 04:48:21.992843 [ 23827 ] {} RaftInstance: creating a snapshot for index 31 2025.04.02 04:48:21.992855 [ 23827 ] {} RaftInstance: create snapshot idx 31 log_term 31 2025.04.02 04:48:21.992878 [ 23827 ] {} KeeperStateMachine: Creating snapshot 31 2025.04.02 04:48:21.992937 [ 23827 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:21.995876 [ 23827 ] {} KeeperStateMachine: Created persistent snapshot 31 with path snapshot_31.bin.zstd 2025.04.02 04:48:21.995903 [ 23827 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:21.995914 [ 23827 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:21.995949 [ 23827 ] {} RaftInstance: snapshot idx 31 log_term 31 created, compact the log store if needed 2025.04.02 04:48:21.995965 [ 23827 ] {} RaftInstance: create snapshot idx 31 log_term 31 done: 3094 us elapsed 2025.04.02 04:48:21.996502 [ 24411 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:21.996536 [ 24422 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:21.996610 [ 24415 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:21.996646 [ 24418 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:21.996702 [ 24417 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:21.996547 [ 24414 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:21.996780 [ 24424 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:21.996852 [ 24421 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:21.996624 [ 24416 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:21.996676 [ 24420 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:21.996546 [ 24412 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:21.996786 [ 24425 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:21.996791 [ 24419 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:21.996874 [ 24426 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:21.996545 [ 24413 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:21.996677 [ 24423 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:21.997835 [ 23827 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:21.997923 [ 24409 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:21.998329 [ 23827 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:21.998498 [ 23827 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:21.998511 [ 23827 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:21.998525 [ 23827 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:21.998538 [ 23827 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:21.998806 [ 23827 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:21.998839 [ 23827 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:22.000693 [ 23827 ] {} Application: Destroyed global context. 2025.04.02 04:48:22.000969 [ 23827 ] {} Application: Waiting for background threads 2025.04.02 04:48:22.017305 [ 23827 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:22.017908 [ 23827 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:22.017926 [ 23827 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:22.022503 [ 23827 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:22.022621 [ 23827 ] {} Application: shutting down 2025.04.02 04:48:22.022633 [ 23827 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:22.023520 [ 23828 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:22.023561 [ 23828 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:22.105552 [ 23826 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:22.312965 [ 24528 ] {} Application: Will watch for the process with pid 24529 2025.04.02 04:48:22.313183 [ 24529 ] {} Application: Forked a child process to watch 2025.04.02 04:48:22.314105 [ 24529 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:22.417857 [ 24529 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 24529 2025.04.02 04:48:22.418267 [ 24529 ] {} Application: starting up 2025.04.02 04:48:22.418286 [ 24529 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:22.426858 [ 24529 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:22.426936 [ 24529 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:22.426987 [ 24529 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:22.427000 [ 24529 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:22.427030 [ 24529 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:22.427875 [ 24529 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:22.428071 [ 24529 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:22.428084 [ 24529 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:22.428154 [ 24529 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:22.428168 [ 24529 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:22.728330 [ 24529 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:22.728516 [ 24529 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:22.755334 [ 24529 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:22.755403 [ 24529 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:22.755553 [ 24529 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:22.790807 [ 24536 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:22.790914 [ 24529 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:22.790972 [ 24529 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:22.790991 [ 24529 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:22.791002 [ 24529 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:22.791194 [ 24529 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:22.791379 [ 24529 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:22.796604 [ 24529 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:22.796641 [ 24529 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:22.796677 [ 24529 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:22.797139 [ 24529 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:22.797220 [ 24529 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:22.797836 [ 24529 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:22.800128 [ 24529 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:22.800193 [ 24529 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:22.800233 [ 24529 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:22.800425 [ 24529 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:22.804492 [ 24529 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:22.804518 [ 24529 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:22.807279 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:22.807717 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:22.807933 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:22.808178 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:22.808420 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:22.810311 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:22.810566 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:22.810804 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:22.811003 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:22.811215 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:22.811511 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:22.811722 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:22.811929 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:22.812124 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:22.812398 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:22.812621 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:22.812835 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:22.813063 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:22.813340 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:22.813589 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:22.813825 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:22.814047 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:22.814409 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:22.814950 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:22.815169 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:22.815579 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:22.816143 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:22.816402 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:22.816624 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:22.816859 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:22.817090 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:22.817365 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:22.817662 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:22.817889 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:22.818196 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:22.818422 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:22.818714 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:22.819007 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:22.819262 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:22.819830 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:22.820182 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:22.820431 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:22.820711 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:22.820984 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:22.821347 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:22.821718 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:22.821995 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:22.822260 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:22.822550 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:22.823509 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:22.823801 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:22.824138 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:22.824409 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:22.824635 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:22.824809 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:22.825066 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:22.825281 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:22.825499 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:22.825670 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:22.825851 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:22.826025 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:22.826287 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:22.826462 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:22.826692 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:22.826953 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:22.827180 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:22.827874 [ 24529 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:22.850024 [ 24529 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:22.850330 [ 24529 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:22.860504 [ 24529 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:22.860516 [ 24529 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:22.860525 [ 24529 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:22.863954 [ 24529 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:22.863967 [ 24529 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:22.863981 [ 24529 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:22.864003 [ 24529 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:22.864788 [ 24529 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:22.865578 [ 24529 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:22.867805 [ 24529 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:22.867909 [ 24529 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:22.867936 [ 24529 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:22.868524 [ 24529 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:22.868655 [ 24529 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:22.868762 [ 24529 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:22.869208 [ 24529 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:22.869233 [ 24529 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:22.869573 [ 24529 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:22.869580 [ 24529 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:22.869585 [ 24529 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:22.869593 [ 24529 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:22.869597 [ 24529 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:22.869638 [ 24529 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:22.869648 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.879539 [ 24529 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:22.880949 [ 24529 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:22.880959 [ 24529 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:22.881289 [ 24529 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:22.881379 [ 24529 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos 2025.04.02 04:48:22.881414 [ 24529 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos 2025.04.02 04:48:22.881423 [ 24529 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos, size 4 2025.04.02 04:48:22.881579 [ 24529 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos. 2025.04.02 04:48:22.881715 [ 25103 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos 2025.04.02 04:48:22.888728 [ 25103 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos, size 4 2025.04.02 04:48:22.888932 [ 24529 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/kfl/gmadjprqimtqxkrtdaplkuslqehos. 2025.04.02 04:48:22.889077 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kfl/gmadjprqimtqxkrtdaplkuslqehos (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.890977 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kfl/gmadjprqimtqxkrtdaplkuslqehos (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.890993 [ 24529 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kfl/gmadjprqimtqxkrtdaplkuslqehos, Version: Latest, Offset: 2 2025.04.02 04:48:22.894377 [ 24529 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/kfl/gmadjprqimtqxkrtdaplkuslqehos 2025.04.02 04:48:22.894391 [ 24529 ] {} deleteFileFromS3: Object with path s3/kfl/gmadjprqimtqxkrtdaplkuslqehos was removed from S3 2025.04.02 04:48:22.894416 [ 24529 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:22.894423 [ 24529 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:22.895030 [ 24529 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:22.896372 [ 24529 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:22.896380 [ 24529 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:22.896524 [ 24529 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:22.902425 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.904943 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.904968 [ 24529 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:22.908963 [ 24529 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:22.909024 [ 24529 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:22 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832607EABB03A1A x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:22.909064 [ 24529 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:22.912114 [ 24529 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:22.912134 [ 24529 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:22.912148 [ 24529 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:22.912157 [ 24529 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:22.912199 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.912233 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.912252 [ 24529 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:22.912270 [ 24529 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:22.912288 [ 24529 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:22.912307 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.912325 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.912343 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.912362 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.912380 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.913359 [ 24529 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:22.915679 [ 24529 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:22.915694 [ 24529 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:22.915929 [ 24529 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:22.920556 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/wto/jboeaqduayivcgktnppftosmrtzgf (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.922052 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/wto/jboeaqduayivcgktnppftosmrtzgf (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.922075 [ 24529 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/wto/jboeaqduayivcgktnppftosmrtzgf, Version: Latest, Offset: 2 2025.04.02 04:48:22.925548 [ 24529 ] {} deleteFileFromS3: No blob storage log, not writing blob special/wto/jboeaqduayivcgktnppftosmrtzgf 2025.04.02 04:48:22.925569 [ 24529 ] {} deleteFileFromS3: Object with path special/wto/jboeaqduayivcgktnppftosmrtzgf was removed from S3 2025.04.02 04:48:22.925583 [ 24529 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:22.925593 [ 24529 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:22.926539 [ 24529 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:22.928835 [ 24529 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:22.928848 [ 24529 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:22.929068 [ 24529 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:22.934670 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/uzm/qgrodrizgfyjbsghjyrfcdgsmkkxu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.936149 [ 24529 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/uzm/qgrodrizgfyjbsghjyrfcdgsmkkxu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:22.936173 [ 24529 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/uzm/qgrodrizgfyjbsghjyrfcdgsmkkxu, Version: Latest, Offset: 2 2025.04.02 04:48:22.939625 [ 24529 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/uzm/qgrodrizgfyjbsghjyrfcdgsmkkxu 2025.04.02 04:48:22.939651 [ 24529 ] {} deleteFileFromS3: Object with path test_02944/uzm/qgrodrizgfyjbsghjyrfcdgsmkkxu was removed from S3 2025.04.02 04:48:22.939678 [ 24529 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:22.939691 [ 24529 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:22.939726 [ 24529 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:22.941876 [ 24529 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:22.943878 [ 24529 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:22.943986 [ 24529 ] {} KeeperSnapshotManager: Found snapshot_30.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:22.944018 [ 24529 ] {} KeeperSnapshotManager: Found snapshot_29.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:22.944030 [ 24529 ] {} KeeperSnapshotManager: Found snapshot_31.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:22.944789 [ 24529 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:22.944870 [ 24529 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:22.945241 [ 24529 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:22.945264 [ 24529 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:22.945307 [ 24529 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:22.945319 [ 24529 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 31 2025.04.02 04:48:22.945728 [ 24529 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:22.945804 [ 24529 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 31 2025.04.02 04:48:22.946120 [ 24529 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 31 entries 2025.04.02 04:48:22.946149 [ 24529 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:22.946204 [ 24529 ] {} KeeperServer: Last local log idx 31 2025.04.02 04:48:22.946222 [ 24529 ] {} KeeperServer: Will use config from log store with log index 31 2025.04.02 04:48:22.946776 [ 24529 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:22.949227 [ 24529 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:22.949523 [ 24529 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:22.949562 [ 24529 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:22.949581 [ 24529 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:22.949601 [ 24529 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:22.949614 [ 24529 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:22.949643 [ 24529 ] {} RaftInstance: === INIT RAFT SERVER === commit index 31 term 31 election timer allowed log store start 1, end 31 config log idx 31, prev log idx 30 -- ASYNC REPLICATION -- 2025.04.02 04:48:22.949664 [ 24529 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:22.949714 [ 24529 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:22.949883 [ 24529 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:22.949962 [ 25130 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:23.000127 [ 24529 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:23.000158 [ 25113 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:23.000222 [ 25113 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:23.000293 [ 25113 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 31, state term 31, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:23.000305 [ 25113 ] {} RaftInstance: pre-vote term (0) is different, reset it to 31 2025.04.02 04:48:23.000427 [ 25113 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:23.002811 [ 25113 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 32, log idx 31, log term 31, priority (target 1 / mine 1) 2025.04.02 04:48:23.002836 [ 25113 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:23.002848 [ 25113 ] {} RaftInstance: state machine commit index 31, precommit index 31, last log index 31 2025.04.02 04:48:23.003077 [ 25111 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:23.003159 [ 25113 ] {} RaftInstance: [BECOME LEADER] appended new config at 32 2025.04.02 04:48:23.003264 [ 25129 ] {} RaftInstance: config at index 32 is committed, prev config log idx 31 2025.04.02 04:48:23.003304 [ 25129 ] {} RaftInstance: new config log idx 32, prev log idx 31, cur config log idx 31, prev log idx 30 2025.04.02 04:48:23.003330 [ 25129 ] {} RaftInstance: new configuration: log idx 32, prev log idx 31 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 32 2025.04.02 04:48:23.003389 [ 24529 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:23.003565 [ 24529 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:23.005048 [ 24529 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:23.005164 [ 24529 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:23.009120 [ 24529 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:23.009145 [ 24529 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:23.009667 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:23.009831 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:23.010034 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:23.010147 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:23.010246 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:23.010343 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:23.010451 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:23.010606 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:23.011760 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:23.011958 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:23.012126 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:23.012302 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:23.012474 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:23.012664 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:23.012832 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:23.013027 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:23.013239 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:23.013469 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:23.013676 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:23.013868 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:23.014050 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:23.014250 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:23.014620 [ 24529 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:23.019334 [ 24529 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:23.019410 [ 24529 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:23.022722 [ 24529 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:23.022759 [ 24529 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:23.023204 [ 24529 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:23.023447 [ 24529 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:23.023657 [ 24529 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:23.023885 [ 25135 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:23.025798 [ 24529 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:23.026311 [ 24529 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:23.027280 [ 24529 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:23.027774 [ 24529 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:23.028932 [ 24529 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:23.029556 [ 24529 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:23.030159 [ 24529 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:23.030717 [ 24529 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:23.030749 [ 24529 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:23.030825 [ 24537 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:23.031181 [ 24537 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:27.665949 [ 24529 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:27.666100 [ 24529 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:27.666357 [ 24529 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:27.666377 [ 24529 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:27.666482 [ 24536 ] {} CancellationChecker: Execution took 4875 ms. 2025.04.02 04:48:27.666676 [ 24529 ] {} Application: Shutting down storages. 2025.04.02 04:48:27.666688 [ 24529 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:27.668032 [ 24529 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:27.668045 [ 24529 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:27.668052 [ 24529 ] {} Context: Shutting down named sessions 2025.04.02 04:48:27.668074 [ 24529 ] {} Context: Shutting down database catalog 2025.04.02 04:48:27.668082 [ 24529 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:27.668121 [ 24529 ] {} Context: Shutting down merges executor 2025.04.02 04:48:27.668953 [ 24529 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:27.669172 [ 24529 ] {} Context: Shutting down moves executor 2025.04.02 04:48:27.669369 [ 24529 ] {} Context: Shutting down common executor 2025.04.02 04:48:27.669630 [ 24529 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:27.669638 [ 24529 ] {} Context: Shutting down caches 2025.04.02 04:48:27.669647 [ 24529 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:27.669967 [ 24529 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:27.672329 [ 24529 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:27.672638 [ 24529 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:27.672784 [ 24529 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:27.672990 [ 24529 ] {} Application: Shut down storages. 2025.04.02 04:48:27.673008 [ 24529 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:28.011854 [ 24529 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:28.011933 [ 24529 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:28.011946 [ 24529 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:28.506082 [ 24529 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:28.506159 [ 24529 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:28.506171 [ 24529 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:28.506275 [ 24529 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:28.506286 [ 24529 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:28.506311 [ 24529 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:28.506322 [ 24529 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:28.506444 [ 25130 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:28.506461 [ 24529 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:28.506493 [ 24529 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:28.506502 [ 24529 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:28.506525 [ 24529 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:28.506536 [ 24529 ] {} RaftInstance: manually create a snapshot on 32 2025.04.02 04:48:28.506548 [ 24529 ] {} RaftInstance: creating a snapshot for index 32 2025.04.02 04:48:28.506561 [ 24529 ] {} RaftInstance: create snapshot idx 32 log_term 32 2025.04.02 04:48:28.506585 [ 24529 ] {} KeeperStateMachine: Creating snapshot 32 2025.04.02 04:48:28.506648 [ 24529 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:28.509924 [ 24529 ] {} KeeperStateMachine: Created persistent snapshot 32 with path snapshot_32.bin.zstd 2025.04.02 04:48:28.509950 [ 24529 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:28.509961 [ 24529 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:28.509999 [ 24529 ] {} RaftInstance: snapshot idx 32 log_term 32 created, compact the log store if needed 2025.04.02 04:48:28.510015 [ 24529 ] {} RaftInstance: create snapshot idx 32 log_term 32 done: 3436 us elapsed 2025.04.02 04:48:28.510598 [ 25115 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:28.510611 [ 25113 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:28.510665 [ 25117 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:28.510604 [ 25114 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:28.510711 [ 25119 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:28.510755 [ 25121 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:28.510622 [ 25116 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:28.510712 [ 25128 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:28.510717 [ 25120 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:28.510745 [ 25127 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:28.510750 [ 25123 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:28.510793 [ 25124 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:28.510806 [ 25125 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:28.510820 [ 25126 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:28.510865 [ 25122 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:28.510644 [ 25118 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:28.511689 [ 24529 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:28.511771 [ 25111 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:28.512387 [ 24529 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:28.512559 [ 24529 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:28.512576 [ 24529 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:28.512591 [ 24529 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:28.512605 [ 24529 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:28.512867 [ 24529 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:28.512915 [ 24529 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:28.514731 [ 24529 ] {} Application: Destroyed global context. 2025.04.02 04:48:28.514967 [ 24529 ] {} Application: Waiting for background threads 2025.04.02 04:48:28.530391 [ 24529 ] {} Application: Background threads finished in 15 ms 2025.04.02 04:48:28.531031 [ 24529 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:28.531049 [ 24529 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:28.536268 [ 24529 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:28.536426 [ 24529 ] {} Application: shutting down 2025.04.02 04:48:28.536443 [ 24529 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:28.537612 [ 24530 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:28.537658 [ 24530 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:28.616958 [ 24528 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:29.110683 [ 25234 ] {} Application: Will watch for the process with pid 25235 2025.04.02 04:48:29.110875 [ 25235 ] {} Application: Forked a child process to watch 2025.04.02 04:48:29.111673 [ 25235 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:29.216590 [ 25235 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 25235 2025.04.02 04:48:29.217068 [ 25235 ] {} Application: starting up 2025.04.02 04:48:29.217089 [ 25235 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:29.225535 [ 25235 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:29.225621 [ 25235 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:29.225672 [ 25235 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:29.225684 [ 25235 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:29.225710 [ 25235 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:29.226512 [ 25235 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:29.226708 [ 25235 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:29.226724 [ 25235 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:29.226797 [ 25235 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:29.226810 [ 25235 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:29.525439 [ 25235 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:29.525618 [ 25235 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:29.552203 [ 25235 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:29.552283 [ 25235 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:29.552411 [ 25235 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:29.587618 [ 25242 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:29.587733 [ 25235 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:29.587761 [ 25235 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:29.587776 [ 25235 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:29.587787 [ 25235 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:29.587952 [ 25235 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:29.588129 [ 25235 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:29.593321 [ 25235 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:29.593362 [ 25235 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:29.593399 [ 25235 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:29.593860 [ 25235 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:29.593913 [ 25235 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:29.594500 [ 25235 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:29.596819 [ 25235 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:29.596876 [ 25235 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:29.596912 [ 25235 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:29.597101 [ 25235 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:29.601131 [ 25235 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:29.601154 [ 25235 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:29.604036 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:29.604468 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:29.604711 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:29.604986 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:29.605289 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:29.607209 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:29.607458 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:29.607723 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:29.607994 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:29.608236 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:29.608542 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:29.608762 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:29.608977 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:29.609223 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:29.609534 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:29.609751 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:29.609971 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:29.610192 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:29.610434 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:29.610680 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:29.610928 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:29.611168 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:29.611555 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:29.612086 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:29.612321 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:29.612748 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:29.613399 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:29.613691 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:29.613908 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:29.614144 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:29.614382 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:29.614655 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:29.614972 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:29.615236 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:29.615625 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:29.615905 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:29.616226 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:29.616596 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:29.616911 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:29.617595 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:29.618004 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:29.618207 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:29.618413 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:29.618641 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:29.618848 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:29.619092 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:29.619298 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:29.619499 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:29.619717 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:29.620483 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:29.620805 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:29.621152 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:29.621422 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:29.621640 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:29.621821 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:29.622101 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:29.622302 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:29.622504 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:29.622693 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:29.622878 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:29.623057 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:29.623324 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:29.623557 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:29.623795 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:29.624056 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:29.624261 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:29.624951 [ 25235 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:29.648390 [ 25235 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:29.648888 [ 25235 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:29.659677 [ 25235 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:29.659690 [ 25235 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:29.659695 [ 25235 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:29.663146 [ 25235 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:29.663159 [ 25235 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:29.663173 [ 25235 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:29.663194 [ 25235 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:29.663974 [ 25235 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:29.664675 [ 25235 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:29.667013 [ 25235 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:29.667099 [ 25235 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:29.667122 [ 25235 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:29.667722 [ 25235 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:29.667868 [ 25235 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:29.667975 [ 25235 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:29.668426 [ 25235 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:29.668451 [ 25235 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:29.668820 [ 25235 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:29.668828 [ 25235 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:29.668834 [ 25235 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:29.668844 [ 25235 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:29.668848 [ 25235 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:29.668889 [ 25235 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:29.668900 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.678613 [ 25235 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:29.680028 [ 25235 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:29.680039 [ 25235 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:29.680335 [ 25235 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:29.680420 [ 25235 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr 2025.04.02 04:48:29.680455 [ 25235 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr 2025.04.02 04:48:29.680465 [ 25235 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr, size 4 2025.04.02 04:48:29.680610 [ 25235 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr. 2025.04.02 04:48:29.680690 [ 25809 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr 2025.04.02 04:48:29.687429 [ 25809 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr, size 4 2025.04.02 04:48:29.687606 [ 25235 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/rnh/fmpmputdphiprrseixxrkaxbsagkr. 2025.04.02 04:48:29.687733 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rnh/fmpmputdphiprrseixxrkaxbsagkr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.689660 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/rnh/fmpmputdphiprrseixxrkaxbsagkr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.689682 [ 25235 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/rnh/fmpmputdphiprrseixxrkaxbsagkr, Version: Latest, Offset: 2 2025.04.02 04:48:29.693666 [ 25235 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/rnh/fmpmputdphiprrseixxrkaxbsagkr 2025.04.02 04:48:29.693684 [ 25235 ] {} deleteFileFromS3: Object with path s3/rnh/fmpmputdphiprrseixxrkaxbsagkr was removed from S3 2025.04.02 04:48:29.693728 [ 25235 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:29.693738 [ 25235 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:29.694594 [ 25235 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:29.696580 [ 25235 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:29.696593 [ 25235 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:29.696784 [ 25235 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:29.702418 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.705337 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.705361 [ 25235 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:29.709023 [ 25235 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:29.709077 [ 25235 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:29 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832608041020EA6 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:29.709113 [ 25235 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:29.712094 [ 25235 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:29.712113 [ 25235 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:29.712125 [ 25235 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:29.712133 [ 25235 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:29.712172 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.712190 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.712206 [ 25235 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:29.712222 [ 25235 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:29.712238 [ 25235 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:29.712253 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.712270 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.712285 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.712301 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.712317 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.713176 [ 25235 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:29.715280 [ 25235 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:29.715296 [ 25235 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:29.715500 [ 25235 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:29.720412 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/hda/hrjoirjadamuibgydhybaynmggzpe (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.721890 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/hda/hrjoirjadamuibgydhybaynmggzpe (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.721912 [ 25235 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/hda/hrjoirjadamuibgydhybaynmggzpe, Version: Latest, Offset: 2 2025.04.02 04:48:29.725404 [ 25235 ] {} deleteFileFromS3: No blob storage log, not writing blob special/hda/hrjoirjadamuibgydhybaynmggzpe 2025.04.02 04:48:29.725449 [ 25235 ] {} deleteFileFromS3: Object with path special/hda/hrjoirjadamuibgydhybaynmggzpe was removed from S3 2025.04.02 04:48:29.725479 [ 25235 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:29.725494 [ 25235 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:29.726922 [ 25235 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:29.730046 [ 25235 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:29.730069 [ 25235 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:29.730421 [ 25235 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:29.735301 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gbf/svmimqawgepzrghrusxoaaqogephv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.736970 [ 25235 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/gbf/svmimqawgepzrghrusxoaaqogephv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:29.737005 [ 25235 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/gbf/svmimqawgepzrghrusxoaaqogephv, Version: Latest, Offset: 2 2025.04.02 04:48:29.740993 [ 25235 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/gbf/svmimqawgepzrghrusxoaaqogephv 2025.04.02 04:48:29.741020 [ 25235 ] {} deleteFileFromS3: Object with path test_02944/gbf/svmimqawgepzrghrusxoaaqogephv was removed from S3 2025.04.02 04:48:29.741037 [ 25235 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:29.741049 [ 25235 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:29.741090 [ 25235 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:29.743262 [ 25235 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:29.745440 [ 25235 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:29.745568 [ 25235 ] {} KeeperSnapshotManager: Found snapshot_32.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:29.745601 [ 25235 ] {} KeeperSnapshotManager: Found snapshot_30.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:29.745614 [ 25235 ] {} KeeperSnapshotManager: Found snapshot_31.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:29.746375 [ 25235 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:29.746465 [ 25235 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:29.746695 [ 25235 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:29.746724 [ 25235 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:29.746768 [ 25235 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:29.746779 [ 25235 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 32 2025.04.02 04:48:29.747176 [ 25235 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:29.747260 [ 25235 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 32 2025.04.02 04:48:29.747639 [ 25235 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 32 entries 2025.04.02 04:48:29.747668 [ 25235 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:29.747731 [ 25235 ] {} KeeperServer: Last local log idx 32 2025.04.02 04:48:29.747749 [ 25235 ] {} KeeperServer: Will use config from log store with log index 32 2025.04.02 04:48:29.748285 [ 25235 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:29.750979 [ 25235 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:29.751282 [ 25235 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:29.751321 [ 25235 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:29.751340 [ 25235 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:29.751360 [ 25235 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:29.751372 [ 25235 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:29.751395 [ 25235 ] {} RaftInstance: === INIT RAFT SERVER === commit index 32 term 32 election timer allowed log store start 1, end 32 config log idx 32, prev log idx 31 -- ASYNC REPLICATION -- 2025.04.02 04:48:29.751419 [ 25235 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:29.751469 [ 25235 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:29.751635 [ 25235 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:29.751731 [ 25836 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:29.801910 [ 25235 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:29.801911 [ 25819 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:29.801953 [ 25819 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:29.802017 [ 25819 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 32, state term 32, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:29.802029 [ 25819 ] {} RaftInstance: pre-vote term (0) is different, reset it to 32 2025.04.02 04:48:29.802140 [ 25819 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:29.804376 [ 25819 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 33, log idx 32, log term 32, priority (target 1 / mine 1) 2025.04.02 04:48:29.804408 [ 25819 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:29.804432 [ 25819 ] {} RaftInstance: state machine commit index 32, precommit index 32, last log index 32 2025.04.02 04:48:29.804642 [ 25817 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:29.804729 [ 25819 ] {} RaftInstance: [BECOME LEADER] appended new config at 33 2025.04.02 04:48:29.804830 [ 25835 ] {} RaftInstance: config at index 33 is committed, prev config log idx 32 2025.04.02 04:48:29.804889 [ 25835 ] {} RaftInstance: new config log idx 33, prev log idx 32, cur config log idx 32, prev log idx 31 2025.04.02 04:48:29.804920 [ 25835 ] {} RaftInstance: new configuration: log idx 33, prev log idx 32 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 33 2025.04.02 04:48:29.805038 [ 25235 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:29.805342 [ 25235 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:29.806956 [ 25235 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:29.807062 [ 25235 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:29.811000 [ 25235 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:29.811025 [ 25235 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:29.811516 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:29.811692 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:29.811895 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:29.812009 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:29.812107 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:29.812203 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:29.812306 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:29.812435 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:29.813655 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:29.813858 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:29.814025 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:29.814200 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:29.814374 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:29.814562 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:29.814736 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:29.814932 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:29.815107 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:29.815327 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:29.815544 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:29.815743 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:29.815972 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:29.816192 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:29.816575 [ 25235 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:29.821306 [ 25235 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:29.821388 [ 25235 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:29.824612 [ 25235 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:29.824650 [ 25235 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:29.825104 [ 25235 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:29.825388 [ 25235 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:29.825604 [ 25235 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:29.825863 [ 25841 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:29.827780 [ 25235 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:29.828377 [ 25235 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:29.829675 [ 25235 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:29.830218 [ 25235 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:29.831601 [ 25235 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:29.832177 [ 25235 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:29.832786 [ 25235 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:29.833546 [ 25235 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:29.833586 [ 25235 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:29.833637 [ 25243 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:29.833943 [ 25243 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:34.194755 [ 25235 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:34.194907 [ 25235 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:34.195174 [ 25235 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:34.195188 [ 25235 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:34.195317 [ 25242 ] {} CancellationChecker: Execution took 4607 ms. 2025.04.02 04:48:34.195515 [ 25235 ] {} Application: Shutting down storages. 2025.04.02 04:48:34.195528 [ 25235 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:34.197182 [ 25235 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:34.197222 [ 25235 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:34.197229 [ 25235 ] {} Context: Shutting down named sessions 2025.04.02 04:48:34.197252 [ 25235 ] {} Context: Shutting down database catalog 2025.04.02 04:48:34.197260 [ 25235 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:34.197301 [ 25235 ] {} Context: Shutting down merges executor 2025.04.02 04:48:34.197717 [ 25235 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:34.198018 [ 25235 ] {} Context: Shutting down moves executor 2025.04.02 04:48:34.198228 [ 25235 ] {} Context: Shutting down common executor 2025.04.02 04:48:34.198382 [ 25235 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:34.198394 [ 25235 ] {} Context: Shutting down caches 2025.04.02 04:48:34.198408 [ 25235 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:34.198923 [ 25235 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:34.202076 [ 25235 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:34.202470 [ 25235 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:34.202678 [ 25235 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:34.202932 [ 25235 ] {} Application: Shut down storages. 2025.04.02 04:48:34.202949 [ 25235 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:34.563724 [ 25235 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:34.563774 [ 25235 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:34.563787 [ 25235 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:34.807639 [ 25235 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:34.807714 [ 25235 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:34.807727 [ 25235 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:34.807792 [ 25235 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:34.808844 [ 25235 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:34.808885 [ 25235 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:34.808898 [ 25235 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:34.809009 [ 25235 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:34.809033 [ 25836 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:34.809160 [ 25235 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:34.809175 [ 25235 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:34.809205 [ 25235 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:34.809216 [ 25235 ] {} RaftInstance: manually create a snapshot on 33 2025.04.02 04:48:34.809229 [ 25235 ] {} RaftInstance: creating a snapshot for index 33 2025.04.02 04:48:34.809242 [ 25235 ] {} RaftInstance: create snapshot idx 33 log_term 33 2025.04.02 04:48:34.809264 [ 25235 ] {} KeeperStateMachine: Creating snapshot 33 2025.04.02 04:48:34.809325 [ 25235 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:34.812367 [ 25235 ] {} KeeperStateMachine: Created persistent snapshot 33 with path snapshot_33.bin.zstd 2025.04.02 04:48:34.812412 [ 25235 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:34.812424 [ 25235 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:34.812469 [ 25235 ] {} RaftInstance: snapshot idx 33 log_term 33 created, compact the log store if needed 2025.04.02 04:48:34.812489 [ 25235 ] {} RaftInstance: create snapshot idx 33 log_term 33 done: 3231 us elapsed 2025.04.02 04:48:34.812844 [ 25819 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:34.812870 [ 25820 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:34.812952 [ 25825 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:34.812900 [ 25821 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:34.812997 [ 25826 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:34.812901 [ 25824 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:34.813082 [ 25827 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:34.812992 [ 25823 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:34.813141 [ 25829 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:34.813012 [ 25834 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:34.813089 [ 25830 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:34.813119 [ 25831 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:34.813131 [ 25828 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:34.812911 [ 25822 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:34.813212 [ 25832 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:34.813161 [ 25833 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:34.813714 [ 25235 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:34.813797 [ 25817 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:34.814247 [ 25235 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:34.814346 [ 25235 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:34.814359 [ 25235 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:34.814375 [ 25235 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:34.814389 [ 25235 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:34.814661 [ 25235 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:34.814708 [ 25235 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:34.816540 [ 25235 ] {} Application: Destroyed global context. 2025.04.02 04:48:34.816798 [ 25235 ] {} Application: Waiting for background threads 2025.04.02 04:48:34.832948 [ 25235 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:34.833535 [ 25235 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:34.833567 [ 25235 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:34.838039 [ 25235 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:34.838148 [ 25235 ] {} Application: shutting down 2025.04.02 04:48:34.838159 [ 25235 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:34.839066 [ 25236 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:34.839106 [ 25236 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:34.919362 [ 25234 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:35.119408 [ 25936 ] {} Application: Will watch for the process with pid 25937 2025.04.02 04:48:35.119626 [ 25937 ] {} Application: Forked a child process to watch 2025.04.02 04:48:35.120326 [ 25937 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:35.224508 [ 25937 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 25937 2025.04.02 04:48:35.225014 [ 25937 ] {} Application: starting up 2025.04.02 04:48:35.225036 [ 25937 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:35.233474 [ 25937 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:35.233567 [ 25937 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:35.233619 [ 25937 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:35.233631 [ 25937 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:35.233658 [ 25937 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:35.234512 [ 25937 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:35.234735 [ 25937 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:35.234749 [ 25937 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:35.234817 [ 25937 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:35.234844 [ 25937 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:35.533829 [ 25937 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:35.534000 [ 25937 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:35.560673 [ 25937 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:35.560741 [ 25937 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:35.560864 [ 25937 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:35.595570 [ 25945 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:35.595709 [ 25937 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:35.595765 [ 25937 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:35.595784 [ 25937 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:35.595795 [ 25937 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:35.595980 [ 25937 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:35.596179 [ 25937 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:35.601471 [ 25937 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:35.601509 [ 25937 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:35.601547 [ 25937 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:35.602023 [ 25937 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:35.602075 [ 25937 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:35.602694 [ 25937 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:35.605017 [ 25937 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:35.605073 [ 25937 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:35.605111 [ 25937 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:35.605338 [ 25937 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:35.609580 [ 25937 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:35.609607 [ 25937 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:35.612453 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:35.612900 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:35.613119 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:35.613397 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:35.613670 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:35.615590 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:35.615832 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:35.616090 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:35.616289 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:35.616512 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:35.616829 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:35.617038 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:35.617330 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:35.617548 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:35.617851 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:35.618058 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:35.618273 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:35.618487 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:35.618743 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:35.618970 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:35.619202 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:35.619425 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:35.619813 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:35.620358 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:35.620619 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:35.621012 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:35.621631 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:35.621902 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:35.622105 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:35.622330 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:35.622581 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:35.622837 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:35.623114 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:35.623330 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:35.623747 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:35.624008 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:35.624287 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:35.624605 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:35.624868 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:35.625475 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:35.625863 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:35.626118 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:35.626385 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:35.626672 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:35.626942 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:35.627266 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:35.627541 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:35.627836 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:35.628110 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:35.628976 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:35.629298 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:35.629686 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:35.629942 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:35.630125 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:35.630292 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:35.630549 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:35.630758 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:35.630954 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:35.631121 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:35.631301 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:35.631475 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:35.631762 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:35.631951 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:35.632164 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:35.632429 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:35.632647 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:35.633333 [ 25937 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:35.655894 [ 25937 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:35.656346 [ 25937 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:35.667931 [ 25937 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:35.667944 [ 25937 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:35.667949 [ 25937 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:35.671453 [ 25937 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:35.671466 [ 25937 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:35.671481 [ 25937 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:35.671503 [ 25937 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:35.672204 [ 25937 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:35.672930 [ 25937 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:35.675200 [ 25937 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:35.675273 [ 25937 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:35.675300 [ 25937 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:35.675865 [ 25937 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:35.676000 [ 25937 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:35.676098 [ 25937 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:35.676525 [ 25937 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:35.676555 [ 25937 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:35.676910 [ 25937 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:35.676917 [ 25937 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:35.676921 [ 25937 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:35.676929 [ 25937 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:35.676933 [ 25937 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:35.676971 [ 25937 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:35.676991 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.692001 [ 25937 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:35.694202 [ 25937 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:35.694220 [ 25937 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:35.694672 [ 25937 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:35.694799 [ 25937 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm 2025.04.02 04:48:35.694848 [ 25937 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm 2025.04.02 04:48:35.694861 [ 25937 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm, size 4 2025.04.02 04:48:35.695047 [ 25937 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm. 2025.04.02 04:48:35.695160 [ 26511 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm 2025.04.02 04:48:35.701225 [ 26511 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm, size 4 2025.04.02 04:48:35.701443 [ 25937 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm. 2025.04.02 04:48:35.701643 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.703726 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.703750 [ 25937 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm, Version: Latest, Offset: 2 2025.04.02 04:48:35.707701 [ 25937 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm 2025.04.02 04:48:35.707720 [ 25937 ] {} deleteFileFromS3: Object with path s3/duq/kqnneliywnqfiwxqpdiiqrbnnaemm was removed from S3 2025.04.02 04:48:35.707757 [ 25937 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:35.707767 [ 25937 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:35.708608 [ 25937 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:35.710703 [ 25937 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:35.710719 [ 25937 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:35.710909 [ 25937 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:35.716808 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.719657 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.719682 [ 25937 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:35.723363 [ 25937 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:35.723427 [ 25937 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:35 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326081A77E040A x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:35.723464 [ 25937 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:35.726365 [ 25937 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:35.726384 [ 25937 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:35.726396 [ 25937 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:35.726405 [ 25937 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:35.726439 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.726456 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.726472 [ 25937 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:35.726488 [ 25937 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:35.726504 [ 25937 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:35.726520 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.726535 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.726552 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.726585 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.726601 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.727418 [ 25937 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:35.729581 [ 25937 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:35.729598 [ 25937 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:35.729798 [ 25937 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:35.734521 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/uhx/suxatwgfbqdhejpigsxrvpnuudexc (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.735994 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/uhx/suxatwgfbqdhejpigsxrvpnuudexc (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.736016 [ 25937 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/uhx/suxatwgfbqdhejpigsxrvpnuudexc, Version: Latest, Offset: 2 2025.04.02 04:48:35.739600 [ 25937 ] {} deleteFileFromS3: No blob storage log, not writing blob special/uhx/suxatwgfbqdhejpigsxrvpnuudexc 2025.04.02 04:48:35.739628 [ 25937 ] {} deleteFileFromS3: Object with path special/uhx/suxatwgfbqdhejpigsxrvpnuudexc was removed from S3 2025.04.02 04:48:35.739646 [ 25937 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:35.739669 [ 25937 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:35.740888 [ 25937 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:35.743927 [ 25937 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:35.743948 [ 25937 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:35.744231 [ 25937 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:35.748596 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vkb/pnbnuaftmggdwvuejsbplyyzscbmh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.750251 [ 25937 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/vkb/pnbnuaftmggdwvuejsbplyyzscbmh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:35.750283 [ 25937 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/vkb/pnbnuaftmggdwvuejsbplyyzscbmh, Version: Latest, Offset: 2 2025.04.02 04:48:35.753858 [ 25937 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/vkb/pnbnuaftmggdwvuejsbplyyzscbmh 2025.04.02 04:48:35.753886 [ 25937 ] {} deleteFileFromS3: Object with path test_02944/vkb/pnbnuaftmggdwvuejsbplyyzscbmh was removed from S3 2025.04.02 04:48:35.753904 [ 25937 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:35.753917 [ 25937 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:35.753953 [ 25937 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:35.756055 [ 25937 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:35.758032 [ 25937 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:35.758141 [ 25937 ] {} KeeperSnapshotManager: Found snapshot_33.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:35.758170 [ 25937 ] {} KeeperSnapshotManager: Found snapshot_32.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:35.758183 [ 25937 ] {} KeeperSnapshotManager: Found snapshot_31.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:35.758918 [ 25937 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:35.758998 [ 25937 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:35.759207 [ 25937 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:35.759226 [ 25937 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:35.759260 [ 25937 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:35.759273 [ 25937 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 33 2025.04.02 04:48:35.759651 [ 25937 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:35.759734 [ 25937 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 33 2025.04.02 04:48:35.760025 [ 25937 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 33 entries 2025.04.02 04:48:35.760051 [ 25937 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:35.760109 [ 25937 ] {} KeeperServer: Last local log idx 33 2025.04.02 04:48:35.760128 [ 25937 ] {} KeeperServer: Will use config from log store with log index 33 2025.04.02 04:48:35.760672 [ 25937 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:35.763167 [ 25937 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:35.763439 [ 25937 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:35.763477 [ 25937 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:35.763496 [ 25937 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:35.763516 [ 25937 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:35.763528 [ 25937 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:35.763551 [ 25937 ] {} RaftInstance: === INIT RAFT SERVER === commit index 33 term 33 election timer allowed log store start 1, end 33 config log idx 33, prev log idx 32 -- ASYNC REPLICATION -- 2025.04.02 04:48:35.763598 [ 25937 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:35.763651 [ 25937 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:35.763796 [ 25937 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:35.763863 [ 26538 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:35.814068 [ 25937 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:35.814051 [ 26521 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:35.814112 [ 26521 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:35.814193 [ 26521 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 33, state term 33, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:35.814207 [ 26521 ] {} RaftInstance: pre-vote term (0) is different, reset it to 33 2025.04.02 04:48:35.814355 [ 26521 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:35.817282 [ 26521 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 34, log idx 33, log term 33, priority (target 1 / mine 1) 2025.04.02 04:48:35.817311 [ 26521 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:35.817323 [ 26521 ] {} RaftInstance: state machine commit index 33, precommit index 33, last log index 33 2025.04.02 04:48:35.817528 [ 26520 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:35.817634 [ 26521 ] {} RaftInstance: [BECOME LEADER] appended new config at 34 2025.04.02 04:48:35.817771 [ 26537 ] {} RaftInstance: config at index 34 is committed, prev config log idx 33 2025.04.02 04:48:35.817822 [ 26537 ] {} RaftInstance: new config log idx 34, prev log idx 33, cur config log idx 33, prev log idx 32 2025.04.02 04:48:35.817853 [ 26537 ] {} RaftInstance: new configuration: log idx 34, prev log idx 33 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 34 2025.04.02 04:48:35.817919 [ 25937 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:35.818087 [ 25937 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:35.819575 [ 25937 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:35.819672 [ 25937 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:35.823612 [ 25937 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:35.823636 [ 25937 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:35.824118 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:35.824281 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:35.824485 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:35.824625 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:35.824731 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:35.824830 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:35.824940 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:35.825076 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:35.826292 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:35.826487 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:35.826694 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:35.826932 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:35.827126 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:35.827300 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:35.827474 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:35.827695 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:35.827879 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:35.828100 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:35.828286 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:35.828481 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:35.828685 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:35.828890 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:35.829282 [ 25937 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:35.834125 [ 25937 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:35.834200 [ 25937 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:35.837451 [ 25937 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:35.837492 [ 25937 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:35.837974 [ 25937 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:35.838226 [ 25937 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:35.838433 [ 25937 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:35.838706 [ 26543 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:35.840599 [ 25937 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:35.841181 [ 25937 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:35.842212 [ 25937 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:35.842769 [ 25937 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:35.844067 [ 25937 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:35.844660 [ 25937 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:35.845286 [ 25937 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:35.845890 [ 25937 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:35.845927 [ 25937 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:35.846044 [ 25944 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:35.846418 [ 25944 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:40.541260 [ 25937 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:40.541407 [ 25937 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:40.541680 [ 25937 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:40.541701 [ 25937 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:40.541826 [ 25945 ] {} CancellationChecker: Execution took 4946 ms. 2025.04.02 04:48:40.542049 [ 25937 ] {} Application: Shutting down storages. 2025.04.02 04:48:40.542063 [ 25937 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:40.543697 [ 25937 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:40.543723 [ 25937 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:40.543731 [ 25937 ] {} Context: Shutting down named sessions 2025.04.02 04:48:40.543754 [ 25937 ] {} Context: Shutting down database catalog 2025.04.02 04:48:40.543762 [ 25937 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:40.543805 [ 25937 ] {} Context: Shutting down merges executor 2025.04.02 04:48:40.544091 [ 25937 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:40.544293 [ 25937 ] {} Context: Shutting down moves executor 2025.04.02 04:48:40.544461 [ 25937 ] {} Context: Shutting down common executor 2025.04.02 04:48:40.544677 [ 25937 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:40.544689 [ 25937 ] {} Context: Shutting down caches 2025.04.02 04:48:40.544699 [ 25937 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:40.544994 [ 25937 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:40.547730 [ 25937 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:40.547997 [ 25937 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:40.548156 [ 25937 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:40.548317 [ 25937 ] {} Application: Shut down storages. 2025.04.02 04:48:40.548328 [ 25937 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:40.576335 [ 25937 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:40.576394 [ 25937 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:40.576407 [ 25937 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:40.820522 [ 25937 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:40.820576 [ 25937 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:40.820587 [ 25937 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:40.820683 [ 25937 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:40.821567 [ 25937 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:40.821630 [ 25937 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:40.821645 [ 25937 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:40.821773 [ 25937 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:40.821776 [ 26538 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:40.821865 [ 25937 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:40.821879 [ 25937 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:40.821888 [ 25937 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:40.821900 [ 25937 ] {} RaftInstance: manually create a snapshot on 34 2025.04.02 04:48:40.821912 [ 25937 ] {} RaftInstance: creating a snapshot for index 34 2025.04.02 04:48:40.821925 [ 25937 ] {} RaftInstance: create snapshot idx 34 log_term 34 2025.04.02 04:48:40.821947 [ 25937 ] {} KeeperStateMachine: Creating snapshot 34 2025.04.02 04:48:40.821997 [ 25937 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:40.824439 [ 25937 ] {} KeeperStateMachine: Created persistent snapshot 34 with path snapshot_34.bin.zstd 2025.04.02 04:48:40.824462 [ 25937 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:40.824473 [ 25937 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:40.824517 [ 25937 ] {} RaftInstance: snapshot idx 34 log_term 34 created, compact the log store if needed 2025.04.02 04:48:40.824533 [ 25937 ] {} RaftInstance: create snapshot idx 34 log_term 34 done: 2592 us elapsed 2025.04.02 04:48:40.824627 [ 26524 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled 2025.04.02 04:48:40.825055 [ 26523 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:40.825062 [ 26532 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:40.825105 [ 26524 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:40.825072 [ 26522 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:40.825169 [ 26531 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:40.825266 [ 26528 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:40.825122 [ 26521 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:40.825177 [ 26536 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:40.825220 [ 26526 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:40.825232 [ 26527 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:40.825222 [ 26535 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:40.825219 [ 26525 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:40.825245 [ 26530 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:40.825294 [ 26529 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:40.825306 [ 26534 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:40.825096 [ 26533 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:40.826359 [ 25937 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:40.826449 [ 26520 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:40.826523 [ 26519 ] {} KeeperLogStore: Raft server is not set in LogStore. 2025.04.02 04:48:40.826883 [ 25937 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:40.827029 [ 25937 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:40.827040 [ 25937 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:40.827058 [ 25937 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:40.827069 [ 25937 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:40.827300 [ 25937 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:40.827327 [ 25937 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:40.828728 [ 25937 ] {} Application: Destroyed global context. 2025.04.02 04:48:40.828895 [ 25937 ] {} Application: Waiting for background threads 2025.04.02 04:48:40.845577 [ 25937 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:40.846129 [ 25937 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:40.846148 [ 25937 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:40.851066 [ 25937 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:40.851190 [ 25937 ] {} Application: shutting down 2025.04.02 04:48:40.851201 [ 25937 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:40.852160 [ 25938 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:40.852214 [ 25938 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:40.930630 [ 25936 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:41.141362 [ 26638 ] {} Application: Will watch for the process with pid 26639 2025.04.02 04:48:41.141509 [ 26639 ] {} Application: Forked a child process to watch 2025.04.02 04:48:41.142079 [ 26639 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:41.241137 [ 26639 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 26639 2025.04.02 04:48:41.241635 [ 26639 ] {} Application: starting up 2025.04.02 04:48:41.241653 [ 26639 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:41.250145 [ 26639 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:41.250219 [ 26639 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:41.250271 [ 26639 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:41.250283 [ 26639 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:41.250309 [ 26639 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:41.251101 [ 26639 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:41.251285 [ 26639 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:41.251301 [ 26639 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:41.251376 [ 26639 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:41.251390 [ 26639 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:41.554645 [ 26639 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:41.554817 [ 26639 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:41.581405 [ 26639 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:41.581482 [ 26639 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:41.581627 [ 26639 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:41.611863 [ 26648 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:41.611942 [ 26639 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:41.612001 [ 26639 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:41.612011 [ 26639 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:41.612017 [ 26639 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:41.612127 [ 26639 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:41.612228 [ 26639 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:41.614616 [ 26639 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:41.614633 [ 26639 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:41.614650 [ 26639 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:41.614930 [ 26639 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:41.614952 [ 26639 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:41.615251 [ 26639 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:41.616294 [ 26639 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:41.616322 [ 26639 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:41.616339 [ 26639 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:41.616438 [ 26639 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:41.618533 [ 26639 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:41.618545 [ 26639 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:41.619803 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:41.619994 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:41.620089 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:41.620198 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:41.620302 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:41.621127 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:41.621250 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:41.621359 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:41.621447 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:41.621538 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:41.621669 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:41.621762 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:41.621856 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:41.621945 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:41.622071 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:41.622167 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:41.622260 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:41.622355 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:41.622457 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:41.622555 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:41.622668 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:41.622769 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:41.622929 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:41.623156 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:41.623256 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:41.623442 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:41.623693 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:41.623813 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:41.623902 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:41.624004 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:41.624108 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:41.624217 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:41.624338 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:41.624434 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:41.624574 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:41.624687 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:41.624817 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:41.624947 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:41.625060 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:41.625329 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:41.625487 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:41.625615 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:41.625734 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:41.625849 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:41.625967 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:41.626108 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:41.626229 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:41.626351 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:41.626476 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:41.626980 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:41.627167 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:41.627385 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:41.627536 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:41.627662 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:41.627776 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:41.627942 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:41.628065 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:41.628197 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:41.628307 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:41.628424 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:41.628538 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:41.628718 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:41.628834 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:41.628968 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:41.629137 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:41.629278 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:41.629730 [ 26639 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:41.648313 [ 26639 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:41.648627 [ 26639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:41.659070 [ 26639 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:41.659082 [ 26639 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:41.659087 [ 26639 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:41.662576 [ 26639 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:41.662587 [ 26639 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:41.662616 [ 26639 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:41.662638 [ 26639 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:41.663463 [ 26639 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:41.664125 [ 26639 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:41.666361 [ 26639 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:41.666456 [ 26639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:41.666481 [ 26639 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:41.667062 [ 26639 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:41.667197 [ 26639 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:41.667293 [ 26639 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:41.667727 [ 26639 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:41.667751 [ 26639 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:41.668086 [ 26639 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:41.668092 [ 26639 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:41.668097 [ 26639 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:41.668104 [ 26639 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:41.668108 [ 26639 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:41.668148 [ 26639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:41.668158 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.678039 [ 26639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:41.679491 [ 26639 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:41.679502 [ 26639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:41.679821 [ 26639 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:41.679912 [ 26639 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu 2025.04.02 04:48:41.679947 [ 26639 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu 2025.04.02 04:48:41.679961 [ 26639 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu, size 4 2025.04.02 04:48:41.680113 [ 26639 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu. 2025.04.02 04:48:41.680240 [ 27213 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu 2025.04.02 04:48:41.685759 [ 27213 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu, size 4 2025.04.02 04:48:41.685940 [ 26639 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/kig/hirywfritphggjalxwodiqlssfhtu. 2025.04.02 04:48:41.686076 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kig/hirywfritphggjalxwodiqlssfhtu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.687843 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/kig/hirywfritphggjalxwodiqlssfhtu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.687860 [ 26639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/kig/hirywfritphggjalxwodiqlssfhtu, Version: Latest, Offset: 2 2025.04.02 04:48:41.690964 [ 26639 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/kig/hirywfritphggjalxwodiqlssfhtu 2025.04.02 04:48:41.690977 [ 26639 ] {} deleteFileFromS3: Object with path s3/kig/hirywfritphggjalxwodiqlssfhtu was removed from S3 2025.04.02 04:48:41.691002 [ 26639 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:41.691009 [ 26639 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:41.691542 [ 26639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:41.692907 [ 26639 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:41.692915 [ 26639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:41.693043 [ 26639 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:41.698423 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.700774 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.700788 [ 26639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:41.704081 [ 26639 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:41.704117 [ 26639 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:41 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 183260830BF89EAB x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:41.704140 [ 26639 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:41.706869 [ 26639 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:41.706887 [ 26639 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:41.706895 [ 26639 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:41.706901 [ 26639 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:41.706918 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.706934 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.706946 [ 26639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:41.706956 [ 26639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:41.706966 [ 26639 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:41.706977 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.706987 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.706998 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.707009 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.707019 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.707548 [ 26639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:41.708913 [ 26639 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:41.708921 [ 26639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:41.709052 [ 26639 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:41.714051 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/jrm/jybqpdesyzbyseqowxlpcshznxlzg (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.715436 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/jrm/jybqpdesyzbyseqowxlpcshznxlzg (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.715458 [ 26639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/jrm/jybqpdesyzbyseqowxlpcshznxlzg, Version: Latest, Offset: 2 2025.04.02 04:48:41.718610 [ 26639 ] {} deleteFileFromS3: No blob storage log, not writing blob special/jrm/jybqpdesyzbyseqowxlpcshznxlzg 2025.04.02 04:48:41.718629 [ 26639 ] {} deleteFileFromS3: Object with path special/jrm/jybqpdesyzbyseqowxlpcshznxlzg was removed from S3 2025.04.02 04:48:41.718641 [ 26639 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:41.718650 [ 26639 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:41.719470 [ 26639 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:41.721530 [ 26639 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:41.721545 [ 26639 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:41.721750 [ 26639 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:41.726017 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/uwh/pthvhgcxmpozbvvjtdhkmiopnduxb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.727366 [ 26639 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/uwh/pthvhgcxmpozbvvjtdhkmiopnduxb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:41.727399 [ 26639 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/uwh/pthvhgcxmpozbvvjtdhkmiopnduxb, Version: Latest, Offset: 2 2025.04.02 04:48:41.730640 [ 26639 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/uwh/pthvhgcxmpozbvvjtdhkmiopnduxb 2025.04.02 04:48:41.730663 [ 26639 ] {} deleteFileFromS3: Object with path test_02944/uwh/pthvhgcxmpozbvvjtdhkmiopnduxb was removed from S3 2025.04.02 04:48:41.730675 [ 26639 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:41.730684 [ 26639 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:41.730708 [ 26639 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:41.732661 [ 26639 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:41.734418 [ 26639 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:41.734495 [ 26639 ] {} KeeperSnapshotManager: Found snapshot_33.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:41.734515 [ 26639 ] {} KeeperSnapshotManager: Found snapshot_34.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:41.734524 [ 26639 ] {} KeeperSnapshotManager: Found snapshot_32.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:41.735044 [ 26639 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:41.735102 [ 26639 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:41.735249 [ 26639 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:41.735261 [ 26639 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:41.735285 [ 26639 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:41.735293 [ 26639 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 34 2025.04.02 04:48:41.735617 [ 26639 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:41.735672 [ 26639 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 34 2025.04.02 04:48:41.735954 [ 26639 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 34 entries 2025.04.02 04:48:41.735973 [ 26639 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:41.736013 [ 26639 ] {} KeeperServer: Last local log idx 34 2025.04.02 04:48:41.736026 [ 26639 ] {} KeeperServer: Will use config from log store with log index 34 2025.04.02 04:48:41.736389 [ 26639 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:41.738306 [ 26639 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:41.738581 [ 26639 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:41.738625 [ 26639 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:41.738639 [ 26639 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:41.738653 [ 26639 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:41.738662 [ 26639 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:41.738685 [ 26639 ] {} RaftInstance: === INIT RAFT SERVER === commit index 34 term 34 election timer allowed log store start 1, end 34 config log idx 34, prev log idx 33 -- ASYNC REPLICATION -- 2025.04.02 04:48:41.738702 [ 26639 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:41.738739 [ 26639 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:41.738845 [ 26639 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:41.738905 [ 27240 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:41.789064 [ 27223 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:41.789097 [ 26639 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:41.789106 [ 27223 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:41.789230 [ 27223 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 34, state term 34, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:41.789246 [ 27223 ] {} RaftInstance: pre-vote term (0) is different, reset it to 34 2025.04.02 04:48:41.789350 [ 27223 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:41.791821 [ 27223 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 35, log idx 34, log term 34, priority (target 1 / mine 1) 2025.04.02 04:48:41.791850 [ 27223 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:41.791862 [ 27223 ] {} RaftInstance: state machine commit index 34, precommit index 34, last log index 34 2025.04.02 04:48:41.792091 [ 27221 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:41.792182 [ 27223 ] {} RaftInstance: [BECOME LEADER] appended new config at 35 2025.04.02 04:48:41.792300 [ 27239 ] {} RaftInstance: config at index 35 is committed, prev config log idx 34 2025.04.02 04:48:41.792341 [ 27239 ] {} RaftInstance: new config log idx 35, prev log idx 34, cur config log idx 34, prev log idx 33 2025.04.02 04:48:41.792364 [ 27239 ] {} RaftInstance: new configuration: log idx 35, prev log idx 34 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 35 2025.04.02 04:48:41.792426 [ 26639 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:41.792582 [ 26639 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:41.794143 [ 26639 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:41.794247 [ 26639 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:41.798195 [ 26639 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:41.798219 [ 26639 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:41.798710 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:41.798867 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:41.799077 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:41.799191 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:41.799292 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:41.799402 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:41.799499 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:41.799656 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:41.800795 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:41.800980 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:41.801148 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:41.801374 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:41.801552 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:41.801741 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:41.801912 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:41.802107 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:41.802273 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:41.802500 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:41.802701 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:41.802897 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:41.803082 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:41.803279 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:41.803649 [ 26639 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:41.809270 [ 26639 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:41.809345 [ 26639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:41.812577 [ 26639 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:41.812633 [ 26639 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:41.813059 [ 26639 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:41.813360 [ 26639 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:41.813555 [ 26639 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:41.813824 [ 27245 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:41.815397 [ 26639 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:41.815917 [ 26639 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:41.817038 [ 26639 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:41.817784 [ 26639 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:41.819130 [ 26639 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:41.819731 [ 26639 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:41.820328 [ 26639 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:41.820945 [ 26639 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:41.820979 [ 26639 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:41.821073 [ 26646 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:41.821413 [ 26646 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:46.197778 [ 26639 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:46.197930 [ 26639 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:46.198208 [ 26639 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:46.198221 [ 26639 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:46.198333 [ 26648 ] {} CancellationChecker: Execution took 4586 ms. 2025.04.02 04:48:46.198538 [ 26639 ] {} Application: Shutting down storages. 2025.04.02 04:48:46.198553 [ 26639 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:46.199896 [ 26639 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:46.199914 [ 26639 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:46.199925 [ 26639 ] {} Context: Shutting down named sessions 2025.04.02 04:48:46.199955 [ 26639 ] {} Context: Shutting down database catalog 2025.04.02 04:48:46.199965 [ 26639 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:46.200018 [ 26639 ] {} Context: Shutting down merges executor 2025.04.02 04:48:46.200313 [ 26639 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:46.200619 [ 26639 ] {} Context: Shutting down moves executor 2025.04.02 04:48:46.200843 [ 26639 ] {} Context: Shutting down common executor 2025.04.02 04:48:46.201024 [ 26639 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:46.201037 [ 26639 ] {} Context: Shutting down caches 2025.04.02 04:48:46.201052 [ 26639 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:46.201466 [ 26639 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:46.204274 [ 26639 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:46.204591 [ 26639 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:46.204773 [ 26639 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:46.205006 [ 26639 ] {} Application: Shut down storages. 2025.04.02 04:48:46.205028 [ 26639 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:46.550523 [ 26639 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:46.550576 [ 26639 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:46.550588 [ 26639 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:46.794684 [ 26639 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:46.794725 [ 26639 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:46.794733 [ 26639 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:46.794835 [ 26639 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:46.794844 [ 26639 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:46.794850 [ 26639 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:46.794862 [ 26639 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:46.794976 [ 26639 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:46.794987 [ 27240 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:46.795068 [ 26639 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:46.795079 [ 26639 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:46.795085 [ 26639 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:46.795093 [ 26639 ] {} RaftInstance: manually create a snapshot on 35 2025.04.02 04:48:46.795102 [ 26639 ] {} RaftInstance: creating a snapshot for index 35 2025.04.02 04:48:46.795110 [ 26639 ] {} RaftInstance: create snapshot idx 35 log_term 35 2025.04.02 04:48:46.795121 [ 26639 ] {} KeeperStateMachine: Creating snapshot 35 2025.04.02 04:48:46.795162 [ 26639 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:46.797044 [ 26639 ] {} KeeperStateMachine: Created persistent snapshot 35 with path snapshot_35.bin.zstd 2025.04.02 04:48:46.797057 [ 26639 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:46.797064 [ 26639 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:46.797089 [ 26639 ] {} RaftInstance: snapshot idx 35 log_term 35 created, compact the log store if needed 2025.04.02 04:48:46.797099 [ 26639 ] {} RaftInstance: create snapshot idx 35 log_term 35 done: 1981 us elapsed 2025.04.02 04:48:46.797396 [ 27223 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:46.797428 [ 27224 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:46.797509 [ 27225 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:46.797588 [ 27232 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:46.797648 [ 27233 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:46.797475 [ 27226 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:46.797490 [ 27238 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:46.797458 [ 27234 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:46.797544 [ 27230 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:46.797544 [ 27227 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:46.797568 [ 27229 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:46.797648 [ 27231 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:46.797661 [ 27237 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:46.797667 [ 27236 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:46.797669 [ 27235 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:46.797473 [ 27228 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:46.799142 [ 26639 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:46.799228 [ 27221 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:46.799853 [ 26639 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:46.800010 [ 26639 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:46.800022 [ 26639 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:46.800036 [ 26639 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:46.800049 [ 26639 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:46.800314 [ 26639 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:46.800354 [ 26639 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:46.802008 [ 26639 ] {} Application: Destroyed global context. 2025.04.02 04:48:46.802206 [ 26639 ] {} Application: Waiting for background threads 2025.04.02 04:48:46.816939 [ 26639 ] {} Application: Background threads finished in 14 ms 2025.04.02 04:48:46.817357 [ 26639 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:46.817368 [ 26639 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:46.819776 [ 26639 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:46.819833 [ 26639 ] {} Application: shutting down 2025.04.02 04:48:46.819839 [ 26639 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:46.820444 [ 26640 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:46.820490 [ 26640 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:46.872281 [ 26638 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:47.172712 [ 27340 ] {} Application: Will watch for the process with pid 27341 2025.04.02 04:48:47.172927 [ 27341 ] {} Application: Forked a child process to watch 2025.04.02 04:48:47.173877 [ 27341 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:47.278523 [ 27341 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 27341 2025.04.02 04:48:47.278975 [ 27341 ] {} Application: starting up 2025.04.02 04:48:47.278994 [ 27341 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:47.287630 [ 27341 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:47.287716 [ 27341 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:47.287768 [ 27341 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:47.287781 [ 27341 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:47.287812 [ 27341 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:47.288686 [ 27341 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:47.288868 [ 27341 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:47.288884 [ 27341 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:47.288959 [ 27341 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:47.288973 [ 27341 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:47.588175 [ 27341 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:47.588346 [ 27341 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:47.615086 [ 27341 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:47.615152 [ 27341 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:47.615283 [ 27341 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:47.652268 [ 27349 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:47.652360 [ 27341 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:47.652415 [ 27341 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:47.652433 [ 27341 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:47.652445 [ 27341 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:47.652633 [ 27341 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:47.652857 [ 27341 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:47.658207 [ 27341 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:47.658254 [ 27341 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:47.658293 [ 27341 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:47.658789 [ 27341 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:47.658840 [ 27341 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:47.659438 [ 27341 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:47.661820 [ 27341 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:47.661899 [ 27341 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:47.661940 [ 27341 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:47.662133 [ 27341 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:47.666246 [ 27341 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:47.666270 [ 27341 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:47.669111 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:47.669603 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:47.669846 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:47.670099 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:47.670350 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:47.672350 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:47.672604 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:47.672867 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:47.673068 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:47.673317 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:47.673604 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:47.673832 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:47.674041 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:47.674242 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:47.674531 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:47.674789 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:47.675022 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:47.675240 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:47.675477 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:47.675722 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:47.675963 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:47.676191 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:47.676579 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:47.677134 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:47.677463 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:47.677883 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:47.678446 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:47.678720 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:47.678928 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:47.679155 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:47.679389 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:47.679654 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:47.679938 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:47.680159 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:47.680510 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:47.680761 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:47.681039 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:47.681393 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:47.681705 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:47.682280 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:47.682529 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:47.682717 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:47.682903 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:47.683082 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:47.683268 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:47.683490 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:47.683696 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:47.683886 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:47.684072 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:47.684865 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:47.685173 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:47.685561 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:47.685819 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:47.686006 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:47.686227 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:47.686608 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:47.686847 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:47.687050 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:47.687221 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:47.687402 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:47.687580 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:47.687870 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:47.688050 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:47.688266 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:47.688522 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:47.688735 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:47.689444 [ 27341 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:47.718020 [ 27341 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:47.718324 [ 27341 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:47.728651 [ 27341 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:47.728663 [ 27341 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:47.728668 [ 27341 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:47.732088 [ 27341 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:47.732100 [ 27341 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:47.732114 [ 27341 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:47.732134 [ 27341 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:47.732768 [ 27341 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:47.733758 [ 27341 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:47.736785 [ 27341 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:47.736882 [ 27341 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:47.736915 [ 27341 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:47.737601 [ 27341 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:47.737749 [ 27341 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:47.737849 [ 27341 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:47.738280 [ 27341 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:47.738304 [ 27341 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:47.738652 [ 27341 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:47.738659 [ 27341 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:47.738663 [ 27341 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:47.738671 [ 27341 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:47.738675 [ 27341 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:47.738715 [ 27341 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:47.738726 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.748589 [ 27341 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:47.750282 [ 27341 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:47.750297 [ 27341 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:47.750596 [ 27341 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:47.750702 [ 27341 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb 2025.04.02 04:48:47.750735 [ 27341 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb 2025.04.02 04:48:47.750746 [ 27341 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb, size 4 2025.04.02 04:48:47.750890 [ 27341 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb. 2025.04.02 04:48:47.751114 [ 27915 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb 2025.04.02 04:48:47.757569 [ 27915 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb, size 4 2025.04.02 04:48:47.757780 [ 27341 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb. 2025.04.02 04:48:47.757916 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.759847 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.759870 [ 27341 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb, Version: Latest, Offset: 2 2025.04.02 04:48:47.763366 [ 27341 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb 2025.04.02 04:48:47.763385 [ 27341 ] {} deleteFileFromS3: Object with path s3/dek/bkamgxbwkengzhzoajgqjomrlmlkb was removed from S3 2025.04.02 04:48:47.763421 [ 27341 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:47.763431 [ 27341 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:47.764258 [ 27341 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:47.766301 [ 27341 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:47.766317 [ 27341 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:47.766511 [ 27341 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:47.772246 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.774836 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.774860 [ 27341 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:47.779295 [ 27341 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:47.779394 [ 27341 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:47 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 183260847613E381 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:47.779457 [ 27341 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:47.783065 [ 27341 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:47.783092 [ 27341 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:47.783112 [ 27341 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:47.783127 [ 27341 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:47.783230 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.783256 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.783279 [ 27341 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:47.783302 [ 27341 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:47.783325 [ 27341 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:47.783349 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.783372 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.783407 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.783431 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.783454 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.784788 [ 27341 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:47.787742 [ 27341 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:47.787764 [ 27341 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:47.788082 [ 27341 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:47.792348 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/tfu/mjwiursugazcrlhwnqkezrnzwowua (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.794160 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/tfu/mjwiursugazcrlhwnqkezrnzwowua (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.794191 [ 27341 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/tfu/mjwiursugazcrlhwnqkezrnzwowua, Version: Latest, Offset: 2 2025.04.02 04:48:47.798006 [ 27341 ] {} deleteFileFromS3: No blob storage log, not writing blob special/tfu/mjwiursugazcrlhwnqkezrnzwowua 2025.04.02 04:48:47.798034 [ 27341 ] {} deleteFileFromS3: Object with path special/tfu/mjwiursugazcrlhwnqkezrnzwowua was removed from S3 2025.04.02 04:48:47.798051 [ 27341 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:47.798064 [ 27341 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:47.799298 [ 27341 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:47.802222 [ 27341 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:47.802242 [ 27341 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:47.802528 [ 27341 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:47.806703 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jpq/wbhoxzodisnwqtbudzxliffbbfylv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.808433 [ 27341 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/jpq/wbhoxzodisnwqtbudzxliffbbfylv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:47.808465 [ 27341 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/jpq/wbhoxzodisnwqtbudzxliffbbfylv, Version: Latest, Offset: 2 2025.04.02 04:48:47.812139 [ 27341 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/jpq/wbhoxzodisnwqtbudzxliffbbfylv 2025.04.02 04:48:47.812166 [ 27341 ] {} deleteFileFromS3: Object with path test_02944/jpq/wbhoxzodisnwqtbudzxliffbbfylv was removed from S3 2025.04.02 04:48:47.812183 [ 27341 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:47.812196 [ 27341 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:47.812234 [ 27341 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:47.814495 [ 27341 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:47.816524 [ 27341 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:47.816659 [ 27341 ] {} KeeperSnapshotManager: Found snapshot_33.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:47.816690 [ 27341 ] {} KeeperSnapshotManager: Found snapshot_35.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:47.816711 [ 27341 ] {} KeeperSnapshotManager: Found snapshot_34.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:47.817482 [ 27341 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:47.817573 [ 27341 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:47.817836 [ 27341 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:47.817860 [ 27341 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:47.817898 [ 27341 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:47.817911 [ 27341 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 35 2025.04.02 04:48:47.818340 [ 27341 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:47.818416 [ 27341 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 35 2025.04.02 04:48:47.818747 [ 27341 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 35 entries 2025.04.02 04:48:47.818777 [ 27341 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:47.818839 [ 27341 ] {} KeeperServer: Last local log idx 35 2025.04.02 04:48:47.818859 [ 27341 ] {} KeeperServer: Will use config from log store with log index 35 2025.04.02 04:48:47.819393 [ 27341 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:47.821972 [ 27341 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:47.822285 [ 27341 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:47.822331 [ 27341 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:47.822350 [ 27341 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:47.822370 [ 27341 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:47.822382 [ 27341 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:47.822405 [ 27341 ] {} RaftInstance: === INIT RAFT SERVER === commit index 35 term 35 election timer allowed log store start 1, end 35 config log idx 35, prev log idx 34 -- ASYNC REPLICATION -- 2025.04.02 04:48:47.822431 [ 27341 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:47.822482 [ 27341 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:47.822660 [ 27341 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:47.822739 [ 27942 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:47.872921 [ 27341 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:47.872953 [ 27925 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:47.873031 [ 27925 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:47.873104 [ 27925 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 35, state term 35, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:47.873131 [ 27925 ] {} RaftInstance: pre-vote term (0) is different, reset it to 35 2025.04.02 04:48:47.873303 [ 27925 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:47.875681 [ 27925 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 36, log idx 35, log term 35, priority (target 1 / mine 1) 2025.04.02 04:48:47.875715 [ 27925 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:47.875728 [ 27925 ] {} RaftInstance: state machine commit index 35, precommit index 35, last log index 35 2025.04.02 04:48:47.875989 [ 27923 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:47.876095 [ 27925 ] {} RaftInstance: [BECOME LEADER] appended new config at 36 2025.04.02 04:48:47.876241 [ 27941 ] {} RaftInstance: config at index 36 is committed, prev config log idx 35 2025.04.02 04:48:47.876316 [ 27941 ] {} RaftInstance: new config log idx 36, prev log idx 35, cur config log idx 35, prev log idx 34 2025.04.02 04:48:47.876347 [ 27941 ] {} RaftInstance: new configuration: log idx 36, prev log idx 35 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 36 2025.04.02 04:48:47.876430 [ 27341 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:47.876612 [ 27341 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:47.878210 [ 27341 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:47.878315 [ 27341 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:47.882263 [ 27341 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:47.882288 [ 27341 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:47.882786 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:47.882950 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:47.883160 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:47.883277 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:47.883380 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:47.883478 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:47.883585 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:47.883739 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:47.884911 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:47.885097 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:47.885308 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:47.885505 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:47.885699 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:47.885873 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:47.886065 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:47.886265 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:47.886446 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:47.886692 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:47.886885 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:47.887080 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:47.887266 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:47.887472 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:47.887857 [ 27341 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:47.894042 [ 27341 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:47.894118 [ 27341 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:47.897423 [ 27341 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:47.897465 [ 27341 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:47.897911 [ 27341 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:47.898163 [ 27341 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:47.898353 [ 27341 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:47.898601 [ 27947 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:47.900416 [ 27341 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:47.901029 [ 27341 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:47.902182 [ 27341 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:47.902709 [ 27341 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:47.904043 [ 27341 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:47.904633 [ 27341 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:47.905323 [ 27341 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:47.905891 [ 27341 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:47.905927 [ 27341 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:47.905989 [ 27352 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:47.906320 [ 27352 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:52.613077 [ 27341 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:52.613237 [ 27341 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:52.613518 [ 27341 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:52.613531 [ 27341 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:52.613600 [ 27349 ] {} CancellationChecker: Execution took 4961 ms. 2025.04.02 04:48:52.613776 [ 27341 ] {} Application: Shutting down storages. 2025.04.02 04:48:52.613789 [ 27341 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:52.615309 [ 27341 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:52.615337 [ 27341 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:52.615348 [ 27341 ] {} Context: Shutting down named sessions 2025.04.02 04:48:52.615387 [ 27341 ] {} Context: Shutting down database catalog 2025.04.02 04:48:52.615398 [ 27341 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:52.615458 [ 27341 ] {} Context: Shutting down merges executor 2025.04.02 04:48:52.615770 [ 27341 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:52.616104 [ 27341 ] {} Context: Shutting down moves executor 2025.04.02 04:48:52.616250 [ 27341 ] {} Context: Shutting down common executor 2025.04.02 04:48:52.616408 [ 27341 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:52.616420 [ 27341 ] {} Context: Shutting down caches 2025.04.02 04:48:52.616433 [ 27341 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:52.616847 [ 27341 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:52.619655 [ 27341 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:52.619980 [ 27341 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:52.620145 [ 27341 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:52.620393 [ 27341 ] {} Application: Shut down storages. 2025.04.02 04:48:52.620410 [ 27341 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:52.634558 [ 27341 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:52.634588 [ 27341 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:52.634601 [ 27341 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:52.878563 [ 27341 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:52.878629 [ 27341 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:52.878641 [ 27341 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:52.878726 [ 27341 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:52.878738 [ 27341 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:52.878759 [ 27341 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:52.878771 [ 27341 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:52.878864 [ 27341 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:52.878884 [ 27942 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:52.878995 [ 27341 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:52.879007 [ 27341 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:52.879017 [ 27341 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:52.879027 [ 27341 ] {} RaftInstance: manually create a snapshot on 36 2025.04.02 04:48:52.879039 [ 27341 ] {} RaftInstance: creating a snapshot for index 36 2025.04.02 04:48:52.879051 [ 27341 ] {} RaftInstance: create snapshot idx 36 log_term 36 2025.04.02 04:48:52.879072 [ 27341 ] {} KeeperStateMachine: Creating snapshot 36 2025.04.02 04:48:52.879135 [ 27341 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:52.882271 [ 27341 ] {} KeeperStateMachine: Created persistent snapshot 36 with path snapshot_36.bin.zstd 2025.04.02 04:48:52.882295 [ 27341 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:52.882305 [ 27341 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:52.882339 [ 27341 ] {} RaftInstance: snapshot idx 36 log_term 36 created, compact the log store if needed 2025.04.02 04:48:52.882355 [ 27341 ] {} RaftInstance: create snapshot idx 36 log_term 36 done: 3288 us elapsed 2025.04.02 04:48:52.882655 [ 27926 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:52.882697 [ 27928 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:52.882767 [ 27932 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:52.882797 [ 27933 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:52.882848 [ 27939 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:52.882874 [ 27934 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:52.882728 [ 27931 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:52.882736 [ 27930 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:52.882706 [ 27925 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:52.882786 [ 27935 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:52.882718 [ 27929 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:52.882860 [ 27937 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:52.882718 [ 27927 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:48:52.882868 [ 27936 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:52.882892 [ 27940 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:52.882779 [ 27938 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:52.883488 [ 27341 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:52.883527 [ 27923 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:52.883909 [ 27341 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:52.884013 [ 27341 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:52.884025 [ 27341 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:52.884041 [ 27341 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:52.884055 [ 27341 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:52.884206 [ 27341 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:52.884241 [ 27341 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:52.885725 [ 27341 ] {} Application: Destroyed global context. 2025.04.02 04:48:52.885924 [ 27341 ] {} Application: Waiting for background threads 2025.04.02 04:48:52.901976 [ 27341 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:52.902600 [ 27341 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:52.902618 [ 27341 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:52.907430 [ 27341 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:52.907549 [ 27341 ] {} Application: shutting down 2025.04.02 04:48:52.907561 [ 27341 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:52.908510 [ 27342 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:52.908548 [ 27342 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:52.994946 [ 27340 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:53.172431 [ 28042 ] {} Application: Will watch for the process with pid 28043 2025.04.02 04:48:53.172644 [ 28043 ] {} Application: Forked a child process to watch 2025.04.02 04:48:53.173631 [ 28043 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:53.275545 [ 28043 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 28043 2025.04.02 04:48:53.276039 [ 28043 ] {} Application: starting up 2025.04.02 04:48:53.276060 [ 28043 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:53.284359 [ 28043 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:53.284437 [ 28043 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:53.284489 [ 28043 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:53.284501 [ 28043 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:53.284538 [ 28043 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:53.285482 [ 28043 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:53.285693 [ 28043 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:53.285712 [ 28043 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:53.285780 [ 28043 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:53.285794 [ 28043 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:53.591527 [ 28043 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:53.591705 [ 28043 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:53.618391 [ 28043 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:53.618458 [ 28043 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:53.618585 [ 28043 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:53.662889 [ 28051 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:53.663033 [ 28043 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:53.663093 [ 28043 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:53.663111 [ 28043 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:53.663122 [ 28043 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:53.663317 [ 28043 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:53.663496 [ 28043 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:53.668590 [ 28043 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:53.668645 [ 28043 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:53.668709 [ 28043 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:53.669122 [ 28043 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:53.669157 [ 28043 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:53.669626 [ 28043 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:53.671198 [ 28043 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:53.671247 [ 28043 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:53.671275 [ 28043 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:53.671410 [ 28043 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:53.674358 [ 28043 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:53.674383 [ 28043 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:53.676407 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:53.676742 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:53.676897 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:53.677081 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:53.677277 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:53.678576 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:53.678757 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:53.678925 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:53.679064 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:53.679206 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:53.679396 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:53.679538 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:53.679702 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:53.679842 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:53.680028 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:53.680181 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:53.680328 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:53.680476 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:53.680639 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:53.680808 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:53.680971 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:53.681127 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:53.681414 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:53.681788 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:53.681949 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:53.682233 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:53.682610 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:53.682799 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:53.682941 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:53.683105 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:53.683269 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:53.683448 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:53.683639 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:53.683804 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:53.684024 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:53.684183 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:53.684371 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:53.684612 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:53.684831 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:53.685234 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:53.685484 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:53.685665 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:53.685867 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:53.686049 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:53.686238 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:53.686462 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:53.686653 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:53.686855 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:53.687046 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:53.687833 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:53.688137 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:53.688478 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:53.688741 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:53.688923 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:53.689101 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:53.689459 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:53.689670 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:53.689900 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:53.690082 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:53.690269 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:53.690447 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:53.690729 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:53.690912 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:53.691120 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:53.691383 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:53.691582 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:53.692277 [ 28043 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:53.712901 [ 28043 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:53.713294 [ 28043 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:53.723808 [ 28043 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:53.723829 [ 28043 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:53.723834 [ 28043 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:53.727397 [ 28043 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:53.727413 [ 28043 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:53.727430 [ 28043 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:53.727452 [ 28043 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:53.728291 [ 28043 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:53.729139 [ 28043 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:53.731560 [ 28043 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:53.731647 [ 28043 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:53.731689 [ 28043 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:53.732294 [ 28043 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:53.732429 [ 28043 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:53.732578 [ 28043 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:53.733023 [ 28043 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:53.733049 [ 28043 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:53.733408 [ 28043 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:53.733426 [ 28043 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:53.733431 [ 28043 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:53.733439 [ 28043 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:53.733444 [ 28043 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:53.733486 [ 28043 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:53.733496 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.754653 [ 28043 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:53.757882 [ 28043 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:53.757909 [ 28043 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:53.758530 [ 28043 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:53.758730 [ 28043 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl 2025.04.02 04:48:53.758805 [ 28043 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl 2025.04.02 04:48:53.758828 [ 28043 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl, size 4 2025.04.02 04:48:53.759123 [ 28043 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl. 2025.04.02 04:48:53.759231 [ 28617 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl 2025.04.02 04:48:53.765863 [ 28617 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl, size 4 2025.04.02 04:48:53.766178 [ 28043 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl. 2025.04.02 04:48:53.766454 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.768595 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.768628 [ 28043 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl, Version: Latest, Offset: 2 2025.04.02 04:48:53.772548 [ 28043 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl 2025.04.02 04:48:53.772576 [ 28043 ] {} deleteFileFromS3: Object with path s3/dyi/abtzjbetlzrhcbsfclibttsgspzxl was removed from S3 2025.04.02 04:48:53.772629 [ 28043 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:53.772645 [ 28043 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:53.773874 [ 28043 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:53.776880 [ 28043 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:53.776901 [ 28043 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:53.777174 [ 28043 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:53.783562 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.786919 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.786954 [ 28043 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:53.791133 [ 28043 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:53.791215 [ 28043 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:53 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326085DC690ECD x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:53.791268 [ 28043 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:53.794483 [ 28043 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:53.794511 [ 28043 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:53.794529 [ 28043 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:53.794542 [ 28043 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:53.794578 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.794615 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.794639 [ 28043 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:53.794663 [ 28043 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:53.794706 [ 28043 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:53.794731 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.794755 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.794778 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.794802 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.794825 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.796037 [ 28043 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:53.799123 [ 28043 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:53.799146 [ 28043 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:53.799431 [ 28043 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:53.803803 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/scb/pxqbszqeptyaizzdlmuymmnatynyr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.805403 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/scb/pxqbszqeptyaizzdlmuymmnatynyr (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.805444 [ 28043 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/scb/pxqbszqeptyaizzdlmuymmnatynyr, Version: Latest, Offset: 2 2025.04.02 04:48:53.809024 [ 28043 ] {} deleteFileFromS3: No blob storage log, not writing blob special/scb/pxqbszqeptyaizzdlmuymmnatynyr 2025.04.02 04:48:53.809050 [ 28043 ] {} deleteFileFromS3: Object with path special/scb/pxqbszqeptyaizzdlmuymmnatynyr was removed from S3 2025.04.02 04:48:53.809068 [ 28043 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:53.809081 [ 28043 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:53.810332 [ 28043 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:53.813372 [ 28043 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:53.813392 [ 28043 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:53.813672 [ 28043 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:53.818647 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dxv/mxycxmhuobnlsrmcxwzlzkgmwwbdb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.820241 [ 28043 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dxv/mxycxmhuobnlsrmcxwzlzkgmwwbdb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:53.820273 [ 28043 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/dxv/mxycxmhuobnlsrmcxwzlzkgmwwbdb, Version: Latest, Offset: 2 2025.04.02 04:48:53.823781 [ 28043 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/dxv/mxycxmhuobnlsrmcxwzlzkgmwwbdb 2025.04.02 04:48:53.823816 [ 28043 ] {} deleteFileFromS3: Object with path test_02944/dxv/mxycxmhuobnlsrmcxwzlzkgmwwbdb was removed from S3 2025.04.02 04:48:53.823834 [ 28043 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:53.823847 [ 28043 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:53.823885 [ 28043 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:53.826166 [ 28043 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:53.828195 [ 28043 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:53.828296 [ 28043 ] {} KeeperSnapshotManager: Found snapshot_35.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:53.828323 [ 28043 ] {} KeeperSnapshotManager: Found snapshot_34.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:53.828335 [ 28043 ] {} KeeperSnapshotManager: Found snapshot_36.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:53.829078 [ 28043 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:53.829163 [ 28043 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:53.829431 [ 28043 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:53.829454 [ 28043 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:53.829495 [ 28043 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:53.829508 [ 28043 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 36 2025.04.02 04:48:53.829947 [ 28043 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:53.830027 [ 28043 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 36 2025.04.02 04:48:53.830342 [ 28043 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 36 entries 2025.04.02 04:48:53.830368 [ 28043 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:53.830435 [ 28043 ] {} KeeperServer: Last local log idx 36 2025.04.02 04:48:53.830454 [ 28043 ] {} KeeperServer: Will use config from log store with log index 36 2025.04.02 04:48:53.831004 [ 28043 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:53.832773 [ 28043 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:53.832956 [ 28043 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:53.832976 [ 28043 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:53.832984 [ 28043 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:53.832994 [ 28043 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:53.832999 [ 28043 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:53.833010 [ 28043 ] {} RaftInstance: === INIT RAFT SERVER === commit index 36 term 36 election timer allowed log store start 1, end 36 config log idx 36, prev log idx 35 -- ASYNC REPLICATION -- 2025.04.02 04:48:53.833022 [ 28043 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:53.833047 [ 28043 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:53.833130 [ 28043 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:53.833236 [ 28644 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:53.883372 [ 28043 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:53.883362 [ 28628 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:53.883423 [ 28628 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:53.883491 [ 28628 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 36, state term 36, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:53.883505 [ 28628 ] {} RaftInstance: pre-vote term (0) is different, reset it to 36 2025.04.02 04:48:53.883611 [ 28628 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:53.886112 [ 28628 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 37, log idx 36, log term 36, priority (target 1 / mine 1) 2025.04.02 04:48:53.886143 [ 28628 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:53.886155 [ 28628 ] {} RaftInstance: state machine commit index 36, precommit index 36, last log index 36 2025.04.02 04:48:53.886355 [ 28625 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:53.886432 [ 28628 ] {} RaftInstance: [BECOME LEADER] appended new config at 37 2025.04.02 04:48:53.886520 [ 28643 ] {} RaftInstance: config at index 37 is committed, prev config log idx 36 2025.04.02 04:48:53.886550 [ 28643 ] {} RaftInstance: new config log idx 37, prev log idx 36, cur config log idx 36, prev log idx 35 2025.04.02 04:48:53.886572 [ 28643 ] {} RaftInstance: new configuration: log idx 37, prev log idx 36 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 37 2025.04.02 04:48:53.886688 [ 28043 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:53.886972 [ 28043 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:53.888611 [ 28043 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:53.888747 [ 28043 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:53.892791 [ 28043 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:53.892827 [ 28043 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:53.893353 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:53.893509 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:53.893733 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:53.893849 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:53.893947 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:53.894043 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:53.894139 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:53.894277 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:53.895430 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:53.895613 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:53.895800 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:53.895982 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:53.896159 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:53.896332 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:53.896503 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:53.896716 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:53.896885 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:53.897114 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:53.897345 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:53.897552 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:53.897756 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:53.897965 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:53.898326 [ 28043 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:53.903101 [ 28043 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:53.903178 [ 28043 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:53.906497 [ 28043 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:53.906546 [ 28043 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:53.907099 [ 28043 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:53.907387 [ 28043 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:53.907625 [ 28043 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:53.907893 [ 28649 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:53.909847 [ 28043 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:53.910332 [ 28043 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:53.911250 [ 28043 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:53.911834 [ 28043 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:53.913150 [ 28043 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:53.913757 [ 28043 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:53.914356 [ 28043 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:53.914924 [ 28043 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:53.914957 [ 28043 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:53.915041 [ 28053 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:53.915577 [ 28053 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:48:58.318739 [ 28043 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:58.318901 [ 28043 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:48:58.319175 [ 28043 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:48:58.319197 [ 28043 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:48:58.319281 [ 28051 ] {} CancellationChecker: Execution took 4656 ms. 2025.04.02 04:48:58.319490 [ 28043 ] {} Application: Shutting down storages. 2025.04.02 04:48:58.319507 [ 28043 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:48:58.321217 [ 28043 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:48:58.321234 [ 28043 ] {} Context: Shutting down workload entity storage 2025.04.02 04:48:58.321242 [ 28043 ] {} Context: Shutting down named sessions 2025.04.02 04:48:58.321301 [ 28043 ] {} Context: Shutting down database catalog 2025.04.02 04:48:58.321314 [ 28043 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:48:58.321368 [ 28043 ] {} Context: Shutting down merges executor 2025.04.02 04:48:58.321591 [ 28043 ] {} Context: Shutting down fetches executor 2025.04.02 04:48:58.321910 [ 28043 ] {} Context: Shutting down moves executor 2025.04.02 04:48:58.322108 [ 28043 ] {} Context: Shutting down common executor 2025.04.02 04:48:58.322288 [ 28043 ] {} Context: Shutting down DDLWorker 2025.04.02 04:48:58.322301 [ 28043 ] {} Context: Shutting down caches 2025.04.02 04:48:58.322312 [ 28043 ] {} Context: Shutting down AccessControl 2025.04.02 04:48:58.322664 [ 28043 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:48:58.325105 [ 28043 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:48:58.325416 [ 28043 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:48:58.325568 [ 28043 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:48:58.325843 [ 28043 ] {} Application: Shut down storages. 2025.04.02 04:48:58.325861 [ 28043 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:48:58.645280 [ 28043 ] {} Application: Closed all listening sockets. 2025.04.02 04:48:58.645337 [ 28043 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:48:58.645350 [ 28043 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:48:58.888962 [ 28043 ] {} RaftInstance: shutting down raft core 2025.04.02 04:48:58.889038 [ 28043 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:48:58.889048 [ 28043 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:48:58.889137 [ 28043 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:48:58.890055 [ 28043 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:48:58.890083 [ 28043 ] {} RaftInstance: reset all pointers. 2025.04.02 04:48:58.890115 [ 28043 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:48:58.890251 [ 28043 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:48:58.890252 [ 28644 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:48:58.890370 [ 28043 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:48:58.890392 [ 28043 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:48:58.890406 [ 28043 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:48:58.890419 [ 28043 ] {} RaftInstance: manually create a snapshot on 37 2025.04.02 04:48:58.890432 [ 28043 ] {} RaftInstance: creating a snapshot for index 37 2025.04.02 04:48:58.890443 [ 28043 ] {} RaftInstance: create snapshot idx 37 log_term 37 2025.04.02 04:48:58.890460 [ 28043 ] {} KeeperStateMachine: Creating snapshot 37 2025.04.02 04:48:58.890545 [ 28043 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:48:58.892575 [ 28043 ] {} KeeperStateMachine: Created persistent snapshot 37 with path snapshot_37.bin.zstd 2025.04.02 04:48:58.892598 [ 28043 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:48:58.892610 [ 28043 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:48:58.892647 [ 28043 ] {} RaftInstance: snapshot idx 37 log_term 37 created, compact the log store if needed 2025.04.02 04:48:58.892662 [ 28043 ] {} RaftInstance: create snapshot idx 37 log_term 37 done: 2208 us elapsed 2025.04.02 04:48:58.893037 [ 28628 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:48:58.893071 [ 28633 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:48:58.893098 [ 28635 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:48:58.893126 [ 28634 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:48:58.893147 [ 28630 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:48:58.893203 [ 28632 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:48:58.893248 [ 28637 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:48:58.893082 [ 28627 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:58.893318 [ 28639 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:48:58.893334 [ 28640 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:48:58.893162 [ 28636 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:48:58.893102 [ 28629 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:48:58.893043 [ 28631 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:48:58.893277 [ 28638 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:48:58.893282 [ 28642 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:48:58.893160 [ 28641 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:48:58.893877 [ 28043 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:58.893933 [ 28625 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:48:58.894336 [ 28043 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:48:58.894480 [ 28043 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:48:58.894492 [ 28043 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:48:58.894507 [ 28043 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:48:58.894521 [ 28043 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:58.894751 [ 28043 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:48:58.894797 [ 28043 ] {} Context: Destructing threadpool writer 2025.04.02 04:48:58.896470 [ 28043 ] {} Application: Destroyed global context. 2025.04.02 04:48:58.896749 [ 28043 ] {} Application: Waiting for background threads 2025.04.02 04:48:58.913440 [ 28043 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:48:58.914036 [ 28043 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:48:58.914057 [ 28043 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:48:58.918804 [ 28043 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:48:58.918917 [ 28043 ] {} Application: shutting down 2025.04.02 04:48:58.918929 [ 28043 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:48:58.919850 [ 28044 ] {} BaseDaemon: Received signal -2 2025.04.02 04:48:58.919900 [ 28044 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:48:59.000112 [ 28042 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:48:59.181647 [ 28744 ] {} Application: Will watch for the process with pid 28745 2025.04.02 04:48:59.181895 [ 28745 ] {} Application: Forked a child process to watch 2025.04.02 04:48:59.182795 [ 28745 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:48:59.287223 [ 28745 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 28745 2025.04.02 04:48:59.287634 [ 28745 ] {} Application: starting up 2025.04.02 04:48:59.287656 [ 28745 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:48:59.296391 [ 28745 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:48:59.296472 [ 28745 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:48:59.296523 [ 28745 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:48:59.296539 [ 28745 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:48:59.296565 [ 28745 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:48:59.297319 [ 28745 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:48:59.297506 [ 28745 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:48:59.297522 [ 28745 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:48:59.297596 [ 28745 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:48:59.297610 [ 28745 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:48:59.593746 [ 28745 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:48:59.593914 [ 28745 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:48:59.620734 [ 28745 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:48:59.620803 [ 28745 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:48:59.620923 [ 28745 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:48:59.657686 [ 28754 ] {} CancellationChecker: Started worker function 2025.04.02 04:48:59.657859 [ 28745 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:48:59.657915 [ 28745 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:48:59.657933 [ 28745 ] {} Application: Initializing DateLUT. 2025.04.02 04:48:59.657945 [ 28745 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:48:59.658126 [ 28745 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:48:59.658328 [ 28745 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:48:59.663508 [ 28745 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:48:59.663550 [ 28745 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:48:59.663589 [ 28745 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:48:59.664089 [ 28745 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:48:59.664150 [ 28745 ] {} Application: Initializing interserver credentials. 2025.04.02 04:48:59.664807 [ 28745 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:48:59.667389 [ 28745 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:59.667448 [ 28745 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:48:59.667492 [ 28745 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:48:59.667698 [ 28745 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:48:59.671820 [ 28745 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:48:59.671851 [ 28745 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:48:59.674688 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:48:59.675136 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:48:59.675351 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:48:59.675596 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:48:59.675860 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:48:59.677713 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:48:59.677975 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:48:59.678216 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:48:59.678417 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:48:59.678625 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:48:59.678913 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:48:59.679130 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:48:59.679358 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:48:59.679563 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:48:59.679858 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:48:59.680071 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:48:59.680287 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:48:59.680507 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:48:59.680760 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:48:59.680989 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:48:59.681276 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:48:59.681511 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:48:59.681891 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:48:59.682409 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:48:59.682635 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:48:59.683072 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:48:59.683633 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:48:59.683917 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:48:59.684134 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:48:59.684374 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:48:59.684619 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:48:59.684899 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:48:59.685218 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:48:59.685454 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:48:59.685795 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:48:59.686000 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:48:59.686193 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:48:59.686400 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:48:59.686584 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:48:59.687006 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:48:59.687255 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:48:59.687429 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:48:59.687612 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:48:59.687814 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:48:59.688006 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:48:59.688233 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:48:59.688421 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:48:59.688608 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:48:59.688816 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:48:59.689666 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:48:59.689989 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:48:59.690335 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:48:59.690575 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:48:59.690783 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:48:59.690961 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:48:59.691220 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:48:59.691414 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:48:59.691627 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:48:59.691821 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:48:59.692013 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:48:59.692195 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:48:59.692461 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:48:59.692642 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:48:59.692870 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:48:59.693128 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:48:59.693346 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:48:59.694032 [ 28745 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:48:59.716372 [ 28745 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:48:59.716951 [ 28745 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:48:59.728739 [ 28745 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:48:59.728759 [ 28745 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:48:59.728764 [ 28745 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:48:59.732615 [ 28745 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:48:59.732630 [ 28745 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:48:59.732644 [ 28745 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:48:59.732668 [ 28745 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:59.733466 [ 28745 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:59.734095 [ 28745 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:48:59.736368 [ 28745 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:48:59.736449 [ 28745 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:48:59.736477 [ 28745 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:59.737100 [ 28745 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:48:59.737268 [ 28745 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:48:59.737385 [ 28745 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:48:59.737819 [ 28745 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:48:59.737845 [ 28745 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:48:59.738301 [ 28745 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:48:59.738309 [ 28745 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:48:59.738313 [ 28745 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:48:59.738321 [ 28745 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:48:59.738326 [ 28745 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:48:59.738367 [ 28745 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:59.738379 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.748231 [ 28745 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:59.749678 [ 28745 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:59.749690 [ 28745 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:59.750010 [ 28745 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:59.750095 [ 28745 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv 2025.04.02 04:48:59.750135 [ 28745 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv 2025.04.02 04:48:59.750144 [ 28745 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv, size 4 2025.04.02 04:48:59.750284 [ 28745 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv. 2025.04.02 04:48:59.750451 [ 29319 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv 2025.04.02 04:48:59.756778 [ 29319 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv, size 4 2025.04.02 04:48:59.756957 [ 28745 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/mzl/dbnukkucytwcloencuudcmurzlhiv. 2025.04.02 04:48:59.757133 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/mzl/dbnukkucytwcloencuudcmurzlhiv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.759061 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/mzl/dbnukkucytwcloencuudcmurzlhiv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.759084 [ 28745 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/mzl/dbnukkucytwcloencuudcmurzlhiv, Version: Latest, Offset: 2 2025.04.02 04:48:59.762892 [ 28745 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/mzl/dbnukkucytwcloencuudcmurzlhiv 2025.04.02 04:48:59.762910 [ 28745 ] {} deleteFileFromS3: Object with path s3/mzl/dbnukkucytwcloencuudcmurzlhiv was removed from S3 2025.04.02 04:48:59.762947 [ 28745 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:48:59.762957 [ 28745 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:48:59.763905 [ 28745 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:59.766297 [ 28745 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:59.766324 [ 28745 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:59.766566 [ 28745 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:59.771903 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.774666 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.774691 [ 28745 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:48:59.778405 [ 28745 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:48:59.778463 [ 28745 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:48:59 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326087414890EA x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:48:59.778510 [ 28745 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:48:59.781551 [ 28745 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:59.781571 [ 28745 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:48:59.781585 [ 28745 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:48:59.781595 [ 28745 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:48:59.781661 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.781680 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.781698 [ 28745 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:59.781729 [ 28745 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:59.781748 [ 28745 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:48:59.781766 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.781784 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.781801 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.781819 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.781836 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.782848 [ 28745 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:59.784880 [ 28745 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:59.784895 [ 28745 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:59.785141 [ 28745 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:59.789350 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ozt/upbvlicfyiajfciejutzprweqcrbv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.790759 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/ozt/upbvlicfyiajfciejutzprweqcrbv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.790781 [ 28745 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/ozt/upbvlicfyiajfciejutzprweqcrbv, Version: Latest, Offset: 2 2025.04.02 04:48:59.794131 [ 28745 ] {} deleteFileFromS3: No blob storage log, not writing blob special/ozt/upbvlicfyiajfciejutzprweqcrbv 2025.04.02 04:48:59.794152 [ 28745 ] {} deleteFileFromS3: Object with path special/ozt/upbvlicfyiajfciejutzprweqcrbv was removed from S3 2025.04.02 04:48:59.794166 [ 28745 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:48:59.794176 [ 28745 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:48:59.795227 [ 28745 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:48:59.797336 [ 28745 ] {} S3Client: Provider type: Unknown 2025.04.02 04:48:59.797356 [ 28745 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:48:59.797607 [ 28745 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:48:59.801906 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dji/wlozxbaasdcdvqpdpangkjgawyhvc (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.803681 [ 28745 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/dji/wlozxbaasdcdvqpdpangkjgawyhvc (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:48:59.803714 [ 28745 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/dji/wlozxbaasdcdvqpdpangkjgawyhvc, Version: Latest, Offset: 2 2025.04.02 04:48:59.807269 [ 28745 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/dji/wlozxbaasdcdvqpdpangkjgawyhvc 2025.04.02 04:48:59.807298 [ 28745 ] {} deleteFileFromS3: Object with path test_02944/dji/wlozxbaasdcdvqpdpangkjgawyhvc was removed from S3 2025.04.02 04:48:59.807317 [ 28745 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:48:59.807331 [ 28745 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:48:59.807409 [ 28745 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:48:59.809471 [ 28745 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:48:59.811385 [ 28745 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:48:59.811489 [ 28745 ] {} KeeperSnapshotManager: Found snapshot_35.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:59.811518 [ 28745 ] {} KeeperSnapshotManager: Found snapshot_37.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:59.811530 [ 28745 ] {} KeeperSnapshotManager: Found snapshot_36.bin.zstd on LocalSnapshotDisk 2025.04.02 04:48:59.812374 [ 28745 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:48:59.812455 [ 28745 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:48:59.812650 [ 28745 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:48:59.812668 [ 28745 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:48:59.812712 [ 28745 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:48:59.812739 [ 28745 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 37 2025.04.02 04:48:59.813085 [ 28745 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:48:59.813164 [ 28745 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 37 2025.04.02 04:48:59.813545 [ 28745 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 37 entries 2025.04.02 04:48:59.813578 [ 28745 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:48:59.813638 [ 28745 ] {} KeeperServer: Last local log idx 37 2025.04.02 04:48:59.813657 [ 28745 ] {} KeeperServer: Will use config from log store with log index 37 2025.04.02 04:48:59.814290 [ 28745 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:48:59.817075 [ 28745 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:48:59.817384 [ 28745 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:48:59.817425 [ 28745 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:48:59.817445 [ 28745 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:48:59.817465 [ 28745 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:48:59.817490 [ 28745 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:48:59.817517 [ 28745 ] {} RaftInstance: === INIT RAFT SERVER === commit index 37 term 37 election timer allowed log store start 1, end 37 config log idx 37, prev log idx 36 -- ASYNC REPLICATION -- 2025.04.02 04:48:59.817543 [ 28745 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:48:59.817596 [ 28745 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:48:59.817770 [ 28745 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:48:59.817815 [ 29346 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:48:59.868023 [ 29329 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:48:59.868076 [ 29329 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:48:59.868099 [ 28745 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:48:59.868143 [ 29329 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 37, state term 37, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:48:59.868158 [ 29329 ] {} RaftInstance: pre-vote term (0) is different, reset it to 37 2025.04.02 04:48:59.868291 [ 29329 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:48:59.871495 [ 29329 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 38, log idx 37, log term 37, priority (target 1 / mine 1) 2025.04.02 04:48:59.871524 [ 29329 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:48:59.871536 [ 29329 ] {} RaftInstance: state machine commit index 37, precommit index 37, last log index 37 2025.04.02 04:48:59.871785 [ 29327 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:48:59.871858 [ 29329 ] {} RaftInstance: [BECOME LEADER] appended new config at 38 2025.04.02 04:48:59.871976 [ 29345 ] {} RaftInstance: config at index 38 is committed, prev config log idx 37 2025.04.02 04:48:59.872035 [ 29345 ] {} RaftInstance: new config log idx 38, prev log idx 37, cur config log idx 37, prev log idx 36 2025.04.02 04:48:59.872066 [ 29345 ] {} RaftInstance: new configuration: log idx 38, prev log idx 37 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 38 2025.04.02 04:48:59.872136 [ 28745 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:48:59.872343 [ 28745 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:48:59.874044 [ 28745 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:48:59.874151 [ 28745 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:48:59.878119 [ 28745 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:48:59.878144 [ 28745 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:48:59.878634 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:48:59.878807 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:48:59.879013 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:48:59.879125 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:48:59.879241 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:48:59.879337 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:48:59.879440 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:48:59.879569 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:48:59.880709 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:48:59.880911 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:48:59.881081 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:48:59.881299 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:48:59.881485 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:48:59.881657 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:48:59.881844 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:48:59.882042 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:48:59.882216 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:48:59.882439 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:48:59.882622 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:48:59.882831 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:48:59.883021 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:48:59.883218 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:48:59.883575 [ 28745 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:48:59.888262 [ 28745 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:48:59.888339 [ 28745 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:48:59.891829 [ 28745 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:48:59.891874 [ 28745 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:48:59.892346 [ 28745 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:48:59.892606 [ 28745 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:48:59.892828 [ 28745 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:48:59.893076 [ 29351 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:48:59.895024 [ 28745 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:48:59.895559 [ 28745 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:48:59.896664 [ 28745 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:48:59.897250 [ 28745 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:48:59.898557 [ 28745 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:48:59.899187 [ 28745 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:48:59.899843 [ 28745 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:48:59.900465 [ 28745 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:48:59.900502 [ 28745 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:48:59.900584 [ 28752 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:48:59.900974 [ 28752 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:04.622696 [ 28745 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:04.622856 [ 28745 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:04.623108 [ 28745 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:04.623122 [ 28745 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:04.623186 [ 28754 ] {} CancellationChecker: Execution took 4965 ms. 2025.04.02 04:49:04.623357 [ 28745 ] {} Application: Shutting down storages. 2025.04.02 04:49:04.623370 [ 28745 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:04.624994 [ 28745 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:04.625012 [ 28745 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:04.625019 [ 28745 ] {} Context: Shutting down named sessions 2025.04.02 04:49:04.625041 [ 28745 ] {} Context: Shutting down database catalog 2025.04.02 04:49:04.625049 [ 28745 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:04.625090 [ 28745 ] {} Context: Shutting down merges executor 2025.04.02 04:49:04.625456 [ 28745 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:04.625818 [ 28745 ] {} Context: Shutting down moves executor 2025.04.02 04:49:04.625980 [ 28745 ] {} Context: Shutting down common executor 2025.04.02 04:49:04.626189 [ 28745 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:04.626212 [ 28745 ] {} Context: Shutting down caches 2025.04.02 04:49:04.626226 [ 28745 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:04.626641 [ 28745 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:04.629704 [ 28745 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:04.629927 [ 28745 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:04.630071 [ 28745 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:04.630247 [ 28745 ] {} Application: Shut down storages. 2025.04.02 04:49:04.630260 [ 28745 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:04.881004 [ 28745 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:04.881072 [ 28745 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:04.881086 [ 28745 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:05.374823 [ 28745 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:05.374887 [ 28745 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:05.374900 [ 28745 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:05.375014 [ 28745 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:05.375026 [ 28745 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:05.375049 [ 28745 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:05.375061 [ 28745 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:05.375179 [ 28745 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:05.375200 [ 29346 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:05.375322 [ 28745 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:05.375336 [ 28745 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:05.375345 [ 28745 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:05.375356 [ 28745 ] {} RaftInstance: manually create a snapshot on 38 2025.04.02 04:49:05.375368 [ 28745 ] {} RaftInstance: creating a snapshot for index 38 2025.04.02 04:49:05.375380 [ 28745 ] {} RaftInstance: create snapshot idx 38 log_term 38 2025.04.02 04:49:05.375403 [ 28745 ] {} KeeperStateMachine: Creating snapshot 38 2025.04.02 04:49:05.375463 [ 28745 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:05.378239 [ 28745 ] {} KeeperStateMachine: Created persistent snapshot 38 with path snapshot_38.bin.zstd 2025.04.02 04:49:05.378264 [ 28745 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:05.378274 [ 28745 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:05.378309 [ 28745 ] {} RaftInstance: snapshot idx 38 log_term 38 created, compact the log store if needed 2025.04.02 04:49:05.378325 [ 28745 ] {} RaftInstance: create snapshot idx 38 log_term 38 done: 2929 us elapsed 2025.04.02 04:49:05.378673 [ 29332 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:05.378720 [ 29336 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:05.378813 [ 29337 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:05.378847 [ 29335 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:05.378889 [ 29340 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:05.378955 [ 29342 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:05.378707 [ 29338 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:05.378672 [ 29329 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:05.378775 [ 29339 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:05.378783 [ 29333 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:05.378829 [ 29341 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:05.378673 [ 29331 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:05.378860 [ 29343 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:05.378681 [ 29334 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:05.378910 [ 29344 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:05.378683 [ 29330 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:05.379909 [ 28745 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:05.379947 [ 29327 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:05.380390 [ 28745 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:05.380534 [ 28745 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:05.380547 [ 28745 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:05.380563 [ 28745 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:05.380576 [ 28745 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:05.380828 [ 28745 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:05.380862 [ 28745 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:05.382618 [ 28745 ] {} Application: Destroyed global context. 2025.04.02 04:49:05.382855 [ 28745 ] {} Application: Waiting for background threads 2025.04.02 04:49:05.398850 [ 28745 ] {} Application: Background threads finished in 15 ms 2025.04.02 04:49:05.399421 [ 28745 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:05.399440 [ 28745 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:05.403974 [ 28745 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:05.404088 [ 28745 ] {} Application: shutting down 2025.04.02 04:49:05.404100 [ 28745 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:05.405141 [ 28746 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:05.405220 [ 28746 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:05.485296 [ 28744 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:06.041930 [ 29450 ] {} Application: Will watch for the process with pid 29451 2025.04.02 04:49:06.042137 [ 29451 ] {} Application: Forked a child process to watch 2025.04.02 04:49:06.043044 [ 29451 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:06.143819 [ 29451 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 29451 2025.04.02 04:49:06.144380 [ 29451 ] {} Application: starting up 2025.04.02 04:49:06.144399 [ 29451 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:06.152576 [ 29451 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:06.152658 [ 29451 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:06.152710 [ 29451 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:06.152722 [ 29451 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:06.152747 [ 29451 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:06.153457 [ 29451 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:06.153645 [ 29451 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:06.153662 [ 29451 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:06.153733 [ 29451 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:06.153747 [ 29451 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:06.449136 [ 29451 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:06.449319 [ 29451 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:06.475967 [ 29451 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:06.476060 [ 29451 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:06.476192 [ 29451 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:06.512822 [ 29461 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:06.512964 [ 29451 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:06.513021 [ 29451 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:06.513038 [ 29451 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:06.513050 [ 29451 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:06.513290 [ 29451 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:06.513487 [ 29451 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:06.518604 [ 29451 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:06.518641 [ 29451 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:06.518677 [ 29451 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:06.519164 [ 29451 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:06.519233 [ 29451 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:06.519858 [ 29451 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:06.522148 [ 29451 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:06.522217 [ 29451 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:06.522256 [ 29451 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:06.522449 [ 29451 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:06.526727 [ 29451 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:06.526756 [ 29451 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:06.529556 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:06.529992 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:06.530207 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:06.530448 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:06.530687 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:06.532508 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:06.532745 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:06.532994 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:06.533226 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:06.533440 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:06.533712 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:06.533958 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:06.534168 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:06.534362 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:06.534632 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:06.534851 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:06.535062 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:06.535269 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:06.535496 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:06.535711 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:06.535982 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:06.536205 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:06.536558 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:06.537087 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:06.537401 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:06.537807 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:06.538348 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:06.538597 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:06.538820 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:06.539049 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:06.539279 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:06.539520 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:06.539809 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:06.540032 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:06.540340 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:06.540516 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:06.540702 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:06.540915 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:06.541093 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:06.541488 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:06.541732 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:06.541920 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:06.542102 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:06.542283 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:06.542461 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:06.542675 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:06.542875 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:06.543058 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:06.543249 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:06.544009 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:06.544296 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:06.544627 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:06.544887 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:06.545071 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:06.545263 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:06.545522 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:06.545711 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:06.545925 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:06.546093 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:06.546270 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:06.546443 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:06.546705 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:06.546894 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:06.547104 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:06.547351 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:06.547544 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:06.548205 [ 29451 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:06.570297 [ 29451 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:06.570851 [ 29451 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:06.581243 [ 29451 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:06.581257 [ 29451 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:06.581262 [ 29451 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:06.584638 [ 29451 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:06.584651 [ 29451 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:06.584665 [ 29451 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:06.584691 [ 29451 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:06.585576 [ 29451 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:06.586368 [ 29451 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:06.588610 [ 29451 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:06.588691 [ 29451 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:06.588717 [ 29451 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:06.589313 [ 29451 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:06.589447 [ 29451 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:06.589548 [ 29451 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:06.589994 [ 29451 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:06.590021 [ 29451 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:06.590354 [ 29451 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:06.590361 [ 29451 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:06.590365 [ 29451 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:06.590373 [ 29451 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:06.590378 [ 29451 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:06.590417 [ 29451 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:06.590427 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.600217 [ 29451 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:06.601627 [ 29451 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:06.601639 [ 29451 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:06.601958 [ 29451 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:06.602046 [ 29451 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd 2025.04.02 04:49:06.602081 [ 29451 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd 2025.04.02 04:49:06.602090 [ 29451 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd, size 4 2025.04.02 04:49:06.602225 [ 29451 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd. 2025.04.02 04:49:06.602362 [ 30025 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd 2025.04.02 04:49:06.609037 [ 30025 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd, size 4 2025.04.02 04:49:06.609289 [ 29451 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd. 2025.04.02 04:49:06.609480 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.611288 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.611312 [ 29451 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd, Version: Latest, Offset: 2 2025.04.02 04:49:06.615150 [ 29451 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd 2025.04.02 04:49:06.615168 [ 29451 ] {} deleteFileFromS3: Object with path s3/bqz/xfjocbrzykaqzkllonjwkutpxwvxd was removed from S3 2025.04.02 04:49:06.615205 [ 29451 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:06.615214 [ 29451 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:06.616014 [ 29451 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:06.618044 [ 29451 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:06.618061 [ 29451 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:06.618319 [ 29451 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:06.624393 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.627302 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.627325 [ 29451 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:06.630907 [ 29451 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:06.630961 [ 29451 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:06 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 18326088D9B8C959 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:06.631003 [ 29451 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:06.634190 [ 29451 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:06.634213 [ 29451 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:06.634226 [ 29451 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:06.634234 [ 29451 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:06.634275 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.634292 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.634308 [ 29451 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:06.634324 [ 29451 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:06.634340 [ 29451 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:06.634363 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.634379 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.634395 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.634411 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.634427 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.635254 [ 29451 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:06.637296 [ 29451 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:06.637309 [ 29451 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:06.637507 [ 29451 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:06.642093 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/tlz/amkrxxqnocewgcnocpzcxstjlvxdm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.643534 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/tlz/amkrxxqnocewgcnocpzcxstjlvxdm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.643556 [ 29451 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/tlz/amkrxxqnocewgcnocpzcxstjlvxdm, Version: Latest, Offset: 2 2025.04.02 04:49:06.646942 [ 29451 ] {} deleteFileFromS3: No blob storage log, not writing blob special/tlz/amkrxxqnocewgcnocpzcxstjlvxdm 2025.04.02 04:49:06.646969 [ 29451 ] {} deleteFileFromS3: Object with path special/tlz/amkrxxqnocewgcnocpzcxstjlvxdm was removed from S3 2025.04.02 04:49:06.646986 [ 29451 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:06.646999 [ 29451 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:06.648226 [ 29451 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:06.651896 [ 29451 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:06.651928 [ 29451 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:06.652222 [ 29451 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:06.656759 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/xzs/qkpexrfhnefevttopqovzkflcvzwv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.658751 [ 29451 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/xzs/qkpexrfhnefevttopqovzkflcvzwv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:06.658810 [ 29451 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/xzs/qkpexrfhnefevttopqovzkflcvzwv, Version: Latest, Offset: 2 2025.04.02 04:49:06.662875 [ 29451 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/xzs/qkpexrfhnefevttopqovzkflcvzwv 2025.04.02 04:49:06.662902 [ 29451 ] {} deleteFileFromS3: Object with path test_02944/xzs/qkpexrfhnefevttopqovzkflcvzwv was removed from S3 2025.04.02 04:49:06.662920 [ 29451 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:06.662932 [ 29451 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:06.662971 [ 29451 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:06.664971 [ 29451 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:06.667095 [ 29451 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:06.667204 [ 29451 ] {} KeeperSnapshotManager: Found snapshot_38.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:06.667233 [ 29451 ] {} KeeperSnapshotManager: Found snapshot_37.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:06.667245 [ 29451 ] {} KeeperSnapshotManager: Found snapshot_36.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:06.667985 [ 29451 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:06.668066 [ 29451 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:06.668274 [ 29451 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:06.668291 [ 29451 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:06.668324 [ 29451 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:06.668336 [ 29451 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 38 2025.04.02 04:49:06.668733 [ 29451 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:06.668829 [ 29451 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 38 2025.04.02 04:49:06.669098 [ 29451 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 38 entries 2025.04.02 04:49:06.669125 [ 29451 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:06.669227 [ 29451 ] {} KeeperServer: Last local log idx 38 2025.04.02 04:49:06.669249 [ 29451 ] {} KeeperServer: Will use config from log store with log index 38 2025.04.02 04:49:06.669805 [ 29451 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:06.672377 [ 29451 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:06.672654 [ 29451 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:06.672696 [ 29451 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:06.672714 [ 29451 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:06.672734 [ 29451 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:06.672746 [ 29451 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:06.672792 [ 29451 ] {} RaftInstance: === INIT RAFT SERVER === commit index 38 term 38 election timer allowed log store start 1, end 38 config log idx 38, prev log idx 37 -- ASYNC REPLICATION -- 2025.04.02 04:49:06.672818 [ 29451 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:06.672869 [ 29451 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:06.673025 [ 29451 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:06.673102 [ 30052 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:06.723327 [ 29451 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:06.723342 [ 30035 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:06.723414 [ 30035 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:06.723512 [ 30035 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 38, state term 38, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:06.723525 [ 30035 ] {} RaftInstance: pre-vote term (0) is different, reset it to 38 2025.04.02 04:49:06.723682 [ 30035 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:06.726145 [ 30035 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 39, log idx 38, log term 38, priority (target 1 / mine 1) 2025.04.02 04:49:06.726232 [ 30035 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:06.726245 [ 30035 ] {} RaftInstance: state machine commit index 38, precommit index 38, last log index 38 2025.04.02 04:49:06.726465 [ 30033 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:06.726594 [ 30035 ] {} RaftInstance: [BECOME LEADER] appended new config at 39 2025.04.02 04:49:06.726736 [ 30051 ] {} RaftInstance: config at index 39 is committed, prev config log idx 38 2025.04.02 04:49:06.726808 [ 30051 ] {} RaftInstance: new config log idx 39, prev log idx 38, cur config log idx 38, prev log idx 37 2025.04.02 04:49:06.726834 [ 30051 ] {} RaftInstance: new configuration: log idx 39, prev log idx 38 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 39 2025.04.02 04:49:06.726900 [ 29451 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:06.727059 [ 29451 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:06.728793 [ 29451 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:06.728899 [ 29451 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:06.732850 [ 29451 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:06.732875 [ 29451 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:06.733386 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:06.733548 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:06.733756 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:06.733891 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:06.733989 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:06.734084 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:06.734188 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:06.734315 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:06.735450 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:06.735633 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:06.735816 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:06.735992 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:06.736180 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:06.736350 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:06.736520 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:06.736712 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:06.736900 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:06.737115 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:06.737337 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:06.737534 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:06.737717 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:06.737931 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:06.738285 [ 29451 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:06.742956 [ 29451 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:06.743032 [ 29451 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:06.746600 [ 29451 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:06.746645 [ 29451 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:06.747116 [ 29451 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:06.747369 [ 29451 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:06.747579 [ 29451 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:06.747920 [ 30057 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:06.749579 [ 29451 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:06.750285 [ 29451 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:06.751399 [ 29451 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:06.752003 [ 29451 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:06.753314 [ 29451 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:06.753954 [ 29451 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:06.754549 [ 29451 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:06.755139 [ 29451 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:06.755173 [ 29451 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:06.755228 [ 29463 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:06.755555 [ 29463 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:11.213297 [ 29451 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:11.213443 [ 29451 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:11.213718 [ 29451 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:11.213731 [ 29451 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:11.213831 [ 29461 ] {} CancellationChecker: Execution took 4700 ms. 2025.04.02 04:49:11.214031 [ 29451 ] {} Application: Shutting down storages. 2025.04.02 04:49:11.214045 [ 29451 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:11.215551 [ 29451 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:11.215568 [ 29451 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:11.215578 [ 29451 ] {} Context: Shutting down named sessions 2025.04.02 04:49:11.215608 [ 29451 ] {} Context: Shutting down database catalog 2025.04.02 04:49:11.215619 [ 29451 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:11.215673 [ 29451 ] {} Context: Shutting down merges executor 2025.04.02 04:49:11.215947 [ 29451 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:11.216133 [ 29451 ] {} Context: Shutting down moves executor 2025.04.02 04:49:11.216272 [ 29451 ] {} Context: Shutting down common executor 2025.04.02 04:49:11.216433 [ 29451 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:11.216441 [ 29451 ] {} Context: Shutting down caches 2025.04.02 04:49:11.216450 [ 29451 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:11.216767 [ 29451 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:11.219258 [ 29451 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:11.219559 [ 29451 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:11.219709 [ 29451 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:11.219928 [ 29451 ] {} Application: Shut down storages. 2025.04.02 04:49:11.219940 [ 29451 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:11.234865 [ 29451 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:11.234900 [ 29451 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:11.234913 [ 29451 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:11.729015 [ 29451 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:11.729063 [ 29451 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:11.729070 [ 29451 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:11.729156 [ 29451 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:11.729162 [ 29451 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:11.729174 [ 29451 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:11.729180 [ 29451 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:11.729275 [ 29451 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:11.729284 [ 30052 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:11.729371 [ 29451 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:11.729379 [ 29451 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:11.729384 [ 29451 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:11.729389 [ 29451 ] {} RaftInstance: manually create a snapshot on 39 2025.04.02 04:49:11.729396 [ 29451 ] {} RaftInstance: creating a snapshot for index 39 2025.04.02 04:49:11.729402 [ 29451 ] {} RaftInstance: create snapshot idx 39 log_term 39 2025.04.02 04:49:11.729414 [ 29451 ] {} KeeperStateMachine: Creating snapshot 39 2025.04.02 04:49:11.729450 [ 29451 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:11.731209 [ 29451 ] {} KeeperStateMachine: Created persistent snapshot 39 with path snapshot_39.bin.zstd 2025.04.02 04:49:11.731219 [ 29451 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:11.731224 [ 29451 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:11.731242 [ 29451 ] {} RaftInstance: snapshot idx 39 log_term 39 created, compact the log store if needed 2025.04.02 04:49:11.731249 [ 29451 ] {} RaftInstance: create snapshot idx 39 log_term 39 done: 1839 us elapsed 2025.04.02 04:49:11.731474 [ 30035 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:11.731522 [ 30048 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:11.731515 [ 30037 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:11.731532 [ 30042 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:11.731529 [ 30049 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:11.731537 [ 30038 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:11.731551 [ 30036 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:11.731620 [ 30039 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:11.731621 [ 30045 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:11.731597 [ 30041 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:11.731613 [ 30044 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:11.731618 [ 30040 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:11.731618 [ 30043 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:11.731639 [ 30050 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:11.731688 [ 30046 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:11.731720 [ 30047 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:11.732861 [ 29451 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:11.732885 [ 30033 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:11.733487 [ 29451 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:11.733574 [ 29451 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:11.733587 [ 29451 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:11.733603 [ 29451 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:11.733616 [ 29451 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:11.733978 [ 29451 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:11.734045 [ 29451 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:11.735614 [ 29451 ] {} Application: Destroyed global context. 2025.04.02 04:49:11.735815 [ 29451 ] {} Application: Waiting for background threads 2025.04.02 04:49:11.751836 [ 29451 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:49:11.752503 [ 29451 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:11.752521 [ 29451 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:11.757443 [ 29451 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:11.757575 [ 29451 ] {} Application: shutting down 2025.04.02 04:49:11.757587 [ 29451 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:11.758647 [ 29452 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:11.758706 [ 29452 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:11.840072 [ 29450 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:12.078965 [ 30152 ] {} Application: Will watch for the process with pid 30153 2025.04.02 04:49:12.079097 [ 30153 ] {} Application: Forked a child process to watch 2025.04.02 04:49:12.079599 [ 30153 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:12.170091 [ 30153 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 30153 2025.04.02 04:49:12.170612 [ 30153 ] {} Application: starting up 2025.04.02 04:49:12.170632 [ 30153 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:12.178832 [ 30153 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:12.178905 [ 30153 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:12.178956 [ 30153 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:12.178977 [ 30153 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:12.179002 [ 30153 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:12.179850 [ 30153 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:12.180023 [ 30153 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:12.180039 [ 30153 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:12.180109 [ 30153 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:12.180123 [ 30153 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:12.474697 [ 30153 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:12.474868 [ 30153 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:12.502108 [ 30153 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:12.502173 [ 30153 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:12.502302 [ 30153 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:12.538782 [ 30160 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:12.538881 [ 30153 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:12.538939 [ 30153 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:12.538957 [ 30153 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:12.538969 [ 30153 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:12.539148 [ 30153 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:12.539348 [ 30153 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:12.544551 [ 30153 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:12.544587 [ 30153 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:12.544622 [ 30153 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:12.545092 [ 30153 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:12.545139 [ 30153 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:12.545771 [ 30153 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:12.548074 [ 30153 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:12.548132 [ 30153 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:12.548169 [ 30153 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:12.548362 [ 30153 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:12.552466 [ 30153 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:12.552490 [ 30153 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:12.555364 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:12.555797 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:12.556050 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:12.556293 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:12.556528 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:12.558422 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:12.558666 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:12.558924 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:12.559124 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:12.559332 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:12.559604 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:12.559823 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:12.560033 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:12.560236 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:12.560508 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:12.560720 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:12.560952 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:12.561166 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:12.561496 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:12.561724 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:12.561972 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:12.562199 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:12.562561 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:12.563094 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:12.563322 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:12.563702 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:12.564281 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:12.564541 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:12.564741 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:12.564997 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:12.565257 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:12.565515 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:12.565829 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:12.566059 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:12.566374 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:12.566599 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:12.566887 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:12.567179 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:12.567436 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:12.568013 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:12.568360 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:12.568534 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:12.568711 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:12.568902 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:12.569086 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:12.569330 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:12.569519 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:12.569701 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:12.569901 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:12.570645 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:12.570955 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:12.571296 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:12.571528 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:12.571706 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:12.571895 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:12.572150 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:12.572350 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:12.572557 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:12.572727 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:12.572920 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:12.573095 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:12.573377 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:12.573556 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:12.573758 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:12.574029 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:12.574223 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:12.574884 [ 30153 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:12.601542 [ 30153 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:12.601876 [ 30153 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:12.612126 [ 30153 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:12.612138 [ 30153 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:12.612143 [ 30153 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:12.615518 [ 30153 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:12.615528 [ 30153 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:12.615547 [ 30153 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:12.615569 [ 30153 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:12.616265 [ 30153 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:12.616916 [ 30153 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:12.619050 [ 30153 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:12.619127 [ 30153 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:12.619152 [ 30153 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:12.619697 [ 30153 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:12.619835 [ 30153 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:12.619933 [ 30153 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:12.620342 [ 30153 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:12.620372 [ 30153 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:12.620705 [ 30153 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:12.620712 [ 30153 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:12.620716 [ 30153 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:12.620724 [ 30153 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:12.620728 [ 30153 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:12.620767 [ 30153 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:12.620778 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.630596 [ 30153 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:12.631997 [ 30153 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:12.632007 [ 30153 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:12.632293 [ 30153 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:12.632380 [ 30153 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt 2025.04.02 04:49:12.632415 [ 30153 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt 2025.04.02 04:49:12.632425 [ 30153 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt, size 4 2025.04.02 04:49:12.632561 [ 30153 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt. 2025.04.02 04:49:12.632742 [ 30727 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt 2025.04.02 04:49:12.639055 [ 30727 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt, size 4 2025.04.02 04:49:12.639314 [ 30153 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/aof/yvzkgxylfgcpiuwetxngqancfejwt. 2025.04.02 04:49:12.639506 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/aof/yvzkgxylfgcpiuwetxngqancfejwt (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.641513 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/aof/yvzkgxylfgcpiuwetxngqancfejwt (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.641535 [ 30153 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/aof/yvzkgxylfgcpiuwetxngqancfejwt, Version: Latest, Offset: 2 2025.04.02 04:49:12.645227 [ 30153 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/aof/yvzkgxylfgcpiuwetxngqancfejwt 2025.04.02 04:49:12.645246 [ 30153 ] {} deleteFileFromS3: Object with path s3/aof/yvzkgxylfgcpiuwetxngqancfejwt was removed from S3 2025.04.02 04:49:12.645286 [ 30153 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:12.645296 [ 30153 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:12.646117 [ 30153 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:12.648120 [ 30153 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:12.648135 [ 30153 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:12.648320 [ 30153 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:12.654661 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.657371 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.657395 [ 30153 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:12.660748 [ 30153 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:12.660800 [ 30153 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:12 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832608A4121B68B x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:12.660853 [ 30153 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:12.663826 [ 30153 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:12.663844 [ 30153 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:12.663856 [ 30153 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:12.663865 [ 30153 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:12.663892 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.663914 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.663931 [ 30153 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:12.663947 [ 30153 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:12.663963 [ 30153 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:12.663978 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.663994 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.664010 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.664025 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.664041 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.664868 [ 30153 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:12.666910 [ 30153 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:12.666926 [ 30153 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:12.667125 [ 30153 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:12.671454 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/jtf/tdwqinrnxvcdarjxnyrucofkwtome (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.672942 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/jtf/tdwqinrnxvcdarjxnyrucofkwtome (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.672974 [ 30153 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/jtf/tdwqinrnxvcdarjxnyrucofkwtome, Version: Latest, Offset: 2 2025.04.02 04:49:12.676652 [ 30153 ] {} deleteFileFromS3: No blob storage log, not writing blob special/jtf/tdwqinrnxvcdarjxnyrucofkwtome 2025.04.02 04:49:12.676671 [ 30153 ] {} deleteFileFromS3: Object with path special/jtf/tdwqinrnxvcdarjxnyrucofkwtome was removed from S3 2025.04.02 04:49:12.676684 [ 30153 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:12.676692 [ 30153 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:12.677533 [ 30153 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:12.679510 [ 30153 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:12.679522 [ 30153 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:12.679713 [ 30153 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:12.684224 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/wko/anlqydfuuugifdppuebbmhaslhakq (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.685673 [ 30153 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/wko/anlqydfuuugifdppuebbmhaslhakq (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:12.685704 [ 30153 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/wko/anlqydfuuugifdppuebbmhaslhakq, Version: Latest, Offset: 2 2025.04.02 04:49:12.688931 [ 30153 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/wko/anlqydfuuugifdppuebbmhaslhakq 2025.04.02 04:49:12.688963 [ 30153 ] {} deleteFileFromS3: Object with path test_02944/wko/anlqydfuuugifdppuebbmhaslhakq was removed from S3 2025.04.02 04:49:12.688981 [ 30153 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:12.688994 [ 30153 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:12.689030 [ 30153 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:12.691236 [ 30153 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:12.693140 [ 30153 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:12.693277 [ 30153 ] {} KeeperSnapshotManager: Found snapshot_38.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:12.693309 [ 30153 ] {} KeeperSnapshotManager: Found snapshot_37.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:12.693321 [ 30153 ] {} KeeperSnapshotManager: Found snapshot_39.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:12.694054 [ 30153 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:12.694166 [ 30153 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:12.694380 [ 30153 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:12.694428 [ 30153 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:12.694464 [ 30153 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:12.694475 [ 30153 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 39 2025.04.02 04:49:12.694908 [ 30153 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:12.694986 [ 30153 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 39 2025.04.02 04:49:12.695268 [ 30153 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 39 entries 2025.04.02 04:49:12.695294 [ 30153 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:12.695352 [ 30153 ] {} KeeperServer: Last local log idx 39 2025.04.02 04:49:12.695371 [ 30153 ] {} KeeperServer: Will use config from log store with log index 39 2025.04.02 04:49:12.695920 [ 30153 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:12.698388 [ 30153 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:12.698719 [ 30153 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:12.698755 [ 30153 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:12.698774 [ 30153 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:12.698794 [ 30153 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:12.698829 [ 30153 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:12.698852 [ 30153 ] {} RaftInstance: === INIT RAFT SERVER === commit index 39 term 39 election timer allowed log store start 1, end 39 config log idx 39, prev log idx 38 -- ASYNC REPLICATION -- 2025.04.02 04:49:12.698878 [ 30153 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:12.698930 [ 30153 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:12.699082 [ 30153 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:12.699172 [ 30754 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:12.749297 [ 30737 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:12.749341 [ 30737 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:12.749339 [ 30153 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:12.749411 [ 30737 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 39, state term 39, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:12.749424 [ 30737 ] {} RaftInstance: pre-vote term (0) is different, reset it to 39 2025.04.02 04:49:12.749517 [ 30737 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:12.751912 [ 30737 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 40, log idx 39, log term 39, priority (target 1 / mine 1) 2025.04.02 04:49:12.751937 [ 30737 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:12.751948 [ 30737 ] {} RaftInstance: state machine commit index 39, precommit index 39, last log index 39 2025.04.02 04:49:12.752182 [ 30735 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:12.752266 [ 30737 ] {} RaftInstance: [BECOME LEADER] appended new config at 40 2025.04.02 04:49:12.752392 [ 30753 ] {} RaftInstance: config at index 40 is committed, prev config log idx 39 2025.04.02 04:49:12.752442 [ 30753 ] {} RaftInstance: new config log idx 40, prev log idx 39, cur config log idx 39, prev log idx 38 2025.04.02 04:49:12.752465 [ 30753 ] {} RaftInstance: new configuration: log idx 40, prev log idx 39 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 40 2025.04.02 04:49:12.752532 [ 30153 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:12.752682 [ 30153 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:12.754215 [ 30153 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:12.754318 [ 30153 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:12.758251 [ 30153 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:12.758276 [ 30153 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:12.758748 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:12.758921 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:12.759126 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:12.759238 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:12.759336 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:12.759431 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:12.759528 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:12.759669 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:12.760824 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:12.761008 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:12.761177 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:12.761387 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:12.761562 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:12.761729 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:12.761917 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:12.762118 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:12.762282 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:12.762506 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:12.762690 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:12.762910 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:12.763105 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:12.763316 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:12.763672 [ 30153 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:12.769262 [ 30153 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:12.769338 [ 30153 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:12.772635 [ 30153 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:12.772672 [ 30153 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:12.773290 [ 30153 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:12.773550 [ 30153 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:12.773793 [ 30153 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:12.774038 [ 30759 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:12.775910 [ 30153 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:12.776401 [ 30153 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:12.777606 [ 30153 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:12.778164 [ 30153 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:12.779396 [ 30153 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:12.780021 [ 30153 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:12.780614 [ 30153 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:12.781220 [ 30153 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:12.781265 [ 30153 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:12.781296 [ 30164 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:12.781588 [ 30164 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:16.927475 [ 30153 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:16.927631 [ 30153 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:16.927847 [ 30153 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:16.927861 [ 30153 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:16.927995 [ 30160 ] {} CancellationChecker: Execution took 4389 ms. 2025.04.02 04:49:16.928199 [ 30153 ] {} Application: Shutting down storages. 2025.04.02 04:49:16.928213 [ 30153 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:16.929856 [ 30153 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:16.929871 [ 30153 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:16.929878 [ 30153 ] {} Context: Shutting down named sessions 2025.04.02 04:49:16.929901 [ 30153 ] {} Context: Shutting down database catalog 2025.04.02 04:49:16.929909 [ 30153 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:16.929950 [ 30153 ] {} Context: Shutting down merges executor 2025.04.02 04:49:16.930199 [ 30153 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:16.930419 [ 30153 ] {} Context: Shutting down moves executor 2025.04.02 04:49:16.930604 [ 30153 ] {} Context: Shutting down common executor 2025.04.02 04:49:16.930781 [ 30153 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:16.930793 [ 30153 ] {} Context: Shutting down caches 2025.04.02 04:49:16.930806 [ 30153 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:16.931274 [ 30153 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:16.934638 [ 30153 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:16.934953 [ 30153 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:16.935175 [ 30153 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:16.935431 [ 30153 ] {} Application: Shut down storages. 2025.04.02 04:49:16.935456 [ 30153 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:17.010015 [ 30153 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:17.010067 [ 30153 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:17.010080 [ 30153 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:17.254503 [ 30153 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:17.254573 [ 30153 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:17.254585 [ 30153 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:17.254678 [ 30153 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:17.254690 [ 30153 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:17.254699 [ 30153 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:17.254726 [ 30153 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:17.254812 [ 30153 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:17.254815 [ 30754 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:17.254892 [ 30153 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:17.254903 [ 30153 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:17.254912 [ 30153 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:17.254922 [ 30153 ] {} RaftInstance: manually create a snapshot on 40 2025.04.02 04:49:17.254948 [ 30153 ] {} RaftInstance: creating a snapshot for index 40 2025.04.02 04:49:17.254960 [ 30153 ] {} RaftInstance: create snapshot idx 40 log_term 40 2025.04.02 04:49:17.254976 [ 30153 ] {} KeeperStateMachine: Creating snapshot 40 2025.04.02 04:49:17.255042 [ 30153 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:17.257181 [ 30153 ] {} KeeperStateMachine: Created persistent snapshot 40 with path snapshot_40.bin.zstd 2025.04.02 04:49:17.257240 [ 30153 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:17.257251 [ 30153 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:17.257288 [ 30153 ] {} RaftInstance: snapshot idx 40 log_term 40 created, compact the log store if needed 2025.04.02 04:49:17.257304 [ 30153 ] {} RaftInstance: create snapshot idx 40 log_term 40 done: 2334 us elapsed 2025.04.02 04:49:17.257581 [ 30741 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:17.257586 [ 30739 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:17.257627 [ 30743 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:17.257668 [ 30745 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:17.257747 [ 30751 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:17.257763 [ 30748 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:17.257787 [ 30746 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:17.257642 [ 30740 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:17.257877 [ 30747 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:17.257684 [ 30752 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:17.257599 [ 30737 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:17.257712 [ 30744 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:17.257729 [ 30750 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:17.257586 [ 30738 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:17.257822 [ 30749 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:17.257859 [ 30742 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:17.258328 [ 30153 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:17.258406 [ 30735 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:17.258689 [ 30153 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:17.258780 [ 30153 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:17.258791 [ 30153 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:17.258806 [ 30153 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:17.258819 [ 30153 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:17.259017 [ 30153 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:17.259051 [ 30153 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:17.260602 [ 30153 ] {} Application: Destroyed global context. 2025.04.02 04:49:17.260775 [ 30153 ] {} Application: Waiting for background threads 2025.04.02 04:49:17.275079 [ 30153 ] {} Application: Background threads finished in 14 ms 2025.04.02 04:49:17.275679 [ 30153 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:17.275711 [ 30153 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:17.280275 [ 30153 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:17.280377 [ 30153 ] {} Application: shutting down 2025.04.02 04:49:17.280389 [ 30153 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:17.281321 [ 30154 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:17.281359 [ 30154 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:17.359928 [ 30152 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:18.001294 [ 30854 ] {} Application: Will watch for the process with pid 30855 2025.04.02 04:49:18.001554 [ 30855 ] {} Application: Forked a child process to watch 2025.04.02 04:49:18.002440 [ 30855 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:18.106380 [ 30855 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 30855 2025.04.02 04:49:18.106787 [ 30855 ] {} Application: starting up 2025.04.02 04:49:18.106807 [ 30855 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:18.115019 [ 30855 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:18.115095 [ 30855 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:18.115147 [ 30855 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:18.115160 [ 30855 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:18.115186 [ 30855 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:18.116127 [ 30855 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:18.116298 [ 30855 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:18.116318 [ 30855 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:18.116385 [ 30855 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:18.116399 [ 30855 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:18.411954 [ 30855 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:18.412118 [ 30855 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:18.438721 [ 30855 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:18.438801 [ 30855 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:18.438946 [ 30855 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:18.474839 [ 30865 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:18.474987 [ 30855 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:18.475044 [ 30855 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:18.475063 [ 30855 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:18.475074 [ 30855 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:18.475262 [ 30855 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:18.475453 [ 30855 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:18.480756 [ 30855 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:18.480812 [ 30855 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:18.480867 [ 30855 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:18.481364 [ 30855 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:18.481435 [ 30855 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:18.482062 [ 30855 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:18.484341 [ 30855 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:18.484416 [ 30855 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:18.484456 [ 30855 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:18.484696 [ 30855 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:18.488895 [ 30855 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:18.488930 [ 30855 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:18.491792 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:18.492280 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:18.492494 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:18.492741 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:18.493001 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:18.494993 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:18.495268 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:18.495504 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:18.495699 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:18.495922 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:18.496218 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:18.496424 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:18.496631 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:18.496828 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:18.497122 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:18.497375 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:18.497591 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:18.497804 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:18.498055 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:18.498273 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:18.498501 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:18.498721 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:18.499093 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:18.499607 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:18.499832 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:18.500232 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:18.500772 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:18.501042 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:18.501277 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:18.501509 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:18.501740 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:18.502007 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:18.502285 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:18.502499 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:18.502811 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:18.503060 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:18.503331 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:18.503620 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:18.503795 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:18.504284 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:18.504531 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:18.504702 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:18.504896 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:18.505075 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:18.505325 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:18.505564 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:18.505782 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:18.505974 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:18.506160 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:18.506980 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:18.507293 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:18.507630 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:18.507880 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:18.508063 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:18.508230 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:18.508485 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:18.508681 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:18.508902 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:18.509127 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:18.509376 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:18.509559 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:18.509823 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:18.510015 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:18.510225 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:18.510474 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:18.510676 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:18.511358 [ 30855 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:18.537035 [ 30855 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:18.537361 [ 30855 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:18.548109 [ 30855 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:18.548123 [ 30855 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:18.548128 [ 30855 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:18.551587 [ 30855 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:18.551600 [ 30855 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:18.551614 [ 30855 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:18.551638 [ 30855 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:18.552543 [ 30855 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:18.553167 [ 30855 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:18.555351 [ 30855 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:18.555429 [ 30855 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:18.555454 [ 30855 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:18.556038 [ 30855 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:18.556171 [ 30855 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:18.556290 [ 30855 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:18.556717 [ 30855 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:18.556741 [ 30855 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:18.557092 [ 30855 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:18.557100 [ 30855 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:18.557104 [ 30855 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:18.557112 [ 30855 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:18.557116 [ 30855 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:18.557157 [ 30855 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:18.557168 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.567238 [ 30855 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:18.568698 [ 30855 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:18.568714 [ 30855 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:18.569028 [ 30855 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:18.569119 [ 30855 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao 2025.04.02 04:49:18.569154 [ 30855 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao 2025.04.02 04:49:18.569168 [ 30855 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao, size 4 2025.04.02 04:49:18.569339 [ 30855 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao. 2025.04.02 04:49:18.569472 [ 31429 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao 2025.04.02 04:49:18.575926 [ 31429 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao, size 4 2025.04.02 04:49:18.576129 [ 30855 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao. 2025.04.02 04:49:18.576266 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.577946 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.577968 [ 30855 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao, Version: Latest, Offset: 2 2025.04.02 04:49:18.582093 [ 30855 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao 2025.04.02 04:49:18.582112 [ 30855 ] {} deleteFileFromS3: Object with path s3/pfm/seyxycktwxjulbjnedcjmmyvqjlao was removed from S3 2025.04.02 04:49:18.582150 [ 30855 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:18.582160 [ 30855 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:18.582978 [ 30855 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:18.585081 [ 30855 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:18.585099 [ 30855 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:18.585313 [ 30855 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:18.591047 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.593688 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.593712 [ 30855 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:18.597175 [ 30855 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:18.597382 [ 30855 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: ::1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:18 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832608BA2F7EFF8 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:18.597429 [ 30855 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:18.600431 [ 30855 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:18.600451 [ 30855 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:18.600463 [ 30855 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:18.600472 [ 30855 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:18.600506 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.600524 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.600540 [ 30855 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:18.600556 [ 30855 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:18.600572 [ 30855 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:18.600588 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.600604 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.600620 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.600635 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.600651 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.601519 [ 30855 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:18.603636 [ 30855 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:18.603652 [ 30855 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:18.603877 [ 30855 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:18.607964 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/nks/indxkshirkyquuhduboekyhpoatii (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.609465 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/nks/indxkshirkyquuhduboekyhpoatii (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.609487 [ 30855 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/nks/indxkshirkyquuhduboekyhpoatii, Version: Latest, Offset: 2 2025.04.02 04:49:18.612615 [ 30855 ] {} deleteFileFromS3: No blob storage log, not writing blob special/nks/indxkshirkyquuhduboekyhpoatii 2025.04.02 04:49:18.612638 [ 30855 ] {} deleteFileFromS3: Object with path special/nks/indxkshirkyquuhduboekyhpoatii was removed from S3 2025.04.02 04:49:18.612655 [ 30855 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:18.612668 [ 30855 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:18.613670 [ 30855 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:18.615841 [ 30855 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:18.615873 [ 30855 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:18.616089 [ 30855 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:18.619891 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/upr/tkrmhyjhqujlsfyykqvmdphtfyhmb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.621287 [ 30855 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/upr/tkrmhyjhqujlsfyykqvmdphtfyhmb (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:18.621309 [ 30855 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/upr/tkrmhyjhqujlsfyykqvmdphtfyhmb, Version: Latest, Offset: 2 2025.04.02 04:49:18.624554 [ 30855 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/upr/tkrmhyjhqujlsfyykqvmdphtfyhmb 2025.04.02 04:49:18.624580 [ 30855 ] {} deleteFileFromS3: Object with path test_02944/upr/tkrmhyjhqujlsfyykqvmdphtfyhmb was removed from S3 2025.04.02 04:49:18.624598 [ 30855 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:18.624610 [ 30855 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:18.624649 [ 30855 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:18.626947 [ 30855 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:18.629309 [ 30855 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:18.629418 [ 30855 ] {} KeeperSnapshotManager: Found snapshot_38.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:18.629447 [ 30855 ] {} KeeperSnapshotManager: Found snapshot_39.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:18.629459 [ 30855 ] {} KeeperSnapshotManager: Found snapshot_40.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:18.630211 [ 30855 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:18.630293 [ 30855 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:18.630491 [ 30855 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:18.630517 [ 30855 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:18.630549 [ 30855 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:18.630561 [ 30855 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 40 2025.04.02 04:49:18.630980 [ 30855 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:18.631060 [ 30855 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 40 2025.04.02 04:49:18.631351 [ 30855 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 40 entries 2025.04.02 04:49:18.631378 [ 30855 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:18.631435 [ 30855 ] {} KeeperServer: Last local log idx 40 2025.04.02 04:49:18.631454 [ 30855 ] {} KeeperServer: Will use config from log store with log index 40 2025.04.02 04:49:18.632006 [ 30855 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:18.634564 [ 30855 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:18.634892 [ 30855 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:18.634933 [ 30855 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:18.634952 [ 30855 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:18.634972 [ 30855 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:18.634995 [ 30855 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:18.635019 [ 30855 ] {} RaftInstance: === INIT RAFT SERVER === commit index 40 term 40 election timer allowed log store start 1, end 40 config log idx 40, prev log idx 39 -- ASYNC REPLICATION -- 2025.04.02 04:49:18.635044 [ 30855 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:18.635096 [ 30855 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:18.635274 [ 30855 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:18.635353 [ 31456 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:18.685568 [ 30855 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:18.685549 [ 31439 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:18.685629 [ 31439 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:18.685701 [ 31439 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 40, state term 40, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:18.685714 [ 31439 ] {} RaftInstance: pre-vote term (0) is different, reset it to 40 2025.04.02 04:49:18.685901 [ 31439 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:18.688487 [ 31439 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 41, log idx 40, log term 40, priority (target 1 / mine 1) 2025.04.02 04:49:18.688516 [ 31439 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:18.688528 [ 31439 ] {} RaftInstance: state machine commit index 40, precommit index 40, last log index 40 2025.04.02 04:49:18.688723 [ 31437 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:18.688899 [ 31439 ] {} RaftInstance: [BECOME LEADER] appended new config at 41 2025.04.02 04:49:18.689029 [ 31455 ] {} RaftInstance: config at index 41 is committed, prev config log idx 40 2025.04.02 04:49:18.689072 [ 31455 ] {} RaftInstance: new config log idx 41, prev log idx 40, cur config log idx 40, prev log idx 39 2025.04.02 04:49:18.689102 [ 31455 ] {} RaftInstance: new configuration: log idx 41, prev log idx 40 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 41 2025.04.02 04:49:18.689216 [ 30855 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:18.689395 [ 30855 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:18.690928 [ 30855 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:18.691025 [ 30855 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:18.694984 [ 30855 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:18.695010 [ 30855 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:18.695490 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:18.695645 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:18.695887 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:18.696006 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:18.696106 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:18.696202 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:18.696307 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:18.696438 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:18.697603 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:18.697794 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:18.697985 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:18.698166 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:18.698341 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:18.698511 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:18.698680 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:18.698896 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:18.699076 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:18.699293 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:18.699477 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:18.699670 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:18.699869 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:18.700076 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:18.700435 [ 30855 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:18.705885 [ 30855 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:18.705962 [ 30855 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:18.709316 [ 30855 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:18.709363 [ 30855 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:18.709803 [ 30855 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:18.710075 [ 30855 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:18.710273 [ 30855 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:18.710533 [ 31461 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:18.712386 [ 30855 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:18.713001 [ 30855 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:18.714174 [ 30855 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:18.714667 [ 30855 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:18.715962 [ 30855 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:18.716615 [ 30855 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:18.717284 [ 30855 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:18.717843 [ 30855 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:18.717892 [ 30855 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:18.717954 [ 30863 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:18.718334 [ 30863 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:23.188718 [ 30855 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:23.188865 [ 30855 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:23.189155 [ 30855 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:23.189170 [ 30855 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:23.189328 [ 30865 ] {} CancellationChecker: Execution took 4714 ms. 2025.04.02 04:49:23.189543 [ 30855 ] {} Application: Shutting down storages. 2025.04.02 04:49:23.189559 [ 30855 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:23.191142 [ 30855 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:23.191157 [ 30855 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:23.191165 [ 30855 ] {} Context: Shutting down named sessions 2025.04.02 04:49:23.191188 [ 30855 ] {} Context: Shutting down database catalog 2025.04.02 04:49:23.191197 [ 30855 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:23.191237 [ 30855 ] {} Context: Shutting down merges executor 2025.04.02 04:49:23.191524 [ 30855 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:23.191737 [ 30855 ] {} Context: Shutting down moves executor 2025.04.02 04:49:23.191892 [ 30855 ] {} Context: Shutting down common executor 2025.04.02 04:49:23.192029 [ 30855 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:23.192037 [ 30855 ] {} Context: Shutting down caches 2025.04.02 04:49:23.192046 [ 30855 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:23.192389 [ 30855 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:23.194858 [ 30855 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:23.195177 [ 30855 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:23.195412 [ 30855 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:23.195603 [ 30855 ] {} Application: Shut down storages. 2025.04.02 04:49:23.195615 [ 30855 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:23.197042 [ 30855 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:23.197053 [ 30855 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:23.197062 [ 30855 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:23.691656 [ 30855 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:23.691738 [ 30855 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:23.691750 [ 30855 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:23.691877 [ 30855 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:23.701546 [ 30855 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:23.701584 [ 30855 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:23.701598 [ 30855 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:23.701652 [ 30855 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:23.701675 [ 31456 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:23.701765 [ 30855 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:23.701779 [ 30855 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:23.701789 [ 30855 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:23.701801 [ 30855 ] {} RaftInstance: manually create a snapshot on 41 2025.04.02 04:49:23.701813 [ 30855 ] {} RaftInstance: creating a snapshot for index 41 2025.04.02 04:49:23.701825 [ 30855 ] {} RaftInstance: create snapshot idx 41 log_term 41 2025.04.02 04:49:23.701847 [ 30855 ] {} KeeperStateMachine: Creating snapshot 41 2025.04.02 04:49:23.701927 [ 30855 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:23.704681 [ 30855 ] {} KeeperStateMachine: Created persistent snapshot 41 with path snapshot_41.bin.zstd 2025.04.02 04:49:23.704706 [ 30855 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:23.704718 [ 30855 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:23.704755 [ 30855 ] {} RaftInstance: snapshot idx 41 log_term 41 created, compact the log store if needed 2025.04.02 04:49:23.704772 [ 30855 ] {} RaftInstance: create snapshot idx 41 log_term 41 done: 2931 us elapsed 2025.04.02 04:49:23.705119 [ 31439 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:23.705153 [ 31443 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:23.705215 [ 31441 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:23.705155 [ 31440 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:23.705250 [ 31445 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:23.705309 [ 31450 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:23.705313 [ 31446 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:23.705286 [ 31448 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:23.705265 [ 31442 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:23.705298 [ 31444 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:23.705345 [ 31447 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:23.705356 [ 31453 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:23.705359 [ 31449 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:23.705373 [ 31454 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:23.705446 [ 31452 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:23.705232 [ 31451 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:23.706245 [ 30855 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:23.706325 [ 31437 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:23.706704 [ 30855 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:23.706921 [ 30855 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:23.706952 [ 30855 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:23.706969 [ 30855 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:23.706983 [ 30855 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:23.707181 [ 30855 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:23.707235 [ 30855 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:23.708872 [ 30855 ] {} Application: Destroyed global context. 2025.04.02 04:49:23.709113 [ 30855 ] {} Application: Waiting for background threads 2025.04.02 04:49:23.725020 [ 30855 ] {} Application: Background threads finished in 15 ms 2025.04.02 04:49:23.725664 [ 30855 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:23.725689 [ 30855 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:23.730360 [ 30855 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:23.730479 [ 30855 ] {} Application: shutting down 2025.04.02 04:49:23.730490 [ 30855 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:23.731423 [ 30856 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:23.731464 [ 30856 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:23.796702 [ 30854 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:24.029797 [ 31556 ] {} Application: Will watch for the process with pid 31557 2025.04.02 04:49:24.030001 [ 31557 ] {} Application: Forked a child process to watch 2025.04.02 04:49:24.030717 [ 31557 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:24.135362 [ 31557 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 31557 2025.04.02 04:49:24.135951 [ 31557 ] {} Application: starting up 2025.04.02 04:49:24.135972 [ 31557 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:24.144210 [ 31557 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:24.144290 [ 31557 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:24.144342 [ 31557 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:24.144354 [ 31557 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:24.144379 [ 31557 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:24.145299 [ 31557 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:24.145481 [ 31557 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:24.145494 [ 31557 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:24.145560 [ 31557 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:24.145573 [ 31557 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:24.451699 [ 31557 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:24.451871 [ 31557 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:24.478693 [ 31557 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:24.478756 [ 31557 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:24.478896 [ 31557 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:24.507442 [ 31565 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:24.507510 [ 31557 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:24.507551 [ 31557 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:24.507562 [ 31557 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:24.507568 [ 31557 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:24.507683 [ 31557 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:24.507786 [ 31557 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:24.510181 [ 31557 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:24.510200 [ 31557 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:24.510227 [ 31557 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:24.510512 [ 31557 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:24.510538 [ 31557 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:24.510826 [ 31557 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:24.511877 [ 31557 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:24.511923 [ 31557 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:24.511942 [ 31557 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:24.512040 [ 31557 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:24.514151 [ 31557 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:24.514164 [ 31557 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:24.515462 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:24.515653 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:24.515748 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:24.515856 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:24.515976 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:24.516782 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:24.516911 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:24.517021 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:24.517109 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:24.517217 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:24.517344 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:24.517436 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:24.517528 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:24.517615 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:24.517737 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:24.517829 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:24.517935 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:24.518032 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:24.518142 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:24.518239 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:24.518341 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:24.518439 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:24.518597 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:24.518824 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:24.518936 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:24.519122 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:24.519360 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:24.519472 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:24.519561 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:24.519661 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:24.519763 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:24.519871 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:24.520009 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:24.520111 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:24.520246 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:24.520352 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:24.520471 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:24.520600 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:24.520713 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:24.520967 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:24.521123 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:24.521257 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:24.521378 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:24.521498 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:24.521614 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:24.521755 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:24.521882 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:24.522015 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:24.522135 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:24.522620 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:24.522806 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:24.523033 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:24.523186 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:24.523308 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:24.523419 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:24.523584 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:24.523707 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:24.523836 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:24.523956 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:24.524075 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:24.524189 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:24.524359 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:24.524473 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:24.524610 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:24.524773 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:24.524912 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:24.525356 [ 31557 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:24.540860 [ 31557 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:24.541251 [ 31557 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:24.551715 [ 31557 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:24.551729 [ 31557 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:24.551734 [ 31557 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:24.555306 [ 31557 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:24.555325 [ 31557 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:24.555341 [ 31557 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:24.555363 [ 31557 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:24.556260 [ 31557 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:24.557115 [ 31557 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:24.559354 [ 31557 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:24.559435 [ 31557 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:24.559460 [ 31557 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:24.560048 [ 31557 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:24.560183 [ 31557 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:24.560289 [ 31557 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:24.560711 [ 31557 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:24.560735 [ 31557 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:24.561082 [ 31557 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:24.561090 [ 31557 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:24.561094 [ 31557 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:24.561103 [ 31557 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:24.561107 [ 31557 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:24.561147 [ 31557 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:24.561158 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.570976 [ 31557 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:24.572449 [ 31557 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:24.572460 [ 31557 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:24.572770 [ 31557 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:24.572864 [ 31557 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh 2025.04.02 04:49:24.572912 [ 31557 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh 2025.04.02 04:49:24.572925 [ 31557 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh, size 4 2025.04.02 04:49:24.573060 [ 31557 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh. 2025.04.02 04:49:24.573167 [ 32131 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh 2025.04.02 04:49:24.579385 [ 32131 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh, size 4 2025.04.02 04:49:24.579577 [ 31557 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh. 2025.04.02 04:49:24.579722 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.581579 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.581595 [ 31557 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh, Version: Latest, Offset: 2 2025.04.02 04:49:24.585098 [ 31557 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh 2025.04.02 04:49:24.585110 [ 31557 ] {} deleteFileFromS3: Object with path s3/qxt/fszadvjhxltgocaefwfmgffbsnjkh was removed from S3 2025.04.02 04:49:24.585135 [ 31557 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:24.585142 [ 31557 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:24.585732 [ 31557 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:24.587129 [ 31557 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:24.587139 [ 31557 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:24.587274 [ 31557 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:24.592298 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.594693 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.594709 [ 31557 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:24.597735 [ 31557 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:24.597772 [ 31557 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:24 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832608D08A247CB x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:24.597797 [ 31557 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:24.600568 [ 31557 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:24.600579 [ 31557 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:24.600588 [ 31557 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:24.600594 [ 31557 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:24.600620 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.600632 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.600643 [ 31557 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:24.600660 [ 31557 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:24.600671 [ 31557 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:24.600682 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.600693 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.600703 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.600714 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.600724 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.601320 [ 31557 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:24.602712 [ 31557 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:24.602720 [ 31557 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:24.602862 [ 31557 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:24.607327 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/cdh/rohajvewixxpzxbexkyhqrivwpnvv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.608636 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/cdh/rohajvewixxpzxbexkyhqrivwpnvv (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.608658 [ 31557 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/cdh/rohajvewixxpzxbexkyhqrivwpnvv, Version: Latest, Offset: 2 2025.04.02 04:49:24.611935 [ 31557 ] {} deleteFileFromS3: No blob storage log, not writing blob special/cdh/rohajvewixxpzxbexkyhqrivwpnvv 2025.04.02 04:49:24.611954 [ 31557 ] {} deleteFileFromS3: Object with path special/cdh/rohajvewixxpzxbexkyhqrivwpnvv was removed from S3 2025.04.02 04:49:24.611967 [ 31557 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:24.611975 [ 31557 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:24.612805 [ 31557 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:24.615023 [ 31557 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:24.615040 [ 31557 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:24.615241 [ 31557 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:24.619518 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/bin/jrmyweocmumorlelmxqrshtecovkh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.620943 [ 31557 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/bin/jrmyweocmumorlelmxqrshtecovkh (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:24.620965 [ 31557 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/bin/jrmyweocmumorlelmxqrshtecovkh, Version: Latest, Offset: 2 2025.04.02 04:49:24.624118 [ 31557 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/bin/jrmyweocmumorlelmxqrshtecovkh 2025.04.02 04:49:24.624136 [ 31557 ] {} deleteFileFromS3: Object with path test_02944/bin/jrmyweocmumorlelmxqrshtecovkh was removed from S3 2025.04.02 04:49:24.624149 [ 31557 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:24.624157 [ 31557 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:24.624191 [ 31557 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:24.625525 [ 31557 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:24.626795 [ 31557 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:24.626870 [ 31557 ] {} KeeperSnapshotManager: Found snapshot_41.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:24.626907 [ 31557 ] {} KeeperSnapshotManager: Found snapshot_39.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:24.626916 [ 31557 ] {} KeeperSnapshotManager: Found snapshot_40.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:24.627422 [ 31557 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:24.627478 [ 31557 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:24.627625 [ 31557 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:24.627637 [ 31557 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:24.627668 [ 31557 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:24.627677 [ 31557 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 41 2025.04.02 04:49:24.627969 [ 31557 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:24.628023 [ 31557 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 41 2025.04.02 04:49:24.628206 [ 31557 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 41 entries 2025.04.02 04:49:24.628223 [ 31557 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:24.628262 [ 31557 ] {} KeeperServer: Last local log idx 41 2025.04.02 04:49:24.628275 [ 31557 ] {} KeeperServer: Will use config from log store with log index 41 2025.04.02 04:49:24.628640 [ 31557 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:24.630529 [ 31557 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:24.630742 [ 31557 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:24.630769 [ 31557 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:24.630782 [ 31557 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:24.630796 [ 31557 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:24.630804 [ 31557 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:24.630825 [ 31557 ] {} RaftInstance: === INIT RAFT SERVER === commit index 41 term 41 election timer allowed log store start 1, end 41 config log idx 41, prev log idx 40 -- ASYNC REPLICATION -- 2025.04.02 04:49:24.630839 [ 31557 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:24.630875 [ 31557 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:24.630999 [ 31557 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:24.631103 [ 32158 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:24.681300 [ 32141 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:24.681340 [ 31557 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:24.681364 [ 32141 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:24.681468 [ 32141 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 41, state term 41, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:24.681482 [ 32141 ] {} RaftInstance: pre-vote term (0) is different, reset it to 41 2025.04.02 04:49:24.681602 [ 32141 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:24.684057 [ 32141 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 42, log idx 41, log term 41, priority (target 1 / mine 1) 2025.04.02 04:49:24.684085 [ 32141 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:24.684097 [ 32141 ] {} RaftInstance: state machine commit index 41, precommit index 41, last log index 41 2025.04.02 04:49:24.684301 [ 32139 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:24.684378 [ 32141 ] {} RaftInstance: [BECOME LEADER] appended new config at 42 2025.04.02 04:49:24.684520 [ 32157 ] {} RaftInstance: config at index 42 is committed, prev config log idx 41 2025.04.02 04:49:24.684560 [ 32157 ] {} RaftInstance: new config log idx 42, prev log idx 41, cur config log idx 41, prev log idx 40 2025.04.02 04:49:24.684587 [ 32157 ] {} RaftInstance: new configuration: log idx 42, prev log idx 41 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 42 2025.04.02 04:49:24.684714 [ 31557 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:24.684931 [ 31557 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:24.686727 [ 31557 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:24.686832 [ 31557 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:24.690809 [ 31557 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:24.690836 [ 31557 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:24.691333 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:24.691490 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:24.691701 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:24.691818 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:24.691939 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:24.692041 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:24.692146 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:24.692279 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:24.693485 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:24.693686 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:24.693851 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:24.694064 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:24.694238 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:24.694405 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:24.694572 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:24.694766 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:24.694962 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:24.695183 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:24.695366 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:24.695555 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:24.695737 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:24.695953 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:24.696310 [ 31557 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:24.701112 [ 31557 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:24.701212 [ 31557 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:24.704472 [ 31557 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:24.704518 [ 31557 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:24.705014 [ 31557 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:24.705298 [ 31557 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:24.705498 [ 31557 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:24.705718 [ 32163 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:24.707650 [ 31557 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:24.708208 [ 31557 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:24.709216 [ 31557 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:24.709790 [ 31557 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:24.711150 [ 31557 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:24.711744 [ 31557 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:24.712461 [ 31557 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:24.713071 [ 31557 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:24.713107 [ 31557 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:24.713169 [ 31563 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:24.713570 [ 31563 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:28.843315 [ 31557 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:28.843459 [ 31557 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:28.843659 [ 31557 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:28.843678 [ 31557 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:28.843722 [ 31565 ] {} CancellationChecker: Execution took 4336 ms. 2025.04.02 04:49:28.843865 [ 31557 ] {} Application: Shutting down storages. 2025.04.02 04:49:28.843878 [ 31557 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:28.844852 [ 31557 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:28.844869 [ 31557 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:28.844876 [ 31557 ] {} Context: Shutting down named sessions 2025.04.02 04:49:28.844898 [ 31557 ] {} Context: Shutting down database catalog 2025.04.02 04:49:28.844905 [ 31557 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:28.844960 [ 31557 ] {} Context: Shutting down merges executor 2025.04.02 04:49:28.845219 [ 31557 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:28.845401 [ 31557 ] {} Context: Shutting down moves executor 2025.04.02 04:49:28.845558 [ 31557 ] {} Context: Shutting down common executor 2025.04.02 04:49:28.845716 [ 31557 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:28.845724 [ 31557 ] {} Context: Shutting down caches 2025.04.02 04:49:28.845733 [ 31557 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:28.845953 [ 31557 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:28.847948 [ 31557 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:28.848203 [ 31557 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:28.848326 [ 31557 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:28.848492 [ 31557 ] {} Application: Shut down storages. 2025.04.02 04:49:28.848504 [ 31557 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:29.192707 [ 31557 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:29.192784 [ 31557 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:29.192796 [ 31557 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:29.687253 [ 31557 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:29.687338 [ 31557 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:29.687351 [ 31557 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:29.687481 [ 31557 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:29.688196 [ 31557 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:29.688236 [ 31557 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:29.688251 [ 31557 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:29.688306 [ 32158 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:29.688328 [ 31557 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:29.688345 [ 31557 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:29.688358 [ 31557 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:29.688371 [ 31557 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:29.688386 [ 31557 ] {} RaftInstance: manually create a snapshot on 42 2025.04.02 04:49:29.688404 [ 31557 ] {} RaftInstance: creating a snapshot for index 42 2025.04.02 04:49:29.688422 [ 31557 ] {} RaftInstance: create snapshot idx 42 log_term 42 2025.04.02 04:49:29.688448 [ 31557 ] {} KeeperStateMachine: Creating snapshot 42 2025.04.02 04:49:29.688501 [ 31557 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:29.690900 [ 31557 ] {} KeeperStateMachine: Created persistent snapshot 42 with path snapshot_42.bin.zstd 2025.04.02 04:49:29.690948 [ 31557 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:29.690960 [ 31557 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:29.690998 [ 31557 ] {} RaftInstance: snapshot idx 42 log_term 42 created, compact the log store if needed 2025.04.02 04:49:29.691016 [ 31557 ] {} RaftInstance: create snapshot idx 42 log_term 42 done: 2572 us elapsed 2025.04.02 04:49:29.691337 [ 32144 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:29.691357 [ 32148 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:29.691364 [ 32143 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:29.691381 [ 32142 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:29.691438 [ 32146 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:29.691471 [ 32147 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:29.691447 [ 32145 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:29.691462 [ 32156 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:29.691565 [ 32153 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:29.691567 [ 32149 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:29.691648 [ 32152 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:29.691679 [ 32151 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:29.691709 [ 32141 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:29.691506 [ 32154 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:29.691714 [ 32155 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:29.691596 [ 32150 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:29.692228 [ 31557 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:29.692300 [ 32139 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:29.692619 [ 31557 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:29.692710 [ 31557 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:29.692721 [ 31557 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:29.692736 [ 31557 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:29.692749 [ 31557 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:29.692966 [ 31557 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:29.693003 [ 31557 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:29.694835 [ 31557 ] {} Application: Destroyed global context. 2025.04.02 04:49:29.695116 [ 31557 ] {} Application: Waiting for background threads 2025.04.02 04:49:29.712832 [ 31557 ] {} Application: Background threads finished in 17 ms 2025.04.02 04:49:29.713464 [ 31557 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:29.713485 [ 31557 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:29.718073 [ 31557 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:29.718199 [ 31557 ] {} Application: shutting down 2025.04.02 04:49:29.718211 [ 31557 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:29.719111 [ 31558 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:29.719180 [ 31558 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:29.798863 [ 31556 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:30.073494 [ 32258 ] {} Application: Will watch for the process with pid 32259 2025.04.02 04:49:30.073705 [ 32259 ] {} Application: Forked a child process to watch 2025.04.02 04:49:30.074574 [ 32259 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:30.178385 [ 32259 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 32259 2025.04.02 04:49:30.178911 [ 32259 ] {} Application: starting up 2025.04.02 04:49:30.179009 [ 32259 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:30.187135 [ 32259 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:30.187210 [ 32259 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:30.187277 [ 32259 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:30.187292 [ 32259 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:30.187318 [ 32259 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:30.188186 [ 32259 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:30.188365 [ 32259 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:30.188378 [ 32259 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:30.188444 [ 32259 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:30.188458 [ 32259 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:30.484698 [ 32259 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:30.484864 [ 32259 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:30.512494 [ 32259 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:30.512619 [ 32259 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:30.512790 [ 32259 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:30.549246 [ 32268 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:30.549386 [ 32259 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:30.549532 [ 32259 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:30.549547 [ 32259 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:30.549556 [ 32259 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:30.549697 [ 32259 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:30.549831 [ 32259 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:30.553339 [ 32259 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:30.553365 [ 32259 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:30.553391 [ 32259 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:30.553745 [ 32259 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:30.553781 [ 32259 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:30.554215 [ 32259 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:30.556087 [ 32259 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:30.556155 [ 32259 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:30.556195 [ 32259 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:30.556388 [ 32259 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:30.560466 [ 32259 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:30.560490 [ 32259 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:30.563366 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:30.563793 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:30.564025 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:30.564273 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:30.564519 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:30.566450 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:30.566698 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:30.566951 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:30.567150 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:30.567354 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:30.567626 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:30.567834 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:30.568061 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:30.568261 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:30.568537 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:30.568741 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:30.568974 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:30.569222 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:30.569467 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:30.569688 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:30.569923 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:30.570172 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:30.570541 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:30.571083 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:30.571312 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:30.571693 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:30.572262 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:30.572525 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:30.572735 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:30.572982 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:30.573327 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:30.573518 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:30.573707 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:30.573860 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:30.574081 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:30.574238 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:30.574420 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:30.574618 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:30.574791 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:30.575176 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:30.575413 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:30.575583 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:30.575762 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:30.575955 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:30.576139 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:30.576357 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:30.576549 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:30.576732 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:30.576914 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:30.577702 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:30.578008 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:30.578345 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:30.578577 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:30.578755 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:30.578920 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:30.579205 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:30.579395 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:30.579594 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:30.579765 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:30.579956 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:30.580134 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:30.580394 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:30.580568 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:30.580776 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:30.581040 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:30.581266 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:30.581975 [ 32259 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:30.610710 [ 32259 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:30.611025 [ 32259 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:30.621323 [ 32259 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:30.621335 [ 32259 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:30.621340 [ 32259 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:30.624755 [ 32259 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:30.624767 [ 32259 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:30.624783 [ 32259 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:30.624805 [ 32259 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:30.625598 [ 32259 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:30.626272 [ 32259 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:30.628468 [ 32259 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:30.628556 [ 32259 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:30.628585 [ 32259 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:30.629168 [ 32259 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:30.629320 [ 32259 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:30.629433 [ 32259 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:30.629853 [ 32259 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:30.629878 [ 32259 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:30.630224 [ 32259 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:30.630232 [ 32259 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:30.630236 [ 32259 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:30.630245 [ 32259 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:30.630249 [ 32259 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:30.630288 [ 32259 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:30.630299 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.642416 [ 32259 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:30.643852 [ 32259 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:30.643862 [ 32259 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:30.644170 [ 32259 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:30.644263 [ 32259 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs 2025.04.02 04:49:30.644299 [ 32259 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs 2025.04.02 04:49:30.644309 [ 32259 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs, size 4 2025.04.02 04:49:30.644443 [ 32259 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs. 2025.04.02 04:49:30.644599 [ 32833 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs 2025.04.02 04:49:30.651484 [ 32833 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs, size 4 2025.04.02 04:49:30.651715 [ 32259 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/oct/itvoilylafdthvkmhakqcnteuoyjs. 2025.04.02 04:49:30.651902 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/oct/itvoilylafdthvkmhakqcnteuoyjs (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.654069 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/oct/itvoilylafdthvkmhakqcnteuoyjs (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.654086 [ 32259 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/oct/itvoilylafdthvkmhakqcnteuoyjs, Version: Latest, Offset: 2 2025.04.02 04:49:30.657557 [ 32259 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/oct/itvoilylafdthvkmhakqcnteuoyjs 2025.04.02 04:49:30.657576 [ 32259 ] {} deleteFileFromS3: Object with path s3/oct/itvoilylafdthvkmhakqcnteuoyjs was removed from S3 2025.04.02 04:49:30.657613 [ 32259 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:30.657624 [ 32259 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:30.658503 [ 32259 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:30.660593 [ 32259 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:30.660608 [ 32259 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:30.660801 [ 32259 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:30.666499 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.669300 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.669324 [ 32259 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:30.672926 [ 32259 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:30.672993 [ 32259 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:30 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832608E72BD48CE x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:30.673030 [ 32259 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:30.676397 [ 32259 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:30.676416 [ 32259 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:30.676428 [ 32259 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:30.676437 [ 32259 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:30.676469 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.676487 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.676503 [ 32259 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:30.676519 [ 32259 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:30.676535 [ 32259 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:30.676550 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.676566 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.676582 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.676599 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.676614 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.677517 [ 32259 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:30.679589 [ 32259 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:30.679602 [ 32259 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:30.679808 [ 32259 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:30.684095 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/kyq/qdvcehqpslobvtwuykmjcpqvuunph (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.685582 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/kyq/qdvcehqpslobvtwuykmjcpqvuunph (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.685604 [ 32259 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/kyq/qdvcehqpslobvtwuykmjcpqvuunph, Version: Latest, Offset: 2 2025.04.02 04:49:30.688850 [ 32259 ] {} deleteFileFromS3: No blob storage log, not writing blob special/kyq/qdvcehqpslobvtwuykmjcpqvuunph 2025.04.02 04:49:30.688868 [ 32259 ] {} deleteFileFromS3: Object with path special/kyq/qdvcehqpslobvtwuykmjcpqvuunph was removed from S3 2025.04.02 04:49:30.688881 [ 32259 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:30.688889 [ 32259 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:30.689763 [ 32259 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:30.691797 [ 32259 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:30.691809 [ 32259 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:30.692019 [ 32259 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:30.696348 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/rgc/smvetdkyrbhwofayatngisskyqdcu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.698194 [ 32259 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/rgc/smvetdkyrbhwofayatngisskyqdcu (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:30.698215 [ 32259 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/rgc/smvetdkyrbhwofayatngisskyqdcu, Version: Latest, Offset: 2 2025.04.02 04:49:30.702110 [ 32259 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/rgc/smvetdkyrbhwofayatngisskyqdcu 2025.04.02 04:49:30.702137 [ 32259 ] {} deleteFileFromS3: Object with path test_02944/rgc/smvetdkyrbhwofayatngisskyqdcu was removed from S3 2025.04.02 04:49:30.702155 [ 32259 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:30.702168 [ 32259 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:30.702205 [ 32259 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:30.704383 [ 32259 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:30.706456 [ 32259 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:30.706570 [ 32259 ] {} KeeperSnapshotManager: Found snapshot_41.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:30.706600 [ 32259 ] {} KeeperSnapshotManager: Found snapshot_42.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:30.706613 [ 32259 ] {} KeeperSnapshotManager: Found snapshot_40.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:30.707355 [ 32259 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:30.707436 [ 32259 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:30.707685 [ 32259 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:30.707704 [ 32259 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:30.707740 [ 32259 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:30.707753 [ 32259 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 42 2025.04.02 04:49:30.708217 [ 32259 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:30.708303 [ 32259 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 42 2025.04.02 04:49:30.708569 [ 32259 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 42 entries 2025.04.02 04:49:30.708594 [ 32259 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:30.708650 [ 32259 ] {} KeeperServer: Last local log idx 42 2025.04.02 04:49:30.708668 [ 32259 ] {} KeeperServer: Will use config from log store with log index 42 2025.04.02 04:49:30.709291 [ 32259 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:30.711818 [ 32259 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:30.712173 [ 32259 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:30.712218 [ 32259 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:30.712236 [ 32259 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:30.712256 [ 32259 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:30.712268 [ 32259 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:30.712299 [ 32259 ] {} RaftInstance: === INIT RAFT SERVER === commit index 42 term 42 election timer allowed log store start 1, end 42 config log idx 42, prev log idx 41 -- ASYNC REPLICATION -- 2025.04.02 04:49:30.712319 [ 32259 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:30.712373 [ 32259 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:30.712602 [ 32259 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:30.712717 [ 32860 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:30.762894 [ 32259 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:30.762901 [ 32843 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:30.762994 [ 32843 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:30.763069 [ 32843 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 42, state term 42, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:30.763078 [ 32843 ] {} RaftInstance: pre-vote term (0) is different, reset it to 42 2025.04.02 04:49:30.763208 [ 32843 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:30.765611 [ 32843 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 43, log idx 42, log term 42, priority (target 1 / mine 1) 2025.04.02 04:49:30.765634 [ 32843 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:30.765641 [ 32843 ] {} RaftInstance: state machine commit index 42, precommit index 42, last log index 42 2025.04.02 04:49:30.765836 [ 32841 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:30.765940 [ 32843 ] {} RaftInstance: [BECOME LEADER] appended new config at 43 2025.04.02 04:49:30.766064 [ 32859 ] {} RaftInstance: config at index 43 is committed, prev config log idx 42 2025.04.02 04:49:30.766103 [ 32859 ] {} RaftInstance: new config log idx 43, prev log idx 42, cur config log idx 42, prev log idx 41 2025.04.02 04:49:30.766132 [ 32859 ] {} RaftInstance: new configuration: log idx 43, prev log idx 42 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 43 2025.04.02 04:49:30.766195 [ 32259 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:30.766356 [ 32259 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:30.767844 [ 32259 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:30.767963 [ 32259 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:30.771871 [ 32259 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:30.771896 [ 32259 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:30.772392 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:30.772549 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:30.772753 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:30.772868 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:30.772987 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:30.773088 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:30.773222 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:30.773363 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:30.774495 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:30.774681 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:30.774851 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:30.775048 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:30.775230 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:30.775403 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:30.775574 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:30.775772 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:30.775967 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:30.776192 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:30.776377 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:30.776589 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:30.776774 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:30.777001 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:30.777393 [ 32259 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:30.783636 [ 32259 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:30.783711 [ 32259 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:30.786920 [ 32259 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:30.786996 [ 32259 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:30.787428 [ 32259 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:30.787678 [ 32259 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:30.787871 [ 32259 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:30.788085 [ 32865 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:30.789982 [ 32259 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:30.790679 [ 32259 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:30.792091 [ 32259 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:30.792672 [ 32259 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:30.794022 [ 32259 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:30.794612 [ 32259 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:30.795217 [ 32259 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:30.795764 [ 32259 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:30.795798 [ 32259 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:30.795849 [ 32267 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:30.796203 [ 32267 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:35.277917 [ 32259 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:35.278101 [ 32259 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:35.278346 [ 32259 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:35.278365 [ 32259 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:35.278443 [ 32268 ] {} CancellationChecker: Execution took 4729 ms. 2025.04.02 04:49:35.278657 [ 32259 ] {} Application: Shutting down storages. 2025.04.02 04:49:35.278674 [ 32259 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:35.280048 [ 32259 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:35.280065 [ 32259 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:35.280076 [ 32259 ] {} Context: Shutting down named sessions 2025.04.02 04:49:35.280107 [ 32259 ] {} Context: Shutting down database catalog 2025.04.02 04:49:35.280119 [ 32259 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:35.280175 [ 32259 ] {} Context: Shutting down merges executor 2025.04.02 04:49:35.280442 [ 32259 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:35.280684 [ 32259 ] {} Context: Shutting down moves executor 2025.04.02 04:49:35.280856 [ 32259 ] {} Context: Shutting down common executor 2025.04.02 04:49:35.281010 [ 32259 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:35.281026 [ 32259 ] {} Context: Shutting down caches 2025.04.02 04:49:35.281040 [ 32259 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:35.281430 [ 32259 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:35.284811 [ 32259 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:35.285118 [ 32259 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:35.285294 [ 32259 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:35.285590 [ 32259 ] {} Application: Shut down storages. 2025.04.02 04:49:35.285607 [ 32259 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:35.524268 [ 32259 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:35.524325 [ 32259 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:35.524338 [ 32259 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:35.768445 [ 32259 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:35.768520 [ 32259 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:35.768532 [ 32259 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:35.768631 [ 32259 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:35.769445 [ 32259 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:35.769475 [ 32259 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:35.769488 [ 32259 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:35.769638 [ 32259 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:35.769630 [ 32860 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:35.769746 [ 32259 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:35.769759 [ 32259 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:35.769783 [ 32259 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:35.769794 [ 32259 ] {} RaftInstance: manually create a snapshot on 43 2025.04.02 04:49:35.769806 [ 32259 ] {} RaftInstance: creating a snapshot for index 43 2025.04.02 04:49:35.769817 [ 32259 ] {} RaftInstance: create snapshot idx 43 log_term 43 2025.04.02 04:49:35.769837 [ 32259 ] {} KeeperStateMachine: Creating snapshot 43 2025.04.02 04:49:35.769897 [ 32259 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:35.772347 [ 32259 ] {} KeeperStateMachine: Created persistent snapshot 43 with path snapshot_43.bin.zstd 2025.04.02 04:49:35.772376 [ 32259 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:35.772388 [ 32259 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:35.772426 [ 32259 ] {} RaftInstance: snapshot idx 43 log_term 43 created, compact the log store if needed 2025.04.02 04:49:35.772444 [ 32259 ] {} RaftInstance: create snapshot idx 43 log_term 43 done: 2611 us elapsed 2025.04.02 04:49:35.772758 [ 32846 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:35.772764 [ 32843 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:35.772799 [ 32849 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:35.772827 [ 32853 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:35.772776 [ 32845 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:35.772870 [ 32847 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:35.772932 [ 32856 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:35.773012 [ 32844 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:35.773020 [ 32852 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:35.772887 [ 32851 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:35.772927 [ 32848 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:35.772941 [ 32854 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:35.772865 [ 32855 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:35.772962 [ 32857 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:35.772988 [ 32858 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:35.772821 [ 32850 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:35.773629 [ 32259 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:35.773686 [ 32841 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:35.774018 [ 32259 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:35.774157 [ 32259 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:35.774170 [ 32259 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:35.774185 [ 32259 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:35.774198 [ 32259 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:35.774394 [ 32259 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:35.774436 [ 32259 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:35.776017 [ 32259 ] {} Application: Destroyed global context. 2025.04.02 04:49:35.776237 [ 32259 ] {} Application: Waiting for background threads 2025.04.02 04:49:35.790450 [ 32259 ] {} Application: Background threads finished in 14 ms 2025.04.02 04:49:35.790924 [ 32259 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:35.790940 [ 32259 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:35.794249 [ 32259 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:35.794343 [ 32259 ] {} Application: shutting down 2025.04.02 04:49:35.794351 [ 32259 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:35.795132 [ 32260 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:35.795185 [ 32260 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:35.866107 [ 32258 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:36.784425 [ 32964 ] {} Application: Will watch for the process with pid 32965 2025.04.02 04:49:36.784604 [ 32965 ] {} Application: Forked a child process to watch 2025.04.02 04:49:36.785513 [ 32965 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:36.893844 [ 32965 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 32965 2025.04.02 04:49:36.894255 [ 32965 ] {} Application: starting up 2025.04.02 04:49:36.894275 [ 32965 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:36.902451 [ 32965 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:36.902527 [ 32965 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:36.902578 [ 32965 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:36.902590 [ 32965 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:36.902618 [ 32965 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:36.903359 [ 32965 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:36.903540 [ 32965 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:36.903556 [ 32965 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:36.903623 [ 32965 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:36.903637 [ 32965 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:37.201242 [ 32965 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:37.201418 [ 32965 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:37.228955 [ 32965 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:37.229099 [ 32965 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:37.229270 [ 32965 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:37.250712 [ 32973 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:37.250817 [ 32965 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:37.250902 [ 32965 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:37.250912 [ 32965 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:37.250918 [ 32965 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:37.251039 [ 32965 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:37.251144 [ 32965 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:37.253532 [ 32965 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:37.253552 [ 32965 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:37.253570 [ 32965 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:37.253842 [ 32965 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:37.253869 [ 32965 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:37.254166 [ 32965 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:37.255200 [ 32965 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:37.255238 [ 32965 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:37.255257 [ 32965 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:37.255354 [ 32965 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:37.257498 [ 32965 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:37.257523 [ 32965 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:37.258872 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:37.259105 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:37.259233 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:37.259348 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:37.259459 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:37.260282 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:37.260391 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:37.260498 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:37.260599 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:37.260691 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:37.260813 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:37.260904 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:37.261009 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:37.261103 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:37.261245 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:37.261341 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:37.261436 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:37.261531 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:37.261636 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:37.261735 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:37.261838 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:37.261938 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:37.262108 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:37.262354 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:37.262464 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:37.262657 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:37.262901 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:37.263026 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:37.263118 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:37.263218 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:37.263322 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:37.263432 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:37.263554 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:37.263651 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:37.263792 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:37.263893 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:37.264031 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:37.264165 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:37.264281 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:37.264529 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:37.264686 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:37.264797 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:37.264914 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:37.265039 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:37.265163 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:37.265347 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:37.265473 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:37.265593 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:37.265715 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:37.266227 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:37.266420 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:37.266642 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:37.266795 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:37.266924 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:37.267049 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:37.267222 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:37.267348 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:37.267498 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:37.267609 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:37.267727 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:37.267844 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:37.268031 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:37.268150 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:37.268298 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:37.268465 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:37.268596 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:37.269035 [ 32965 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:37.287852 [ 32965 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:37.288331 [ 32965 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:37.299003 [ 32965 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:37.299039 [ 32965 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:37.299045 [ 32965 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:37.302636 [ 32965 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:37.302665 [ 32965 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:37.302681 [ 32965 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:37.302704 [ 32965 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:37.303588 [ 32965 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:37.304524 [ 32965 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:37.307570 [ 32965 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:37.307703 [ 32965 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:37.307751 [ 32965 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:37.308569 [ 32965 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:37.308777 [ 32965 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:37.309009 [ 32965 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:37.309647 [ 32965 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:37.309686 [ 32965 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:37.310197 [ 32965 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:37.310208 [ 32965 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:37.310215 [ 32965 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:37.310226 [ 32965 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:37.310232 [ 32965 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:37.310285 [ 32965 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:37.310301 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.322754 [ 32965 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:37.324321 [ 32965 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:37.324338 [ 32965 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:37.324696 [ 32965 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:37.324790 [ 32965 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg 2025.04.02 04:49:37.324826 [ 32965 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg 2025.04.02 04:49:37.324836 [ 32965 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg, size 4 2025.04.02 04:49:37.325038 [ 32965 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg. 2025.04.02 04:49:37.325167 [ 33539 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg 2025.04.02 04:49:37.331054 [ 33539 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg, size 4 2025.04.02 04:49:37.331447 [ 32965 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg. 2025.04.02 04:49:37.331694 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.334008 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.334037 [ 32965 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg, Version: Latest, Offset: 2 2025.04.02 04:49:37.338072 [ 32965 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg 2025.04.02 04:49:37.338106 [ 32965 ] {} deleteFileFromS3: Object with path s3/nje/ttlmiphxvmslrfhphbqkwbmcanpgg was removed from S3 2025.04.02 04:49:37.338152 [ 32965 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:37.338166 [ 32965 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:37.339070 [ 32965 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:37.340830 [ 32965 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:37.340849 [ 32965 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:37.341036 [ 32965 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:37.347701 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.350273 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.350302 [ 32965 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:37.353973 [ 32965 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:37.354060 [ 32965 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:37 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 1832609000F4A7B2 x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:37.354118 [ 32965 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:37.356900 [ 32965 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:37.356931 [ 32965 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:37.356953 [ 32965 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:37.356966 [ 32965 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:37.357067 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.357090 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.357109 [ 32965 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:37.357127 [ 32965 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:37.357146 [ 32965 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:37.357165 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.357231 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.357258 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.357276 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.357294 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.358228 [ 32965 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:37.360275 [ 32965 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:37.360297 [ 32965 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:37.360525 [ 32965 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:37.366134 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/vwf/lfvtwhwfwygsqckprsdvdzttavshm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.367796 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/vwf/lfvtwhwfwygsqckprsdvdzttavshm (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.367824 [ 32965 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/vwf/lfvtwhwfwygsqckprsdvdzttavshm, Version: Latest, Offset: 2 2025.04.02 04:49:37.372255 [ 32965 ] {} deleteFileFromS3: No blob storage log, not writing blob special/vwf/lfvtwhwfwygsqckprsdvdzttavshm 2025.04.02 04:49:37.372297 [ 32965 ] {} deleteFileFromS3: Object with path special/vwf/lfvtwhwfwygsqckprsdvdzttavshm was removed from S3 2025.04.02 04:49:37.372319 [ 32965 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:37.372334 [ 32965 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:37.373771 [ 32965 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:37.376800 [ 32965 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:37.376822 [ 32965 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:37.377148 [ 32965 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:37.381314 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mqu/ukaleyxqnwodobsqtvhgrxgwnxcyw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.383289 [ 32965 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/mqu/ukaleyxqnwodobsqtvhgrxgwnxcyw (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:37.383324 [ 32965 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/mqu/ukaleyxqnwodobsqtvhgrxgwnxcyw, Version: Latest, Offset: 2 2025.04.02 04:49:37.386748 [ 32965 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/mqu/ukaleyxqnwodobsqtvhgrxgwnxcyw 2025.04.02 04:49:37.386775 [ 32965 ] {} deleteFileFromS3: Object with path test_02944/mqu/ukaleyxqnwodobsqtvhgrxgwnxcyw was removed from S3 2025.04.02 04:49:37.386794 [ 32965 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:37.386807 [ 32965 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:37.386847 [ 32965 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:37.388817 [ 32965 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:37.390686 [ 32965 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:37.390795 [ 32965 ] {} KeeperSnapshotManager: Found snapshot_41.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:37.390824 [ 32965 ] {} KeeperSnapshotManager: Found snapshot_42.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:37.390837 [ 32965 ] {} KeeperSnapshotManager: Found snapshot_43.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:37.391584 [ 32965 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:37.391665 [ 32965 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:37.391858 [ 32965 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:37.391877 [ 32965 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:37.391917 [ 32965 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:37.391929 [ 32965 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 43 2025.04.02 04:49:37.392319 [ 32965 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:37.392400 [ 32965 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 43 2025.04.02 04:49:37.392706 [ 32965 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 43 entries 2025.04.02 04:49:37.392733 [ 32965 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:37.392787 [ 32965 ] {} KeeperServer: Last local log idx 43 2025.04.02 04:49:37.392806 [ 32965 ] {} KeeperServer: Will use config from log store with log index 43 2025.04.02 04:49:37.393417 [ 32965 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:37.395899 [ 32965 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:37.396198 [ 32965 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:37.396238 [ 32965 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:37.396266 [ 32965 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:37.396287 [ 32965 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:37.396299 [ 32965 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:37.396323 [ 32965 ] {} RaftInstance: === INIT RAFT SERVER === commit index 43 term 43 election timer allowed log store start 1, end 43 config log idx 43, prev log idx 42 -- ASYNC REPLICATION -- 2025.04.02 04:49:37.396348 [ 32965 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:37.396399 [ 32965 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:37.396548 [ 32965 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:37.396608 [ 33566 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:37.446823 [ 33549 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:37.446867 [ 33549 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:37.446868 [ 32965 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:37.446917 [ 33549 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 43, state term 43, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:37.446926 [ 33549 ] {} RaftInstance: pre-vote term (0) is different, reset it to 43 2025.04.02 04:49:37.447060 [ 33549 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:37.449257 [ 33549 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 44, log idx 43, log term 43, priority (target 1 / mine 1) 2025.04.02 04:49:37.449278 [ 33549 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:37.449285 [ 33549 ] {} RaftInstance: state machine commit index 43, precommit index 43, last log index 43 2025.04.02 04:49:37.449474 [ 33547 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:37.449541 [ 33549 ] {} RaftInstance: [BECOME LEADER] appended new config at 44 2025.04.02 04:49:37.449637 [ 33565 ] {} RaftInstance: config at index 44 is committed, prev config log idx 43 2025.04.02 04:49:37.449674 [ 33565 ] {} RaftInstance: new config log idx 44, prev log idx 43, cur config log idx 43, prev log idx 42 2025.04.02 04:49:37.449699 [ 33565 ] {} RaftInstance: new configuration: log idx 44, prev log idx 43 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 44 2025.04.02 04:49:37.449775 [ 32965 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:37.449965 [ 32965 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:37.451546 [ 32965 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:37.451689 [ 32965 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:37.455601 [ 32965 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:37.455627 [ 32965 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:37.456141 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:37.456301 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:37.456506 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:37.456622 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:37.456722 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:37.456819 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:37.456923 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:37.457076 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:37.458327 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:37.458538 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:37.458712 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:37.458888 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:37.459080 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:37.459254 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:37.459443 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:37.459657 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:37.459835 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:37.460080 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:37.460268 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:37.460463 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:37.460647 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:37.460845 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:37.461288 [ 32965 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:37.466848 [ 32965 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:37.466924 [ 32965 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:37.470201 [ 32965 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:37.470242 [ 32965 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:37.470769 [ 32965 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:37.471066 [ 32965 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:37.471286 [ 32965 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:37.471564 [ 33571 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:37.473376 [ 32965 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:37.474035 [ 32965 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:37.475037 [ 32965 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:37.475520 [ 32965 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:37.476796 [ 32965 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:37.477432 [ 32965 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:37.478159 [ 32965 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:37.478836 [ 32965 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:37.478884 [ 32965 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:37.478963 [ 32972 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:37.479297 [ 32972 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:41.698900 [ 32965 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:41.699068 [ 32965 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:41.699348 [ 32965 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:41.699362 [ 32965 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:41.699435 [ 32973 ] {} CancellationChecker: Execution took 4448 ms. 2025.04.02 04:49:41.699614 [ 32965 ] {} Application: Shutting down storages. 2025.04.02 04:49:41.699629 [ 32965 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:41.700805 [ 32965 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:41.700819 [ 32965 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:41.700828 [ 32965 ] {} Context: Shutting down named sessions 2025.04.02 04:49:41.700857 [ 32965 ] {} Context: Shutting down database catalog 2025.04.02 04:49:41.700866 [ 32965 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:41.700908 [ 32965 ] {} Context: Shutting down merges executor 2025.04.02 04:49:41.701182 [ 32965 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:41.701472 [ 32965 ] {} Context: Shutting down moves executor 2025.04.02 04:49:41.701648 [ 32965 ] {} Context: Shutting down common executor 2025.04.02 04:49:41.701795 [ 32965 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:41.701807 [ 32965 ] {} Context: Shutting down caches 2025.04.02 04:49:41.701820 [ 32965 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:41.702139 [ 32965 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:41.704640 [ 32965 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:41.704902 [ 32965 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:41.705067 [ 32965 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:41.705304 [ 32965 ] {} Application: Shut down storages. 2025.04.02 04:49:41.705322 [ 32965 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:41.707233 [ 32965 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:41.707247 [ 32965 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:41.707258 [ 32965 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:41.952002 [ 32965 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:41.952086 [ 32965 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:41.952099 [ 32965 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:41.952116 [ 32965 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:41.952127 [ 32965 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:41.952151 [ 32965 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:41.952162 [ 32965 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:41.952291 [ 32965 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:41.952284 [ 33566 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:41.952397 [ 32965 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:41.952410 [ 32965 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:41.952419 [ 32965 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:41.952429 [ 32965 ] {} RaftInstance: manually create a snapshot on 44 2025.04.02 04:49:41.952441 [ 32965 ] {} RaftInstance: creating a snapshot for index 44 2025.04.02 04:49:41.952453 [ 32965 ] {} RaftInstance: create snapshot idx 44 log_term 44 2025.04.02 04:49:41.952476 [ 32965 ] {} KeeperStateMachine: Creating snapshot 44 2025.04.02 04:49:41.952538 [ 32965 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:41.955715 [ 32965 ] {} KeeperStateMachine: Created persistent snapshot 44 with path snapshot_44.bin.zstd 2025.04.02 04:49:41.955742 [ 32965 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:41.955753 [ 32965 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:41.955788 [ 32965 ] {} RaftInstance: snapshot idx 44 log_term 44 created, compact the log store if needed 2025.04.02 04:49:41.955804 [ 32965 ] {} RaftInstance: create snapshot idx 44 log_term 44 done: 3334 us elapsed 2025.04.02 04:49:41.956147 [ 33550 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:41.956191 [ 33549 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:41.956196 [ 33552 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:41.956273 [ 33558 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:41.956239 [ 33553 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:41.956242 [ 33551 ] {} RaftInstance: end of asio worker thread, remaining threads: 12 2025.04.02 04:49:41.956287 [ 33563 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:41.956438 [ 33561 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:41.956371 [ 33564 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:41.956351 [ 33556 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:41.956542 [ 33555 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:41.956454 [ 33557 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:41.956503 [ 33562 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:41.956538 [ 33554 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:41.956277 [ 33560 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:41.956375 [ 33559 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:41.957110 [ 32965 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:41.957171 [ 33547 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:41.957525 [ 32965 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:41.957648 [ 32965 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:41.957667 [ 32965 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:41.957682 [ 32965 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:41.957694 [ 32965 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:41.957876 [ 32965 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:41.957913 [ 32965 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:41.959516 [ 32965 ] {} Application: Destroyed global context. 2025.04.02 04:49:41.959701 [ 32965 ] {} Application: Waiting for background threads 2025.04.02 04:49:41.974670 [ 32965 ] {} Application: Background threads finished in 14 ms 2025.04.02 04:49:41.975272 [ 32965 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:41.975291 [ 32965 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:41.979758 [ 32965 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:41.979871 [ 32965 ] {} Application: shutting down 2025.04.02 04:49:41.979883 [ 32965 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:41.980767 [ 32966 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:41.980803 [ 32966 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:42.059270 [ 32964 ] {} Application: Child process exited normally with code 233. 2025.04.02 04:49:42.671727 [ 33666 ] {} Application: Will watch for the process with pid 33667 2025.04.02 04:49:42.671926 [ 33667 ] {} Application: Forked a child process to watch 2025.04.02 04:49:42.672608 [ 33667 ] {} SentryWriter: Sending crash reports is disabled 2025.04.02 04:49:42.778839 [ 33667 ] {} Application: Starting ClickHouse 25.2.2.173926.altinityantalya.173926 (revision: 4294967295, git hash: 25f7c2a766916d92d37aee82d9defa5f14b86ec8, build id: BB78C1DD419B7F382EC5FCF63BB7BD1B6D1E8DD2), PID 33667 2025.04.02 04:49:42.779265 [ 33667 ] {} Application: starting up 2025.04.02 04:49:42.779283 [ 33667 ] {} Application: OS name: Linux, version: 5.15.0-130-generic, architecture: x86_64 2025.04.02 04:49:42.787472 [ 33667 ] {} Context: Server was built with undefined behavior sanitizer. It will work slowly. 2025.04.02 04:49:42.787549 [ 33667 ] {} Application: Available RAM: 30.60 GiB; logical cores: 16; used cores: 16. 2025.04.02 04:49:42.787600 [ 33667 ] {} Application: Available CPU instruction sets: SSE, SSE2, SSE3, SSSE3, SSE41, SSE42, F16C, POPCNT, BMI1, BMI2, PCLMUL, AES, AVX, FMA, AVX2, SHA, ADX, RDRAND, RDSEED, RDTSCP, CLFLUSHOPT, CLWB, XSAVE, OSXSAVE 2025.04.02 04:49:42.787613 [ 33667 ] {} Application: Query Profiler is disabled because it cannot work under sanitizers when two different stack unwinding methods will interfere with each other. 2025.04.02 04:49:42.787639 [ 33667 ] {} Pipe: Pipe capacity is 1.00 MiB 2025.04.02 04:49:42.788408 [ 33667 ] {} CgroupsReader: Will create cgroup reader from '/sys/fs/cgroup/' (cgroups version: v2) 2025.04.02 04:49:42.788581 [ 33667 ] {} AsynchronousMetrics: Scanning /sys/class/thermal 2025.04.02 04:49:42.788595 [ 33667 ] {} AsynchronousMetrics: Scanning /sys/block 2025.04.02 04:49:42.788663 [ 33667 ] {} AsynchronousMetrics: Scanning /sys/devices/system/edac 2025.04.02 04:49:42.788677 [ 33667 ] {} AsynchronousMetrics: Scanning /sys/class/hwmon 2025.04.02 04:49:43.084561 [ 33667 ] {} Application: Integrity check of the executable successfully passed (checksum: F783DCB4F4FBDF2C6350AF1DF7238AE4) 2025.04.02 04:49:43.084724 [ 33667 ] {} Application: Will do mlock to prevent executable memory from being paged out. It may take a few seconds. 2025.04.02 04:49:43.111510 [ 33667 ] {} Application: The memory map of clickhouse executable has been mlock'ed, total 499.97 MiB 2025.04.02 04:49:43.111592 [ 33667 ] {} MemoryWorker: Starting background memory thread with period of 50ms, using Cgroups as source 2025.04.02 04:49:43.111718 [ 33667 ] {} BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 512 threads 2025.04.02 04:49:43.143846 [ 33677 ] {} CancellationChecker: Started worker function 2025.04.02 04:49:43.144005 [ 33667 ] {} Application: Set max number of file descriptors to 1048576 (was 1024). 2025.04.02 04:49:43.144050 [ 33667 ] {} Application: rlimit on number of threads is 18446744073709551615 2025.04.02 04:49:43.144066 [ 33667 ] {} Application: Initializing DateLUT. 2025.04.02 04:49:43.144077 [ 33667 ] {} Application: Initialized DateLUT with time zone 'Europe/Amsterdam'. 2025.04.02 04:49:43.144247 [ 33667 ] {} Context: Setting up /tmp/clickhouse/ to store temporary data in it 2025.04.02 04:49:43.144428 [ 33667 ] {} TLDListsHolder: public_suffix_list loading from /etc/clickhouse-server/top_level_domains/public_suffix_list.dat 2025.04.02 04:49:43.149600 [ 33667 ] {} TLDListsHolder: public_suffix_list was added (9084 hosts) 2025.04.02 04:49:43.149638 [ 33667 ] {} TLDListsHolder: no_new_line_list loading from /etc/clickhouse-server/top_level_domains/no_new_line_list.dat 2025.04.02 04:49:43.149673 [ 33667 ] {} TLDListsHolder: no_new_line_list was added (1 hosts) 2025.04.02 04:49:43.150149 [ 33667 ] {} Application: Configuration parameter 'interserver_http_host' doesn't exist or exists and empty. Will use '30a59d31e02b' as replica host. 2025.04.02 04:49:43.150198 [ 33667 ] {} Application: Initializing interserver credentials. 2025.04.02 04:49:43.150804 [ 33667 ] {} NamedCollectionsMetadataStorage: Using local storage for named collections at path: /var/lib/clickhouse/named_collections 2025.04.02 04:49:43.153086 [ 33667 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:43.153141 [ 33667 ] {} NamedCollectionFactory: Loaded 0 collections from sql 2025.04.02 04:49:43.153177 [ 33667 ] {} FileCacheFactory: Will load 0 caches from default cache config 2025.04.02 04:49:43.153402 [ 33667 ] {} SensitiveDataMaskerConfigRead: 1 query masking rules loaded. 2025.04.02 04:49:43.157414 [ 33667 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/config.xml' 2025.04.02 04:49:43.157438 [ 33667 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/config.xml'. 2025.04.02 04:49:43.160281 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/azure_storage_conf.xml'. 2025.04.02 04:49:43.160699 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backoff_failed_mutation.xml'. 2025.04.02 04:49:43.160909 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/backups.xml'. 2025.04.02 04:49:43.161162 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/blob_storage_log.xml'. 2025.04.02 04:49:43.161436 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/clusters.xml'. 2025.04.02 04:49:43.163311 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/compressed_marks_and_index.xml'. 2025.04.02 04:49:43.163548 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/core.xml'. 2025.04.02 04:49:43.163779 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_disks_base_path.xml'. 2025.04.02 04:49:43.163970 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/custom_settings_prefixes.xml'. 2025.04.02 04:49:43.164191 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_atomic.xml'. 2025.04.02 04:49:43.164463 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/database_catalog_drop_table_concurrency.xml'. 2025.04.02 04:49:43.164664 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/disable_s3_env_credentials.xml'. 2025.04.02 04:49:43.164866 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/display_name.xml'. 2025.04.02 04:49:43.165078 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_access_control_improvements.xml'. 2025.04.02 04:49:43.165433 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_keeper_map.xml'. 2025.04.02 04:49:43.165651 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_wait_for_shutdown_replicated_tables.xml'. 2025.04.02 04:49:43.165873 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/enable_zero_copy_replication.xml'. 2025.04.02 04:49:43.166096 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/encryption.xml'. 2025.04.02 04:49:43.166328 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_cache_log.xml'. 2025.04.02 04:49:43.166544 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/filesystem_caches_path.xml'. 2025.04.02 04:49:43.166768 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/forbidden_headers.xml'. 2025.04.02 04:49:43.166988 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite.xml'. 2025.04.02 04:49:43.167365 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/graphite_alternative.xml'. 2025.04.02 04:49:43.167882 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/grpc_protocol.xml'. 2025.04.02 04:49:43.168110 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/handlers.yaml'. 2025.04.02 04:49:43.168485 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/keeper_port.xml'. 2025.04.02 04:49:43.169036 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/legacy_geobase.xml'. 2025.04.02 04:49:43.169315 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/listen.xml'. 2025.04.02 04:49:43.169524 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logger_trace.xml'. 2025.04.02 04:49:43.169743 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/logging_no_rotate.xml'. 2025.04.02 04:49:43.169972 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/lost_forever_check.xml'. 2025.04.02 04:49:43.170230 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/macros.xml'. 2025.04.02 04:49:43.170514 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_concurrent_queries.xml'. 2025.04.02 04:49:43.170734 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_num_to_warn.xml'. 2025.04.02 04:49:43.171050 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/max_server_memory_usage.xml'. 2025.04.02 04:49:43.171275 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree.xml'. 2025.04.02 04:49:43.171539 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_old_dirs_cleanup.xml'. 2025.04.02 04:49:43.171825 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/merge_tree_settings.xml'. 2025.04.02 04:49:43.172095 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/named_collection.xml'. 2025.04.02 04:49:43.172638 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/nlp.xml'. 2025.04.02 04:49:43.172979 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/prometheus.xml'. 2025.04.02 04:49:43.173277 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml'. 2025.04.02 04:49:43.173547 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/query_masking_rules.xml_original.xml'. 2025.04.02 04:49:43.173808 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/rocksdb.xml'. 2025.04.02 04:49:43.174092 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/secure_ports.xml'. 2025.04.02 04:49:43.174410 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/serverwide_trace_collector.xml'. 2025.04.02 04:49:43.174677 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/session_log.xml'. 2025.04.02 04:49:43.174937 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/ssl_certs.xml'. 2025.04.02 04:49:43.175216 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf.xml'. 2025.04.02 04:49:43.176352 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02944.xml'. 2025.04.02 04:49:43.176685 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02961.xml'. 2025.04.02 04:49:43.177074 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/storage_conf_02963.xml'. 2025.04.02 04:49:43.177364 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/system_unfreeze.xml'. 2025.04.02 04:49:43.177573 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tcp_with_proxy.xml'. 2025.04.02 04:49:43.177763 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/test_cluster_with_incorrect_pw.xml'. 2025.04.02 04:49:43.178066 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/text_log.xml'. 2025.04.02 04:49:43.178283 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/threadpool_writer_pool_size.yaml'. 2025.04.02 04:49:43.178506 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/tmp.xml'. 2025.04.02 04:49:43.178695 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_lists.xml'. 2025.04.02 04:49:43.178896 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/top_level_domains_path.xml'. 2025.04.02 04:49:43.179109 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/transactions.xml'. 2025.04.02 04:49:43.179410 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/validate_tcp_client_information.xml'. 2025.04.02 04:49:43.179609 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zero_copy_destructive_operations.xml'. 2025.04.02 04:49:43.179849 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_fault_injection.xml'. 2025.04.02 04:49:43.180145 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_log.xml'. 2025.04.02 04:49:43.180368 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/config.d/zookeeper_write.xml'. 2025.04.02 04:49:43.181149 [ 33667 ] {} ConfigProcessor: Env variable is not set: AZURE_CONNECTION_STRING 2025.04.02 04:49:43.206484 [ 33667 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. 2025.04.02 04:49:43.207038 [ 33667 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performing update on configuration 2025.04.02 04:49:43.219537 [ 33667 ] {} Application: Changed setting 'max_server_memory_usage' to 15.30 GiB (30.60 GiB available memory * 0.50 max_server_memory_usage_to_ram_ratio) 2025.04.02 04:49:43.219549 [ 33667 ] {} Application: Setting merges_mutations_memory_usage_soft_limit was set to 15.30 GiB (30.60 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio) 2025.04.02 04:49:43.219560 [ 33667 ] {} Application: Merges and mutations memory limit is set to 15.30 GiB 2025.04.02 04:49:43.223045 [ 33667 ] {} Application: Setting max_remote_read_network_bandwidth_for_server was set to 0 2025.04.02 04:49:43.223058 [ 33667 ] {} Application: Setting max_remote_write_network_bandwidth_for_server was set to 0 2025.04.02 04:49:43.223073 [ 33667 ] {} Application: ConcurrencyControl limit is set to 32 CPU slots with 'fair_round_robin' scheduler 2025.04.02 04:49:43.223096 [ 33667 ] {} BackgroundSchedulePool/BgBufSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:43.223733 [ 33667 ] {} BackgroundSchedulePool/BgMBSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:43.224450 [ 33667 ] {} BackgroundSchedulePool/BgDistSchPool: Create BackgroundSchedulePool with 16 threads 2025.04.02 04:49:43.226623 [ 33667 ] {} NamedCollectionFactory: Loaded 9 collections from config 2025.04.02 04:49:43.226695 [ 33667 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/config.xml', performed update on configuration 2025.04.02 04:49:43.226726 [ 33667 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:43.227286 [ 33667 ] {} Context: Keeper server is participant of the main zookeeper cluster, will try to connect to it 2025.04.02 04:49:43.227419 [ 33667 ] {} ZooKeeper: Availability zones from config: [''], client: '' 2025.04.02 04:49:43.227520 [ 33667 ] {} ZooKeeperClient: Adding ZooKeeper host localhost:9181 ([::1]:9181), az: UNKNOWN, priority: 0 2025.04.02 04:49:43.227939 [ 33667 ] {} Context: Cannot connect to ZooKeeper (or Keeper) before internal Keeper start, will wait for Keeper synchronously 2025.04.02 04:49:43.227966 [ 33667 ] {} KeeperDispatcher: Initializing storage dispatcher 2025.04.02 04:49:43.228327 [ 33667 ] {} KeeperContext: Keeper feature flag FILTERED_LIST: enabled 2025.04.02 04:49:43.228334 [ 33667 ] {} KeeperContext: Keeper feature flag MULTI_READ: enabled 2025.04.02 04:49:43.228339 [ 33667 ] {} KeeperContext: Keeper feature flag CHECK_NOT_EXISTS: enabled 2025.04.02 04:49:43.228347 [ 33667 ] {} KeeperContext: Keeper feature flag CREATE_IF_NOT_EXISTS: disabled 2025.04.02 04:49:43.228351 [ 33667 ] {} KeeperContext: Keeper feature flag REMOVE_RECURSIVE: disabled 2025.04.02 04:49:43.228390 [ 33667 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:43.228401 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.238217 [ 33667 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:43.239638 [ 33667 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:43.239647 [ 33667 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:43.239939 [ 33667 ] {} DiskObjectStorage(s3_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:43.240032 [ 33667 ] {} WriteBufferFromS3: Create WriteBufferFromS3, Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei 2025.04.02 04:49:43.240068 [ 33667 ] {} WriteBufferFromS3: preFinalize WriteBufferFromS3. Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei 2025.04.02 04:49:43.240077 [ 33667 ] {} WriteBufferFromS3: Making single part upload. Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei, size 4 2025.04.02 04:49:43.240216 [ 33667 ] {} WriteBufferFromS3: finalizeImpl WriteBufferFromS3. Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei. 2025.04.02 04:49:43.240319 [ 34241 ] {} WriteBufferFromS3: writing single part upload started. Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei 2025.04.02 04:49:43.246338 [ 34241 ] {} WriteBufferFromS3: Single part upload has completed. Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei, size 4 2025.04.02 04:49:43.246565 [ 33667 ] {} WriteBufferFromS3: Close WriteBufferFromS3. Details: bucket test, key s3/laa/emexxmevuwgayajobifquonfjfjei. 2025.04.02 04:49:43.246758 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/laa/emexxmevuwgayajobifquonfjfjei (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.248778 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3/laa/emexxmevuwgayajobifquonfjfjei (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.248803 [ 33667 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3/laa/emexxmevuwgayajobifquonfjfjei, Version: Latest, Offset: 2 2025.04.02 04:49:43.253516 [ 33667 ] {} deleteFileFromS3: No blob storage log, not writing blob s3/laa/emexxmevuwgayajobifquonfjfjei 2025.04.02 04:49:43.253538 [ 33667 ] {} deleteFileFromS3: Object with path s3/laa/emexxmevuwgayajobifquonfjfjei was removed from S3 2025.04.02 04:49:43.253577 [ 33667 ] {} DiskObjectStorage(s3_disk): Starting up disk s3_disk 2025.04.02 04:49:43.253588 [ 33667 ] {} DiskObjectStorage(s3_disk): Disk s3_disk started up 2025.04.02 04:49:43.254496 [ 33667 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:43.256575 [ 33667 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:43.256587 [ 33667 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:43.256790 [ 33667 ] {} DiskObjectStorage(s3_plain_disk): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:43.262531 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.265369 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.265394 [ 33667 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7, Version: Latest, Offset: 2 2025.04.02 04:49:43.268891 [ 33667 ] {} AWSClient: Response status: 404, Not Found 2025.04.02 04:49:43.268945 [ 33667 ] {} AWSClient: AWSXmlClient: HTTP response code: 404 Resolved remote host IP address: 127.0.0.1:11111 Request ID: Exception name: Error message: No response body. 13 response headers: accept-ranges : bytes content-length : 0 content-type : date : Wed, 02 Apr 2025 02:49:43 GMT server : MinIO strict-transport-security : max-age=31536000; includeSubDomains vary : Accept-Encoding x-amz-id-2 : 7dc7eb22d3288ec80374614e9088e31d3668a6922ead55932dd2a8e56373820f x-amz-request-id : 183260916184CADC x-content-type-options : nosniff x-minio-error-code : NoSuchKey x-minio-error-desc : "The specified key does not exist." x-xss-protection : 1; mode=block 2025.04.02 04:49:43.268986 [ 33667 ] {} AWSClient: If the signature check failed. This could be because of a time skew. Attempting to adjust the signer. 2025.04.02 04:49:43.272030 [ 33667 ] {} deleteFileFromS3: No blob storage log, not writing blob s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:43.272050 [ 33667 ] {} deleteFileFromS3: Object with path s3_plain/clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 was removed from S3 2025.04.02 04:49:43.272062 [ 33667 ] {} DiskObjectStorage(s3_plain_disk): Starting up disk s3_plain_disk 2025.04.02 04:49:43.272071 [ 33667 ] {} DiskObjectStorage(s3_plain_disk): Disk s3_plain_disk started up 2025.04.02 04:49:43.272111 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.272129 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.272146 [ 33667 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:43.272162 [ 33667 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:43.272178 [ 33667 ] {} KeeperContext: Disk type 'local_blob_storage' is not supported for Keeper 2025.04.02 04:49:43.272194 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.272210 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.272226 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.272242 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.272258 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.273085 [ 33667 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:43.275257 [ 33667 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:43.275274 [ 33667 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:43.275474 [ 33667 ] {} DiskObjectStorage(s3_no_cache): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:43.279599 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/frx/amavqohrbiwfjzzjpzxkhjazhvqdl (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.281016 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: special/frx/amavqohrbiwfjzzjpzxkhjazhvqdl (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.281055 [ 33667 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: special/frx/amavqohrbiwfjzzjpzxkhjazhvqdl, Version: Latest, Offset: 2 2025.04.02 04:49:43.284283 [ 33667 ] {} deleteFileFromS3: No blob storage log, not writing blob special/frx/amavqohrbiwfjzzjpzxkhjazhvqdl 2025.04.02 04:49:43.284302 [ 33667 ] {} deleteFileFromS3: Object with path special/frx/amavqohrbiwfjzzjpzxkhjazhvqdl was removed from S3 2025.04.02 04:49:43.284314 [ 33667 ] {} DiskObjectStorage(s3_no_cache): Starting up disk s3_no_cache 2025.04.02 04:49:43.284323 [ 33667 ] {} DiskObjectStorage(s3_no_cache): Disk s3_no_cache started up 2025.04.02 04:49:43.285641 [ 33667 ] {} AWSClient: ClientConfiguration: User agent is overridden in the config: ClickHouse 25.2.2.173926.altinityantalya.173926 (official build) 2025.04.02 04:49:43.288610 [ 33667 ] {} S3Client: Provider type: Unknown 2025.04.02 04:49:43.288623 [ 33667 ] {} S3Client: API mode of the S3 client: AWS 2025.04.02 04:49:43.288816 [ 33667 ] {} DiskObjectStorage(s3_disk_02944): Write file: clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7 2025.04.02 04:49:43.292908 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/duv/fiijxyizthtklqiqqjfdcawfguxob (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.294611 [ 33667 ] {} ReadBufferFromRemoteFSGather: Reading from file: test_02944/duv/fiijxyizthtklqiqqjfdcawfguxob (clickhouse_access_check_82240da6-2338-471b-9fd3-3548de1bdcf7) 2025.04.02 04:49:43.294642 [ 33667 ] {} ReadBufferFromS3: Read S3 object. Bucket: test, Key: test_02944/duv/fiijxyizthtklqiqqjfdcawfguxob, Version: Latest, Offset: 2 2025.04.02 04:49:43.298432 [ 33667 ] {} deleteFileFromS3: No blob storage log, not writing blob test_02944/duv/fiijxyizthtklqiqqjfdcawfguxob 2025.04.02 04:49:43.298459 [ 33667 ] {} deleteFileFromS3: Object with path test_02944/duv/fiijxyizthtklqiqqjfdcawfguxob was removed from S3 2025.04.02 04:49:43.298488 [ 33667 ] {} DiskObjectStorage(s3_disk_02944): Starting up disk s3_disk_02944 2025.04.02 04:49:43.298501 [ 33667 ] {} DiskObjectStorage(s3_disk_02944): Disk s3_disk_02944 started up 2025.04.02 04:49:43.298537 [ 33667 ] {} KeeperContext: Disk type 'cache' is not supported for Keeper 2025.04.02 04:49:43.300638 [ 33667 ] {} KeeperContext: Disk type 'object_storage' is not supported for Keeper 2025.04.02 04:49:43.302571 [ 33667 ] {} KeeperSnapshotManager: Reading from disk LocalSnapshotDisk 2025.04.02 04:49:43.302676 [ 33667 ] {} KeeperSnapshotManager: Found snapshot_44.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:43.302704 [ 33667 ] {} KeeperSnapshotManager: Found snapshot_42.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:43.302717 [ 33667 ] {} KeeperSnapshotManager: Found snapshot_43.bin.zstd on LocalSnapshotDisk 2025.04.02 04:49:43.303462 [ 33667 ] {} KeeperLogStore: Reading from disk LocalLogDisk 2025.04.02 04:49:43.303553 [ 33667 ] {} KeeperLogStore: Found changelog_1_100000.bin on LocalLogDisk 2025.04.02 04:49:43.303746 [ 33667 ] {} KeeperLogStore: force_sync disabled 2025.04.02 04:49:43.303765 [ 33667 ] {} KeeperDispatcher: Waiting server to initialize 2025.04.02 04:49:43.303805 [ 33667 ] {} KeeperStateMachine: Totally have 3 snapshots 2025.04.02 04:49:43.303817 [ 33667 ] {} KeeperStateMachine: Trying to load state machine from snapshot up to log index 44 2025.04.02 04:49:43.304251 [ 33667 ] {} KeeperSnapshotManager: Building structure for children nodes 2025.04.02 04:49:43.304329 [ 33667 ] {} KeeperStateMachine: Loaded snapshot with last committed log index 44 2025.04.02 04:49:43.304613 [ 33667 ] {} KeeperLogStore: Totally read from changelog changelog_1_100000.bin 44 entries 2025.04.02 04:49:43.304642 [ 33667 ] {} KeeperLogStore: Continue to write into changelog_1_100000.bin 2025.04.02 04:49:43.304696 [ 33667 ] {} KeeperServer: Last local log idx 44 2025.04.02 04:49:43.304715 [ 33667 ] {} KeeperServer: Will use config from log store with log index 44 2025.04.02 04:49:43.305336 [ 33667 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.02 04:49:43.307745 [ 33667 ] {} RaftInstance: Raft ASIO listener initiated on :::9234, unsecured 2025.04.02 04:49:43.308085 [ 33667 ] {} KeeperStateManager: Read state from /var/lib/clickhouse/coordination/state 2025.04.02 04:49:43.308125 [ 33667 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.02 04:49:43.308143 [ 33667 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.02 04:49:43.308164 [ 33667 ] {} RaftInstance: parameters: election timeout range 0 - 0, heartbeat 0, leadership expiry 0, max batch 100, backoff 50, snapshot distance 10000, enable randomized snapshot creation NO, log sync stop gap 99999, reserved logs 2147483647, client timeout 10000, auto forwarding on, API call type async, custom commit quorum size 0, custom election quorum size 0, snapshot receiver included, leadership transfer wait time 0, grace period of lagging state machine 0, snapshot IO: blocking, parallel log appending: on 2025.04.02 04:49:43.308177 [ 33667 ] {} RaftInstance: new election timeout range: 0 - 0 2025.04.02 04:49:43.308206 [ 33667 ] {} RaftInstance: === INIT RAFT SERVER === commit index 44 term 44 election timer allowed log store start 1, end 44 config log idx 44, prev log idx 43 -- ASYNC REPLICATION -- 2025.04.02 04:49:43.308227 [ 33667 ] {} RaftInstance: peer 1: DC ID 0, localhost:9234, voting member, 1 my id: 1, voting_member num peers: 0 2025.04.02 04:49:43.308278 [ 33667 ] {} RaftInstance: global manager does not exist. will use local thread for commit and append 2025.04.02 04:49:43.308439 [ 33667 ] {} RaftInstance: wait for HB, for 50 + [0, 0] ms 2025.04.02 04:49:43.308547 [ 34268 ] {} RaftInstance: bg append_entries thread initiated 2025.04.02 04:49:43.358737 [ 33667 ] {} KeeperDispatcher: Server initialized, waiting for quorum 2025.04.02 04:49:43.358752 [ 34251 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.02 04:49:43.358830 [ 34251 ] {} RaftInstance: [PRIORITY] decay, target 1 -> 1, mine 1 2025.04.02 04:49:43.358920 [ 34251 ] {} RaftInstance: [ELECTION TIMEOUT] current role: follower, log last term 44, state term 44, target p 1, my p 1, hb dead, pre-vote NOT done 2025.04.02 04:49:43.358934 [ 34251 ] {} RaftInstance: pre-vote term (0) is different, reset it to 44 2025.04.02 04:49:43.359128 [ 34251 ] {} IDisk: Copying from LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state to LocalStateFileDisk (path: /var/lib/clickhouse/coordination) state-OLD. 2025.04.02 04:49:43.361530 [ 34251 ] {} RaftInstance: [VOTE INIT] my id 1, my role candidate, term 45, log idx 44, log term 44, priority (target 1 / mine 1) 2025.04.02 04:49:43.361560 [ 34251 ] {} RaftInstance: number of pending commit elements: 0 2025.04.02 04:49:43.361572 [ 34251 ] {} RaftInstance: state machine commit index 44, precommit index 44, last log index 44 2025.04.02 04:49:43.361778 [ 34249 ] {} KeeperLogStore: Flushing 1 logs 2025.04.02 04:49:43.361860 [ 34251 ] {} RaftInstance: [BECOME LEADER] appended new config at 45 2025.04.02 04:49:43.361952 [ 34267 ] {} RaftInstance: config at index 45 is committed, prev config log idx 44 2025.04.02 04:49:43.361983 [ 34267 ] {} RaftInstance: new config log idx 45, prev log idx 44, cur config log idx 44, prev log idx 43 2025.04.02 04:49:43.362007 [ 34267 ] {} RaftInstance: new configuration: log idx 45, prev log idx 44 peer 1, DC ID 0, localhost:9234, voting member, 1 my id: 1, leader: 1, term: 45 2025.04.02 04:49:43.362085 [ 33667 ] {} KeeperDispatcher: Quorum initialized 2025.04.02 04:49:43.362290 [ 33667 ] {} KeeperDispatcher: Dispatcher initialized 2025.04.02 04:49:43.363890 [ 33667 ] {} Application: Listening for Keeper (tcp): [::]:9181 2025.04.02 04:49:43.363994 [ 33667 ] {} Application: Listening for replica communication (interserver): http://[::]:9009 2025.04.02 04:49:43.367929 [ 33667 ] {} ConfigReloader: Loading config '/etc/clickhouse-server/users.xml' 2025.04.02 04:49:43.367963 [ 33667 ] {} ConfigProcessor: Processing configuration file '/etc/clickhouse-server/users.xml'. 2025.04.02 04:49:43.368484 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/access_management.xml'. 2025.04.02 04:49:43.368687 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/allow_introspection_functions.yaml'. 2025.04.02 04:49:43.368901 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_atomic_drop_detach_sync.xml'. 2025.04.02 04:49:43.369017 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/database_ordinary.xml'. 2025.04.02 04:49:43.369135 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/enable_blobs_check.xml'. 2025.04.02 04:49:43.369286 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/filelog.xml'. 2025.04.02 04:49:43.369399 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/insert_keeper_retries.xml'. 2025.04.02 04:49:43.369529 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/limits.yaml'. 2025.04.02 04:49:43.370691 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/log_queries.xml'. 2025.04.02 04:49:43.370889 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/marks.xml'. 2025.04.02 04:49:43.371091 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/memory_profiler.xml'. 2025.04.02 04:49:43.371271 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/no_fsync_metadata.xml'. 2025.04.02 04:49:43.371445 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/nonconst_timezone.xml'. 2025.04.02 04:49:43.371612 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/opentelemetry.xml'. 2025.04.02 04:49:43.371779 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/prefetch_settings.xml'. 2025.04.02 04:49:43.371973 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/readonly.xml'. 2025.04.02 04:49:43.372164 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/remote_queries.xml'. 2025.04.02 04:49:43.372381 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/replicated_ddl_entry.xml'. 2025.04.02 04:49:43.372563 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache.xml'. 2025.04.02 04:49:43.372753 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/s3_cache_new.xml'. 2025.04.02 04:49:43.372935 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/session_log_test.xml'. 2025.04.02 04:49:43.373150 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/stress_test_tweaks-users.xml'. 2025.04.02 04:49:43.373543 [ 33667 ] {} ConfigProcessor: Merging configuration file '/etc/clickhouse-server/users.d/timeouts.xml'. 2025.04.02 04:49:43.378282 [ 33667 ] {} ConfigProcessor: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. 2025.04.02 04:49:43.378363 [ 33667 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performing update on configuration 2025.04.02 04:49:43.381741 [ 33667 ] {} ConfigReloader: Loaded config '/etc/clickhouse-server/users.xml', performed update on configuration 2025.04.02 04:49:43.381790 [ 33667 ] {} ConfigReloader: Config reload interval set to 2000ms 2025.04.02 04:49:43.382341 [ 33667 ] {} Access(user directories): Added users_xml access storage 'users_xml', path: /etc/clickhouse-server/users.xml 2025.04.02 04:49:43.382631 [ 33667 ] {} Access(user directories): Added local_directory access storage 'local_directory', path: /var/lib/clickhouse/access/ 2025.04.02 04:49:43.382866 [ 33667 ] {} CgroupsMemoryUsageObserver: Started cgroup current memory usage observer thread 2025.04.02 04:49:43.383129 [ 34273 ] {} CgroupsMemoryUsageObserver: Memory amount initially available to the process is 30.60 GiB 2025.04.02 04:49:43.385310 [ 33667 ] {} Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin 2025.04.02 04:49:43.385804 [ 33667 ] {} Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2025.04.02 04:49:43.386780 [ 33667 ] {} Context: Initialized background executor for fetches with num_threads=16, num_tasks=16 2025.04.02 04:49:43.387255 [ 33667 ] {} Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2025.04.02 04:49:43.388400 [ 33667 ] {} Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production. 2025.04.02 04:49:43.388985 [ 33667 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.02 04:49:43.389633 [ 33667 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.02 04:49:43.390205 [ 33667 ] {} DNSCacheUpdater: Update period 15 seconds 2025.04.02 04:49:43.390239 [ 33667 ] {} Application: Loading metadata from /var/lib/clickhouse/ 2025.04.02 04:49:43.390345 [ 33675 ] {} DNSResolver: Updating DNS cache 2025.04.02 04:49:43.390735 [ 33675 ] {} DNSResolver: Updated DNS cache 2025.04.02 04:49:47.927515 [ 33667 ] {} Application: Caught exception while loading metadata: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:47.927664 [ 33667 ] {} Application: Stopping AsyncLoader. 2025.04.02 04:49:47.927949 [ 33667 ] {} CgroupsMemoryUsageObserver: Stopped cgroup current memory usage observer thread 2025.04.02 04:49:47.927970 [ 33667 ] {} CancellationChecker: Stopping CancellationChecker 2025.04.02 04:49:47.928050 [ 33677 ] {} CancellationChecker: Execution took 4784 ms. 2025.04.02 04:49:47.928272 [ 33667 ] {} Application: Shutting down storages. 2025.04.02 04:49:47.928287 [ 33667 ] {} AsynchronousInsertQueue: Shutting down the asynchronous insertion queue 2025.04.02 04:49:47.929374 [ 33667 ] {} AsynchronousInsertQueue: Asynchronous insertion queue finished 2025.04.02 04:49:47.929389 [ 33667 ] {} Context: Shutting down workload entity storage 2025.04.02 04:49:47.929397 [ 33667 ] {} Context: Shutting down named sessions 2025.04.02 04:49:47.929421 [ 33667 ] {} Context: Shutting down database catalog 2025.04.02 04:49:47.929429 [ 33667 ] {} DatabaseCatalog: Shutting down system databases 2025.04.02 04:49:47.929469 [ 33667 ] {} Context: Shutting down merges executor 2025.04.02 04:49:47.929761 [ 33667 ] {} Context: Shutting down fetches executor 2025.04.02 04:49:47.929988 [ 33667 ] {} Context: Shutting down moves executor 2025.04.02 04:49:47.930158 [ 33667 ] {} Context: Shutting down common executor 2025.04.02 04:49:47.930357 [ 33667 ] {} Context: Shutting down DDLWorker 2025.04.02 04:49:47.930376 [ 33667 ] {} Context: Shutting down caches 2025.04.02 04:49:47.930390 [ 33667 ] {} Context: Shutting down AccessControl 2025.04.02 04:49:47.930798 [ 33667 ] {} BackgroundSchedulePool/BgBufSchPool: Waiting for threads to finish. 2025.04.02 04:49:47.934337 [ 33667 ] {} BackgroundSchedulePool/BgSchPool: Waiting for threads to finish. 2025.04.02 04:49:47.934655 [ 33667 ] {} BackgroundSchedulePool/BgDistSchPool: Waiting for threads to finish. 2025.04.02 04:49:47.934814 [ 33667 ] {} BackgroundSchedulePool/BgMBSchPool: Waiting for threads to finish. 2025.04.02 04:49:47.935084 [ 33667 ] {} Application: Shut down storages. 2025.04.02 04:49:47.935106 [ 33667 ] {} Application: Waiting for current connections to servers for tables to finish. 2025.04.02 04:49:48.120194 [ 33667 ] {} Application: Closed all listening sockets. 2025.04.02 04:49:48.120225 [ 33667 ] {} Application: Closed connections to servers for tables. 2025.04.02 04:49:48.120238 [ 33667 ] {} KeeperDispatcher: Shutting down storage dispatcher 2025.04.02 04:49:48.364175 [ 33667 ] {} RaftInstance: shutting down raft core 2025.04.02 04:49:48.364226 [ 33667 ] {} RaftInstance: sent stop signal to the commit thread. 2025.04.02 04:49:48.364238 [ 33667 ] {} RaftInstance: cancelled all schedulers. 2025.04.02 04:49:48.364278 [ 33667 ] {} RaftInstance: commit thread stopped. 2025.04.02 04:49:48.364289 [ 33667 ] {} RaftInstance: all pending commit elements dropped. 2025.04.02 04:49:48.364311 [ 33667 ] {} RaftInstance: reset all pointers. 2025.04.02 04:49:48.364323 [ 33667 ] {} RaftInstance: joined terminated commit thread. 2025.04.02 04:49:48.364374 [ 33667 ] {} RaftInstance: sent stop signal to background append thread. 2025.04.02 04:49:48.364381 [ 34268 ] {} RaftInstance: bg append_entries thread terminated 2025.04.02 04:49:48.364444 [ 33667 ] {} RaftInstance: clean up auto-forwarding queue: 0 elems 2025.04.02 04:49:48.364455 [ 33667 ] {} RaftInstance: clean up auto-forwarding clients 2025.04.02 04:49:48.364465 [ 33667 ] {} RaftInstance: raft_server shutdown completed. 2025.04.02 04:49:48.364475 [ 33667 ] {} RaftInstance: manually create a snapshot on 45 2025.04.02 04:49:48.364487 [ 33667 ] {} RaftInstance: creating a snapshot for index 45 2025.04.02 04:49:48.364499 [ 33667 ] {} RaftInstance: create snapshot idx 45 log_term 45 2025.04.02 04:49:48.364520 [ 33667 ] {} KeeperStateMachine: Creating snapshot 45 2025.04.02 04:49:48.364570 [ 33667 ] {} KeeperStateMachine: Creating a snapshot during shutdown because 'create_snapshot_on_exit' is enabled. 2025.04.02 04:49:48.367418 [ 33667 ] {} KeeperStateMachine: Created persistent snapshot 45 with path snapshot_45.bin.zstd 2025.04.02 04:49:48.367471 [ 33667 ] {} KeeperStateMachine: Clearing garbage after snapshot 2025.04.02 04:49:48.367482 [ 33667 ] {} KeeperStateMachine: Cleared garbage after snapshot 2025.04.02 04:49:48.367529 [ 33667 ] {} RaftInstance: snapshot idx 45 log_term 45 created, compact the log store if needed 2025.04.02 04:49:48.367550 [ 33667 ] {} RaftInstance: create snapshot idx 45 log_term 45 done: 3035 us elapsed 2025.04.02 04:49:48.367872 [ 34251 ] {} RaftInstance: end of asio worker thread, remaining threads: 15 2025.04.02 04:49:48.367902 [ 34254 ] {} RaftInstance: end of asio worker thread, remaining threads: 14 2025.04.02 04:49:48.367941 [ 34255 ] {} RaftInstance: end of asio worker thread, remaining threads: 13 2025.04.02 04:49:48.367981 [ 34265 ] {} RaftInstance: end of asio worker thread, remaining threads: 8 2025.04.02 04:49:48.368043 [ 34263 ] {} RaftInstance: end of asio worker thread, remaining threads: 1 2025.04.02 04:49:48.367934 [ 34253 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:48.367919 [ 34256 ] {} RaftInstance: end of asio worker thread, remaining threads: 10 2025.04.02 04:49:48.367982 [ 34264 ] {} RaftInstance: end of asio worker thread, remaining threads: 5 2025.04.02 04:49:48.367979 [ 34257 ] {} RaftInstance: end of asio worker thread, remaining threads: 6 2025.04.02 04:49:48.367990 [ 34258 ] {} RaftInstance: end of asio worker thread, remaining threads: 7 2025.04.02 04:49:48.368019 [ 34259 ] {} RaftInstance: end of asio worker thread, remaining threads: 4 2025.04.02 04:49:48.368032 [ 34262 ] {} RaftInstance: end of asio worker thread, remaining threads: 3 2025.04.02 04:49:48.367917 [ 34252 ] {} RaftInstance: end of asio worker thread, remaining threads: 11 2025.04.02 04:49:48.368044 [ 34261 ] {} RaftInstance: end of asio worker thread, remaining threads: 2 2025.04.02 04:49:48.368095 [ 34266 ] {} RaftInstance: end of asio worker thread, remaining threads: 0 2025.04.02 04:49:48.367960 [ 34260 ] {} RaftInstance: end of asio worker thread, remaining threads: 9 2025.04.02 04:49:48.368885 [ 33667 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:48.368957 [ 34249 ] {} KeeperLogStore: Flushing 0 logs 2025.04.02 04:49:48.369255 [ 33667 ] {} KeeperSnapshotManagerS3: Shutting down KeeperSnapshotManagerS3 2025.04.02 04:49:48.369371 [ 33667 ] {} KeeperSnapshotManagerS3: KeeperSnapshotManagerS3 shut down 2025.04.02 04:49:48.369384 [ 33667 ] {} KeeperDispatcher: Dispatcher shut down 2025.04.02 04:49:48.369400 [ 33667 ] {} Context: Destructing remote fs threadpool reader 2025.04.02 04:49:48.369414 [ 33667 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:48.369743 [ 33667 ] {} Context: Destructing local fs threadpool reader 2025.04.02 04:49:48.369792 [ 33667 ] {} Context: Destructing threadpool writer 2025.04.02 04:49:48.371500 [ 33667 ] {} Application: Destroyed global context. 2025.04.02 04:49:48.371782 [ 33667 ] {} Application: Waiting for background threads 2025.04.02 04:49:48.388383 [ 33667 ] {} Application: Background threads finished in 16 ms 2025.04.02 04:49:48.388955 [ 33667 ] {} KeeperLogStore: Changelog is shut down 2025.04.02 04:49:48.388973 [ 33667 ] {} KeeperLogStore: Shutting down Changelog 2025.04.02 04:49:48.393404 [ 33667 ] {} Application: std::exception. Code: 1001, type: Azure::Core::Http::TransportException, e.what() = Fail to get a new connection for: ://. URL using bad/illegal format or missing URL, Stack trace (when copying this message, always include the lines below): 0. std::exception::exception[abi:ne190107]() @ 0x0000000017e26194 1. ./contrib/llvm-project/libcxx/src/support/runtime/stdexcept_default.ipp:32: std::runtime_error::runtime_error(String const&) @ 0x000000003706897e 2. ./build_docker/./contrib/azure/sdk/core/azure-core/src/exception.cpp:20: Azure::Core::RequestFailedException::RequestFailedException(String const&) @ 0x00000000352121ce 3. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/http.hpp:66: Azure::Core::Http::CurlConnection::CurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, String const&, String const&) @ 0x000000003520db35 4. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:634: Azure::Core::Http::_detail::CurlConnectionPool::ExtractOrCreateCurlConnection(Azure::Core::Http::Request&, Azure::Core::Http::CurlTransportOptions const&, bool) @ 0x0000000035204c75 5. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/curl/curl.cpp:351: Azure::Core::Http::CurlTransport::Send(Azure::Core::Http::Request&, Azure::Core::Context const&) @ 0x00000000352038ec 6. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/transport_policy.cpp:121: Azure::Core::Http::Policies::_internal::TransportPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352424d0 7. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/log_policy.cpp:114: Azure::Core::Http::Policies::_internal::LogPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x0000000035220001 8. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/request_activity_policy.cpp:110: Azure::Core::Http::Policies::_internal::RequestActivityPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352402e2 9. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_per_retry_policy.cpp:57: Azure::Storage::_internal::StoragePerRetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529af5f 10. ./build_docker/./contrib/azure/sdk/storage/azure-storage-common/src/storage_switch_to_secondary_policy.cpp:36: Azure::Storage::_internal::StorageSwitchToSecondaryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003529b3f5 11. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/retry_policy.cpp:146: Azure::Core::Http::Policies::_internal::RetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523ecd8 12. ./build_docker/./contrib/azure/sdk/core/azure-core/src/http/telemetry_policy.cpp:23: Azure::Core::Http::Policies::_internal::TelemetryPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x00000000352428a3 13. ./contrib/azure/sdk/core/azure-core/inc/azure/core/http/policies/policy.hpp:453: Azure::Core::Http::Policies::_internal::RequestIdPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003523555a 14. ./contrib/azure/sdk/storage/azure-storage-common/inc/azure/storage/common/internal/storage_service_version_policy.hpp:34: Azure::Storage::_internal::StorageServiceVersionPolicy::Send(Azure::Core::Http::Request&, Azure::Core::Http::Policies::NextHttpPolicy, Azure::Core::Context const&) const @ 0x000000003524f36a 15. ./contrib/azure/sdk/core/azure-core/inc/azure/core/internal/http/pipeline.hpp:230: Azure::Storage::Blobs::_detail::BlobContainerClient::GetProperties(Azure::Core::Http::_internal::HttpPipeline&, Azure::Core::Url const&, Azure::Storage::Blobs::_detail::BlobContainerClient::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) @ 0x000000003526c06e 16. ./build_docker/./contrib/azure/sdk/storage/azure-storage-blobs/src/blob_container_client.cpp:324: Azure::Storage::Blobs::BlobContainerClient::GetProperties(Azure::Storage::Blobs::GetBlobContainerPropertiesOptions const&, Azure::Core::Context const&) const @ 0x0000000035256f90 17. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:105: DB::AzureBlobStorage::ContainerClientWrapper::GetProperties() const @ 0x000000002b4cdc35 18. ./build_docker/./src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp:319: DB::AzureBlobStorage::getContainerClient(DB::AzureBlobStorage::ConnectionParams const&, bool) @ 0x000000002b4d1109 19. ./build_docker/./src/Disks/ObjectStorages/ObjectStorageFactory.cpp:308: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr const&, bool) @ 0x000000002c5bdca8 20. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c5baa14 21. ./build_docker/./src/Disks/ObjectStorages/RegisterDiskObjectStorage.cpp:27: std::shared_ptr std::__function::__policy_invoker (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>::__call_impl[abi:ne190107] (String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool)>>(std::__function::__policy_storage const*, String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr&&, std::map, std::less, std::allocator>>> const&, bool, bool) @ 0x000000002c5b99b3 22. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002c4d534b 23. ./build_docker/./src/Disks/DiskFactory.cpp:48: DB::DiskFactory::create(String const&, Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::map, std::less, std::allocator>>> const&, bool, bool, std::unordered_set, std::equal_to, std::allocator> const&) const @ 0x000000002c4d503c 24. ./build_docker/./src/Disks/DiskSelector.cpp:55: DB::DiskSelector::initialize(Poco::Util::AbstractConfiguration const&, String const&, std::shared_ptr, std::function) @ 0x000000002c51438c 25. ./build_docker/./src/Interpreters/Context.cpp:4976: DB::Context::getDiskSelector(std::lock_guard&) const @ 0x000000002d05c0db 26. ./build_docker/./src/Interpreters/Context.cpp:4960: DB::Context::getDisksMap(std::lock_guard&) const @ 0x000000002d05c6b6 27. ./build_docker/./src/Interpreters/Context.cpp:4955: DB::Context::getDisksMap() const @ 0x000000002d05d2a2 28. ./build_docker/./src/Interpreters/Context.cpp:1179: DB::Context::getDatabaseDisk() const @ 0x000000002d028f6d 29. ./build_docker/./src/Databases/DatabasesCommon.cpp:330: DB::DatabaseWithOwnTablesBase::DatabaseWithOwnTablesBase(String const&, String const&, std::shared_ptr) @ 0x000000002c386adc 30. ./build_docker/./src/Databases/DatabaseMemory.cpp:25: DB::DatabaseMemory::DatabaseMemory(String const&, std::shared_ptr) @ 0x000000002c2d50a3 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: DB::DatabaseMemory* std::construct_at[abi:ne190107], DB::DatabaseMemory*>(DB::DatabaseMemory*, char const* const&, std::shared_ptr&&) @ 0x000000002d1b4141 (version 25.2.2.173926.altinityantalya.173926 (official build)) 2025.04.02 04:49:48.393523 [ 33667 ] {} Application: shutting down 2025.04.02 04:49:48.393534 [ 33667 ] {} Application: Uninitializing subsystem: Logging Subsystem 2025.04.02 04:49:48.394430 [ 33668 ] {} BaseDaemon: Received signal -2 2025.04.02 04:49:48.394457 [ 33668 ] {} BaseDaemon: Stop SignalListener thread 2025.04.02 04:49:48.475884 [ 33666 ] {} Application: Child process exited normally with code 233.