2025-06-26 02:44:38,384 INFO mapreduce.MiniHadoopClusterManager: Updated 0 configuration settings from command line. 2025-06-26 02:44:38,473 INFO hdfs.MiniDFSCluster: starting cluster: numNameNodes=1, numDataNodes=1 2025-06-26 02:44:38,914 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-06-26 02:44:39,013 INFO namenode.NameNode: Formatting using clusterid: testClusterID 2025-06-26 02:44:39,034 INFO namenode.FSEditLog: Edit logging is async:true 2025-06-26 02:44:39,061 INFO namenode.FSNamesystem: KeyProvider: null 2025-06-26 02:44:39,063 INFO namenode.FSNamesystem: fsLock is fair: true 2025-06-26 02:44:39,063 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2025-06-26 02:44:39,109 INFO namenode.FSNamesystem: fsOwner = clickhouse (auth:SIMPLE) 2025-06-26 02:44:39,109 INFO namenode.FSNamesystem: supergroup = supergroup 2025-06-26 02:44:39,109 INFO namenode.FSNamesystem: isPermissionEnabled = true 2025-06-26 02:44:39,109 INFO namenode.FSNamesystem: isStoragePolicyEnabled = true 2025-06-26 02:44:39,110 INFO namenode.FSNamesystem: HA Enabled: false 2025-06-26 02:44:39,158 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-06-26 02:44:39,162 INFO Configuration.deprecation: hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping 2025-06-26 02:44:39,162 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2025-06-26 02:44:39,162 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2025-06-26 02:44:39,167 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2025-06-26 02:44:39,167 INFO blockmanagement.BlockManager: The block deletion will start around 2025 Jun 26 02:44:39 2025-06-26 02:44:39,169 INFO util.GSet: Computing capacity for map BlocksMap 2025-06-26 02:44:39,169 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:39,170 INFO util.GSet: 2.0% max memory 7.6 GB = 156.4 MB 2025-06-26 02:44:39,171 INFO util.GSet: capacity = 2^24 = 16777216 entries 2025-06-26 02:44:39,201 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2025-06-26 02:44:39,201 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2025-06-26 02:44:39,207 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.999 2025-06-26 02:44:39,207 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2025-06-26 02:44:39,207 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 0 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: defaultReplication = 1 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: maxReplication = 512 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: minReplication = 1 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2025-06-26 02:44:39,208 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2025-06-26 02:44:39,230 INFO namenode.FSDirectory: GLOBAL serial map: bits=29 maxEntries=536870911 2025-06-26 02:44:39,231 INFO namenode.FSDirectory: USER serial map: bits=24 maxEntries=16777215 2025-06-26 02:44:39,231 INFO namenode.FSDirectory: GROUP serial map: bits=24 maxEntries=16777215 2025-06-26 02:44:39,231 INFO namenode.FSDirectory: XATTR serial map: bits=24 maxEntries=16777215 2025-06-26 02:44:39,242 INFO util.GSet: Computing capacity for map INodeMap 2025-06-26 02:44:39,242 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:39,243 INFO util.GSet: 1.0% max memory 7.6 GB = 78.2 MB 2025-06-26 02:44:39,243 INFO util.GSet: capacity = 2^23 = 8388608 entries 2025-06-26 02:44:39,256 INFO namenode.FSDirectory: ACLs enabled? true 2025-06-26 02:44:39,257 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2025-06-26 02:44:39,257 INFO namenode.FSDirectory: XAttrs enabled? true 2025-06-26 02:44:39,257 INFO namenode.NameNode: Caching file names occurring more than 10 times 2025-06-26 02:44:39,262 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2025-06-26 02:44:39,264 INFO snapshot.SnapshotManager: SkipList is disabled 2025-06-26 02:44:39,268 INFO util.GSet: Computing capacity for map cachedBlocks 2025-06-26 02:44:39,268 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:39,268 INFO util.GSet: 0.25% max memory 7.6 GB = 19.6 MB 2025-06-26 02:44:39,268 INFO util.GSet: capacity = 2^21 = 2097152 entries 2025-06-26 02:44:39,279 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2025-06-26 02:44:39,280 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2025-06-26 02:44:39,280 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2025-06-26 02:44:39,283 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2025-06-26 02:44:39,283 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2025-06-26 02:44:39,285 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2025-06-26 02:44:39,285 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:39,285 INFO util.GSet: 0.029999999329447746% max memory 7.6 GB = 2.3 MB 2025-06-26 02:44:39,285 INFO util.GSet: capacity = 2^18 = 262144 entries 2025-06-26 02:44:39,312 INFO namenode.FSImage: Allocated new BlockPoolId: BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:39,335 INFO common.Storage: Storage directory /hadoop-3.3.1/target/test/data/dfs/name-0-1 has been successfully formatted. 2025-06-26 02:44:39,339 INFO common.Storage: Storage directory /hadoop-3.3.1/target/test/data/dfs/name-0-2 has been successfully formatted. 2025-06-26 02:44:39,386 INFO namenode.FSImageFormatProtobuf: Saving image file /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage.ckpt_0000000000000000000 using no compression 2025-06-26 02:44:39,386 INFO namenode.FSImageFormatProtobuf: Saving image file /hadoop-3.3.1/target/test/data/dfs/name-0-2/current/fsimage.ckpt_0000000000000000000 using no compression 2025-06-26 02:44:39,538 INFO namenode.FSImageFormatProtobuf: Image file /hadoop-3.3.1/target/test/data/dfs/name-0-2/current/fsimage.ckpt_0000000000000000000 of size 405 bytes saved in 0 seconds . 2025-06-26 02:44:39,538 INFO namenode.FSImageFormatProtobuf: Image file /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage.ckpt_0000000000000000000 of size 405 bytes saved in 0 seconds . 2025-06-26 02:44:39,558 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 2025-06-26 02:44:39,598 INFO namenode.FSNamesystem: Stopping services started for active state 2025-06-26 02:44:39,598 INFO namenode.FSNamesystem: Stopping services started for standby state 2025-06-26 02:44:39,600 INFO namenode.NameNode: createNameNode [] 2025-06-26 02:44:39,666 INFO impl.MetricsConfig: Loaded properties from hadoop-metrics2.properties 2025-06-26 02:44:39,767 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2025-06-26 02:44:39,767 INFO impl.MetricsSystemImpl: NameNode metrics system started 2025-06-26 02:44:39,790 INFO namenode.NameNodeUtils: fs.defaultFS is hdfs://127.0.0.1:12222 2025-06-26 02:44:39,790 INFO namenode.NameNode: Clients should use 127.0.0.1:12222 to access this namenode/service. 2025-06-26 02:44:39,841 INFO util.JvmPauseMonitor: Starting JVM pause monitor 2025-06-26 02:44:39,851 INFO hdfs.DFSUtil: Filter initializers set : org.apache.hadoop.http.lib.StaticUserWebFilter,org.apache.hadoop.hdfs.web.AuthFilterInitializer 2025-06-26 02:44:39,855 INFO hdfs.DFSUtil: Starting Web-server for hdfs at: http://localhost:0 2025-06-26 02:44:39,868 INFO util.log: Logging initialized @2117ms to org.eclipse.jetty.util.log.Slf4jLog 2025-06-26 02:44:39,954 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-06-26 02:44:39,958 INFO http.HttpRequestLog: Http request log for http.requests.namenode is not defined 2025-06-26 02:44:39,964 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2025-06-26 02:44:39,966 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs 2025-06-26 02:44:39,966 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2025-06-26 02:44:39,966 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2025-06-26 02:44:39,968 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context hdfs 2025-06-26 02:44:39,969 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context static 2025-06-26 02:44:39,969 INFO http.HttpServer2: Added filter AuthFilter (class=org.apache.hadoop.hdfs.web.AuthFilter) to context logs 2025-06-26 02:44:39,997 INFO http.HttpServer2: addJerseyResourcePackage: packageName=org.apache.hadoop.hdfs.server.namenode.web.resources;org.apache.hadoop.hdfs.web.resources, pathSpec=/webhdfs/v1/* 2025-06-26 02:44:40,006 INFO http.HttpServer2: Jetty bound to port 45223 2025-06-26 02:44:40,007 INFO server.Server: jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 11.0.25+9-post-Ubuntu-1ubuntu122.04 2025-06-26 02:44:40,037 INFO server.session: DefaultSessionIdManager workerName=node0 2025-06-26 02:44:40,038 INFO server.session: No SessionScavenger set, using defaults 2025-06-26 02:44:40,039 INFO server.session: node0 Scavenging every 660000ms 2025-06-26 02:44:40,055 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-06-26 02:44:40,057 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@6b587673{logs,/logs,file:///hadoop-3.3.1/logs,AVAILABLE} 2025-06-26 02:44:40,058 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@383790cf{static,/static,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/static/,AVAILABLE} 2025-06-26 02:44:40,141 INFO handler.ContextHandler: Started o.e.j.w.WebAppContext@b965857{hdfs,/,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/hdfs/,AVAILABLE}{file:/hadoop-3.3.1/share/hadoop/hdfs/webapps/hdfs} 2025-06-26 02:44:40,154 INFO server.AbstractConnector: Started ServerConnector@7435a578{HTTP/1.1, (http/1.1)}{localhost:45223} 2025-06-26 02:44:40,154 INFO server.Server: Started @2403ms 2025-06-26 02:44:40,161 INFO namenode.FSEditLog: Edit logging is async:true 2025-06-26 02:44:40,173 INFO namenode.FSNamesystem: KeyProvider: null 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: fsLock is fair: true 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: fsOwner = clickhouse (auth:SIMPLE) 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: supergroup = supergroup 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: isPermissionEnabled = true 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: isStoragePolicyEnabled = true 2025-06-26 02:44:40,174 INFO namenode.FSNamesystem: HA Enabled: false 2025-06-26 02:44:40,175 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-06-26 02:44:40,175 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2025-06-26 02:44:40,175 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2025-06-26 02:44:40,175 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2025-06-26 02:44:40,175 INFO blockmanagement.BlockManager: The block deletion will start around 2025 Jun 26 02:44:40 2025-06-26 02:44:40,176 INFO util.GSet: Computing capacity for map BlocksMap 2025-06-26 02:44:40,176 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:40,176 INFO util.GSet: 2.0% max memory 7.6 GB = 156.4 MB 2025-06-26 02:44:40,176 INFO util.GSet: capacity = 2^24 = 16777216 entries 2025-06-26 02:44:40,199 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2025-06-26 02:44:40,199 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.999 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 0 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: defaultReplication = 1 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: maxReplication = 512 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: minReplication = 1 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2025-06-26 02:44:40,200 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2025-06-26 02:44:40,200 INFO util.GSet: Computing capacity for map INodeMap 2025-06-26 02:44:40,200 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:40,200 INFO util.GSet: 1.0% max memory 7.6 GB = 78.2 MB 2025-06-26 02:44:40,200 INFO util.GSet: capacity = 2^23 = 8388608 entries 2025-06-26 02:44:40,228 INFO namenode.FSDirectory: ACLs enabled? true 2025-06-26 02:44:40,229 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2025-06-26 02:44:40,229 INFO namenode.FSDirectory: XAttrs enabled? true 2025-06-26 02:44:40,230 INFO namenode.NameNode: Caching file names occurring more than 10 times 2025-06-26 02:44:40,230 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2025-06-26 02:44:40,231 INFO snapshot.SnapshotManager: SkipList is disabled 2025-06-26 02:44:40,231 INFO util.GSet: Computing capacity for map cachedBlocks 2025-06-26 02:44:40,231 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:40,232 INFO util.GSet: 0.25% max memory 7.6 GB = 19.6 MB 2025-06-26 02:44:40,232 INFO util.GSet: capacity = 2^21 = 2097152 entries 2025-06-26 02:44:40,238 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2025-06-26 02:44:40,238 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2025-06-26 02:44:40,238 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2025-06-26 02:44:40,238 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2025-06-26 02:44:40,238 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2025-06-26 02:44:40,238 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2025-06-26 02:44:40,238 INFO util.GSet: VM type = 64-bit 2025-06-26 02:44:40,238 INFO util.GSet: 0.029999999329447746% max memory 7.6 GB = 2.3 MB 2025-06-26 02:44:40,238 INFO util.GSet: capacity = 2^18 = 262144 entries 2025-06-26 02:44:40,250 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/name-0-1/in_use.lock acquired by nodename 419@ceb3cd7048a8 2025-06-26 02:44:40,253 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/name-0-2/in_use.lock acquired by nodename 419@ceb3cd7048a8 2025-06-26 02:44:40,257 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop-3.3.1/target/test/data/dfs/name-0-1/current 2025-06-26 02:44:40,257 INFO namenode.FileJournalManager: Recovering unfinalized segments in /hadoop-3.3.1/target/test/data/dfs/name-0-2/current 2025-06-26 02:44:40,257 INFO namenode.FSImage: No edit log streams selected. 2025-06-26 02:44:40,258 INFO namenode.FSImage: Planning to load image: FSImageFile(file=/hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage_0000000000000000000, cpktTxId=0000000000000000000) 2025-06-26 02:44:40,289 INFO namenode.FSImageFormatPBINode: Loading 1 INodes. 2025-06-26 02:44:40,290 INFO namenode.FSImageFormatPBINode: Successfully loaded 1 inodes 2025-06-26 02:44:40,294 INFO namenode.FSImageFormatPBINode: Completed update blocks map and name cache, total waiting duration 0ms. 2025-06-26 02:44:40,296 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds. 2025-06-26 02:44:40,296 INFO namenode.FSImage: Loaded image for txid 0 from /hadoop-3.3.1/target/test/data/dfs/name-0-1/current/fsimage_0000000000000000000 2025-06-26 02:44:40,300 INFO namenode.FSNamesystem: Need to save fs image? false (staleImage=false, haEnabled=false, isRollingUpgrade=false) 2025-06-26 02:44:40,301 INFO namenode.FSEditLog: Starting log segment at 1 2025-06-26 02:44:40,321 INFO namenode.NameCache: initialized with 0 entries 0 lookups 2025-06-26 02:44:40,321 INFO namenode.FSNamesystem: Finished loading FSImage in 80 msecs 2025-06-26 02:44:40,478 INFO namenode.NameNode: RPC server is binding to localhost:12222 2025-06-26 02:44:40,478 INFO namenode.NameNode: Enable NameNode state context:false 2025-06-26 02:44:40,487 INFO ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2025-06-26 02:44:40,498 INFO ipc.Server: Starting Socket Reader #1 for port 12222 2025-06-26 02:44:40,696 INFO namenode.FSNamesystem: Registered FSNamesystemState, ReplicatedBlocksState and ECBlockGroupsState MBeans. 2025-06-26 02:44:40,710 INFO namenode.LeaseManager: Number of blocks under construction: 0 2025-06-26 02:44:40,720 INFO blockmanagement.DatanodeAdminDefaultMonitor: Initialized the Default Decommission and Maintenance monitor 2025-06-26 02:44:40,724 INFO blockmanagement.BlockManager: initializing replication queues 2025-06-26 02:44:40,724 INFO hdfs.StateChange: STATE* Leaving safe mode after 0 secs 2025-06-26 02:44:40,724 INFO hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes 2025-06-26 02:44:40,724 INFO hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks 2025-06-26 02:44:40,736 INFO blockmanagement.BlockManager: Total number of blocks = 0 2025-06-26 02:44:40,737 INFO blockmanagement.BlockManager: Number of invalid blocks = 0 2025-06-26 02:44:40,737 INFO blockmanagement.BlockManager: Number of under-replicated blocks = 0 2025-06-26 02:44:40,737 INFO blockmanagement.BlockManager: Number of over-replicated blocks = 0 2025-06-26 02:44:40,737 INFO blockmanagement.BlockManager: Number of blocks being written = 0 2025-06-26 02:44:40,737 INFO hdfs.StateChange: STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 13 msec 2025-06-26 02:44:40,764 INFO ipc.Server: IPC Server Responder: starting 2025-06-26 02:44:40,765 INFO ipc.Server: IPC Server listener on 12222: starting 2025-06-26 02:44:40,768 INFO namenode.NameNode: NameNode RPC up at: localhost/127.0.0.1:12222 2025-06-26 02:44:40,770 INFO namenode.FSNamesystem: Starting services required for active state 2025-06-26 02:44:40,770 INFO namenode.FSDirectory: Initializing quota with 12 thread(s) 2025-06-26 02:44:40,776 INFO namenode.FSDirectory: Quota initialization completed in 5 milliseconds name space=1 storage space=0 storage types=RAM_DISK=0, SSD=0, DISK=0, ARCHIVE=0, PROVIDED=0 2025-06-26 02:44:40,782 INFO blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds 2025-06-26 02:44:40,790 INFO hdfs.MiniDFSCluster: Starting DataNode 0 with dfs.datanode.data.dir: [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1,[DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 2025-06-26 02:44:40,838 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 2025-06-26 02:44:40,849 INFO checker.ThrottledAsyncChecker: Scheduling a check for [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 2025-06-26 02:44:40,866 INFO impl.MetricsSystemImpl: DataNode metrics system started (again) 2025-06-26 02:44:40,872 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-06-26 02:44:40,876 INFO datanode.BlockScanner: Initialized block scanner with targetBytesPerSec 1048576 2025-06-26 02:44:40,881 INFO datanode.DataNode: Configured hostname is 127.0.0.1 2025-06-26 02:44:40,882 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2025-06-26 02:44:40,886 INFO datanode.DataNode: Starting DataNode with maxLockedMemory = 0 2025-06-26 02:44:40,891 INFO datanode.DataNode: Opened streaming server at /127.0.0.1:36823 2025-06-26 02:44:40,894 INFO datanode.DataNode: Balancing bandwidth is 104857600 bytes/s 2025-06-26 02:44:40,894 INFO datanode.DataNode: Number threads for balancing is 100 2025-06-26 02:44:40,905 INFO server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2025-06-26 02:44:40,905 INFO http.HttpRequestLog: Http request log for http.requests.datanode is not defined 2025-06-26 02:44:40,908 INFO http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2025-06-26 02:44:40,909 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode 2025-06-26 02:44:40,909 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2025-06-26 02:44:40,909 INFO http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2025-06-26 02:44:40,912 INFO http.HttpServer2: Jetty bound to port 36051 2025-06-26 02:44:40,912 INFO server.Server: jetty-9.4.40.v20210413; built: 2021-04-13T20:42:42.668Z; git: b881a572662e1943a14ae12e7e1207989f218b74; jvm 11.0.25+9-post-Ubuntu-1ubuntu122.04 2025-06-26 02:44:40,914 INFO server.session: DefaultSessionIdManager workerName=node0 2025-06-26 02:44:40,914 INFO server.session: No SessionScavenger set, using defaults 2025-06-26 02:44:40,914 INFO server.session: node0 Scavenging every 660000ms 2025-06-26 02:44:40,915 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@6d099323{logs,/logs,file:///hadoop-3.3.1/logs,AVAILABLE} 2025-06-26 02:44:40,917 INFO handler.ContextHandler: Started o.e.j.s.ServletContextHandler@10947c4e{static,/static,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/static/,AVAILABLE} 2025-06-26 02:44:40,927 INFO handler.ContextHandler: Started o.e.j.w.WebAppContext@3c66b7d8{datanode,/,file:///hadoop-3.3.1/share/hadoop/hdfs/webapps/datanode/,AVAILABLE}{file:/hadoop-3.3.1/share/hadoop/hdfs/webapps/datanode} 2025-06-26 02:44:40,928 INFO server.AbstractConnector: Started ServerConnector@5eea5627{HTTP/1.1, (http/1.1)}{localhost:36051} 2025-06-26 02:44:40,928 INFO server.Server: Started @3177ms 2025-06-26 02:44:41,037 WARN web.DatanodeHttpServer: Got null for restCsrfPreventionFilter - will not do any filtering. 2025-06-26 02:44:41,131 INFO web.DatanodeHttpServer: Listening HTTP traffic on /127.0.0.1:34677 2025-06-26 02:44:41,132 INFO util.JvmPauseMonitor: Starting JVM pause monitor 2025-06-26 02:44:41,134 INFO datanode.DataNode: dnUserName = clickhouse 2025-06-26 02:44:41,134 INFO datanode.DataNode: supergroup = supergroup 2025-06-26 02:44:41,149 INFO ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue, queueCapacity: 1000, scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler, ipcBackoff: false. 2025-06-26 02:44:41,150 INFO ipc.Server: Starting Socket Reader #1 for port 0 2025-06-26 02:44:41,156 INFO datanode.DataNode: Opened IPC server at /127.0.0.1:43097 2025-06-26 02:44:41,180 INFO datanode.DataNode: Refresh request received for nameservices: null 2025-06-26 02:44:41,182 INFO datanode.DataNode: Starting BPOfferServices for nameservices: 2025-06-26 02:44:41,191 INFO datanode.DataNode: Block pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:12222 starting to offer service 2025-06-26 02:44:41,196 INFO ipc.Server: IPC Server Responder: starting 2025-06-26 02:44:41,196 INFO ipc.Server: IPC Server listener on 0: starting 2025-06-26 02:44:41,388 INFO datanode.DataNode: Acknowledging ACTIVE Namenode during handshakeBlock pool (Datanode Uuid unassigned) service to localhost/127.0.0.1:12222 2025-06-26 02:44:41,391 INFO common.Storage: Using 2 threads to upgrade data directories (dfs.datanode.parallel.volumes.load.threads.num=2, dataDirs=2) 2025-06-26 02:44:41,395 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/data/data1/in_use.lock acquired by nodename 419@ceb3cd7048a8 2025-06-26 02:44:41,396 INFO common.Storage: Storage directory with location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 is not formatted for namespace 892219300. Formatting... 2025-06-26 02:44:41,397 INFO common.Storage: Generated new storageID DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674 for directory /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-06-26 02:44:41,403 INFO common.Storage: Lock on /hadoop-3.3.1/target/test/data/dfs/data/data2/in_use.lock acquired by nodename 419@ceb3cd7048a8 2025-06-26 02:44:41,403 INFO common.Storage: Storage directory with location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 is not formatted for namespace 892219300. Formatting... 2025-06-26 02:44:41,403 INFO common.Storage: Generated new storageID DS-c1feaca6-49aa-4f4b-a141-204d3849497f for directory /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-06-26 02:44:41,432 INFO common.Storage: Analyzing storage directories for bpid BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,432 INFO common.Storage: Locking is disabled for /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,433 INFO common.Storage: Block pool storage directory for location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1 and block pool id BP-653333143-172.17.0.2-1750877079302 is not formatted. Formatting ... 2025-06-26 02:44:41,433 INFO common.Storage: Formatting block pool BP-653333143-172.17.0.2-1750877079302 directory /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current 2025-06-26 02:44:41,459 INFO common.Storage: Analyzing storage directories for bpid BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,460 INFO common.Storage: Locking is disabled for /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,460 INFO common.Storage: Block pool storage directory for location [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2 and block pool id BP-653333143-172.17.0.2-1750877079302 is not formatted. Formatting ... 2025-06-26 02:44:41,460 INFO common.Storage: Formatting block pool BP-653333143-172.17.0.2-1750877079302 directory /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current 2025-06-26 02:44:41,464 INFO datanode.DataNode: Setting up storage: nsid=892219300;bpid=BP-653333143-172.17.0.2-1750877079302;lv=-57;nsInfo=lv=-66;cid=testClusterID;nsid=892219300;c=1750877079302;bpid=BP-653333143-172.17.0.2-1750877079302;dnuuid=null 2025-06-26 02:44:41,467 INFO datanode.DataNode: Generated and persisted new Datanode UUID 34872996-582a-4416-bd83-d7de6ac81ddb 2025-06-26 02:44:41,482 INFO impl.FsDatasetImpl: The datanode lock is a read write lock 2025-06-26 02:44:41,567 INFO impl.FsDatasetImpl: Added new volume: DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674 2025-06-26 02:44:41,567 INFO impl.FsDatasetImpl: Added volume - [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data1, StorageType: DISK 2025-06-26 02:44:41,570 INFO impl.FsDatasetImpl: Added new volume: DS-c1feaca6-49aa-4f4b-a141-204d3849497f 2025-06-26 02:44:41,570 INFO impl.FsDatasetImpl: Added volume - [DISK]file:/hadoop-3.3.1/target/test/data/dfs/data/data2, StorageType: DISK 2025-06-26 02:44:41,575 INFO impl.MemoryMappableBlockLoader: Initializing cache loader: MemoryMappableBlockLoader. 2025-06-26 02:44:41,580 INFO impl.FsDatasetImpl: Registered FSDatasetState MBean 2025-06-26 02:44:41,585 INFO impl.FsDatasetImpl: Adding block pool BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,587 INFO impl.FsDatasetImpl: Scanning block pool BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2... 2025-06-26 02:44:41,586 INFO impl.FsDatasetImpl: Scanning block pool BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1... 2025-06-26 02:44:41,625 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-653333143-172.17.0.2-1750877079302 on /hadoop-3.3.1/target/test/data/dfs/data/data1: 38ms 2025-06-26 02:44:41,625 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-653333143-172.17.0.2-1750877079302 on /hadoop-3.3.1/target/test/data/dfs/data/data2: 38ms 2025-06-26 02:44:41,626 INFO impl.FsDatasetImpl: Total time to scan all replicas for block pool BP-653333143-172.17.0.2-1750877079302: 41ms 2025-06-26 02:44:41,628 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1... 2025-06-26 02:44:41,629 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/replicas doesn't exist 2025-06-26 02:44:41,629 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2... 2025-06-26 02:44:41,629 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/replicas doesn't exist 2025-06-26 02:44:41,631 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1: 3ms 2025-06-26 02:44:41,631 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2: 2ms 2025-06-26 02:44:41,632 INFO impl.FsDatasetImpl: Total time to add all replicas to map for block pool BP-653333143-172.17.0.2-1750877079302: 4ms 2025-06-26 02:44:41,632 INFO checker.ThrottledAsyncChecker: Scheduling a check for /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-06-26 02:44:41,642 INFO checker.DatasetVolumeChecker: Scheduled health check for volume /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-06-26 02:44:41,645 INFO checker.ThrottledAsyncChecker: Scheduling a check for /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-06-26 02:44:41,645 INFO checker.DatasetVolumeChecker: Scheduled health check for volume /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-06-26 02:44:41,649 INFO datanode.VolumeScanner: Now scanning bpid BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data2 2025-06-26 02:44:41,650 INFO datanode.VolumeScanner: Now scanning bpid BP-653333143-172.17.0.2-1750877079302 on volume /hadoop-3.3.1/target/test/data/dfs/data/data1 2025-06-26 02:44:41,651 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data2, DS-c1feaca6-49aa-4f4b-a141-204d3849497f): finished scanning block pool BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,651 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data1, DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674): finished scanning block pool BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,654 WARN datanode.DirectoryScanner: dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value above 1000 ms/sec. Assuming default value of -1 2025-06-26 02:44:41,654 INFO datanode.DirectoryScanner: Periodic Directory Tree Verification scan starting in 21540565ms with interval of 21600000ms and throttle limit of -1ms/s 2025-06-26 02:44:41,660 INFO datanode.DataNode: Block pool BP-653333143-172.17.0.2-1750877079302 (Datanode Uuid 34872996-582a-4416-bd83-d7de6ac81ddb) service to localhost/127.0.0.1:12222 beginning handshake with NN 2025-06-26 02:44:41,667 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data2, DS-c1feaca6-49aa-4f4b-a141-204d3849497f): no suitable block pools found to scan. Waiting 1814399982 ms. 2025-06-26 02:44:41,667 INFO datanode.VolumeScanner: VolumeScanner(/hadoop-3.3.1/target/test/data/dfs/data/data1, DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674): no suitable block pools found to scan. Waiting 1814399982 ms. 2025-06-26 02:44:41,675 INFO hdfs.MiniDFSCluster: dnInfo.length != numDataNodes 2025-06-26 02:44:41,676 INFO hdfs.MiniDFSCluster: Waiting for cluster to become active 2025-06-26 02:44:41,680 INFO hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1:36823, datanodeUuid=34872996-582a-4416-bd83-d7de6ac81ddb, infoPort=34677, infoSecurePort=0, ipcPort=43097, storageInfo=lv=-57;cid=testClusterID;nsid=892219300;c=1750877079302) storage 34872996-582a-4416-bd83-d7de6ac81ddb 2025-06-26 02:44:41,683 INFO net.NetworkTopology: Adding a new node: /default-rack/127.0.0.1:36823 2025-06-26 02:44:41,683 INFO blockmanagement.BlockReportLeaseManager: Registered DN 34872996-582a-4416-bd83-d7de6ac81ddb (127.0.0.1:36823). 2025-06-26 02:44:41,688 INFO datanode.DataNode: Block pool BP-653333143-172.17.0.2-1750877079302 (Datanode Uuid 34872996-582a-4416-bd83-d7de6ac81ddb) service to localhost/127.0.0.1:12222 successfully registered with NN 2025-06-26 02:44:41,688 INFO datanode.DataNode: For namenode localhost/127.0.0.1:12222 using BLOCKREPORT_INTERVAL of 21600000msecs CACHEREPORT_INTERVAL of 10000msecs Initial delay: 0msecs; heartBeatInterval=3000 2025-06-26 02:44:41,706 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674 for DN 127.0.0.1:36823 2025-06-26 02:44:41,706 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-c1feaca6-49aa-4f4b-a141-204d3849497f for DN 127.0.0.1:36823 2025-06-26 02:44:41,736 INFO BlockStateChange: BLOCK* processReport 0xde45c142f8e61f20: Processing first storage report for DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674 from datanode 34872996-582a-4416-bd83-d7de6ac81ddb 2025-06-26 02:44:41,738 INFO BlockStateChange: BLOCK* processReport 0xde45c142f8e61f20: from storage DS-df58db9e-ec0f-4fcf-9ca5-a95f5c1ed674 node DatanodeRegistration(127.0.0.1:36823, datanodeUuid=34872996-582a-4416-bd83-d7de6ac81ddb, infoPort=34677, infoSecurePort=0, ipcPort=43097, storageInfo=lv=-57;cid=testClusterID;nsid=892219300;c=1750877079302), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2025-06-26 02:44:41,739 INFO BlockStateChange: BLOCK* processReport 0xde45c142f8e61f20: Processing first storage report for DS-c1feaca6-49aa-4f4b-a141-204d3849497f from datanode 34872996-582a-4416-bd83-d7de6ac81ddb 2025-06-26 02:44:41,739 INFO BlockStateChange: BLOCK* processReport 0xde45c142f8e61f20: from storage DS-c1feaca6-49aa-4f4b-a141-204d3849497f node DatanodeRegistration(127.0.0.1:36823, datanodeUuid=34872996-582a-4416-bd83-d7de6ac81ddb, infoPort=34677, infoSecurePort=0, ipcPort=43097, storageInfo=lv=-57;cid=testClusterID;nsid=892219300;c=1750877079302), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2025-06-26 02:44:41,757 INFO datanode.DataNode: Successfully sent block report 0xde45c142f8e61f20 to namenode: localhost/127.0.0.1:12222, containing 2 storage report(s), of which we sent 2. The reports had 0 total blocks and used 1 RPC(s). This took 6 msecs to generate and 32 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5. 2025-06-26 02:44:41,758 INFO datanode.DataNode: Got finalize command for block pool BP-653333143-172.17.0.2-1750877079302 2025-06-26 02:44:41,787 INFO hdfs.MiniDFSCluster: Cluster is active 2025-06-26 02:44:41,792 INFO mapreduce.MiniHadoopClusterManager: Started MiniDFSCluster -- namenode on port 12222 2025-06-26 02:49:31,211 INFO namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 36 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 1 1 2025-06-26 02:49:31,226 INFO hdfs.StateChange: BLOCK* allocate blk_1073741825_1001, replicas=127.0.0.1:36823 for /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data1.tsv 2025-06-26 02:49:31,305 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741825_1001 src: /127.0.0.1:50766 dest: /127.0.0.1:36823 2025-06-26 02:49:31,354 INFO DataNode.clienttrace: src: /127.0.0.1:50766, dest: /127.0.0.1:36823, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.006042_count_4_pid_624_tid_280657870158464, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741825_1001, duration(ns): 11406089 2025-06-26 02:49:31,354 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741825_1001, type=LAST_IN_PIPELINE terminating 2025-06-26 02:49:31,356 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data1.tsv for libhdfs3_client_rand_0.006042_count_4_pid_624_tid_280657870158464 2025-06-26 02:49:31,362 INFO namenode.FSNamesystem: BLOCK* blk_1073741825_1001 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data1.tsv 2025-06-26 02:49:31,766 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data1.tsv is closed by libhdfs3_client_rand_0.006042_count_4_pid_624_tid_280657870158464 2025-06-26 02:49:31,857 INFO hdfs.StateChange: BLOCK* allocate blk_1073741826_1002, replicas=127.0.0.1:36823 for /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data2.tsv 2025-06-26 02:49:31,860 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741826_1002 src: /127.0.0.1:50774 dest: /127.0.0.1:36823 2025-06-26 02:49:31,865 INFO DataNode.clienttrace: src: /127.0.0.1:50774, dest: /127.0.0.1:36823, bytes: 3, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.006042_count_6_pid_624_tid_280657827887744, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741826_1002, duration(ns): 2337202 2025-06-26 02:49:31,866 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741826_1002, type=LAST_IN_PIPELINE terminating 2025-06-26 02:49:31,867 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data2.tsv for libhdfs3_client_rand_0.006042_count_6_pid_624_tid_280657827887744 2025-06-26 02:49:31,870 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data2.tsv is closed by libhdfs3_client_rand_0.006042_count_6_pid_624_tid_280657827887744 2025-06-26 02:49:31,981 INFO hdfs.StateChange: BLOCK* allocate blk_1073741827_1003, replicas=127.0.0.1:36823 for /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data3.tsv 2025-06-26 02:49:31,983 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741827_1003 src: /127.0.0.1:50790 dest: /127.0.0.1:36823 2025-06-26 02:49:31,989 INFO DataNode.clienttrace: src: /127.0.0.1:50790, dest: /127.0.0.1:36823, bytes: 4, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.006042_count_8_pid_624_tid_280657929337472, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741827_1003, duration(ns): 3168282 2025-06-26 02:49:31,989 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741827_1003, type=LAST_IN_PIPELINE terminating 2025-06-26 02:49:31,990 INFO hdfs.StateChange: BLOCK* fsync: /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data3.tsv for libhdfs3_client_rand_0.006042_count_8_pid_624_tid_280657929337472 2025-06-26 02:49:31,992 INFO hdfs.StateChange: DIR* completeFile: /02923_hdfs_engine_size_virtual_column_test_agvtvx7p.data3.tsv is closed by libhdfs3_client_rand_0.006042_count_8_pid_624_tid_280657929337472 2025-06-26 02:55:40,983 INFO namenode.FSEditLog: Number of transactions: 20 Total time for transactions(ms): 37 Number of transactions batched in Syncs: 3 Number of syncs: 17 SyncTimes(ms): 1 1 2025-06-26 02:55:40,989 INFO hdfs.StateChange: BLOCK* allocate blk_1073741828_1004, replicas=127.0.0.1:36823 for /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data1.tsv 2025-06-26 02:55:40,991 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741828_1004 src: /127.0.0.1:33346 dest: /127.0.0.1:36823 2025-06-26 02:55:40,997 INFO DataNode.clienttrace: src: /127.0.0.1:33346, dest: /127.0.0.1:36823, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.383016_count_15_pid_624_tid_280658140691072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741828_1004, duration(ns): 3354625 2025-06-26 02:55:40,998 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data1.tsv for libhdfs3_client_rand_0.383016_count_15_pid_624_tid_280658140691072 2025-06-26 02:55:40,998 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741828_1004, type=LAST_IN_PIPELINE terminating 2025-06-26 02:55:41,000 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data1.tsv is closed by libhdfs3_client_rand_0.383016_count_15_pid_624_tid_280658140691072 2025-06-26 02:55:41,109 INFO hdfs.StateChange: BLOCK* allocate blk_1073741829_1005, replicas=127.0.0.1:36823 for /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data2.tsv 2025-06-26 02:55:41,111 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741829_1005 src: /127.0.0.1:33356 dest: /127.0.0.1:36823 2025-06-26 02:55:41,116 INFO DataNode.clienttrace: src: /127.0.0.1:33356, dest: /127.0.0.1:36823, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.468048_count_17_pid_624_tid_280658394315392, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741829_1005, duration(ns): 2326337 2025-06-26 02:55:41,116 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741829_1005, type=LAST_IN_PIPELINE terminating 2025-06-26 02:55:41,117 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data2.tsv for libhdfs3_client_rand_0.468048_count_17_pid_624_tid_280658394315392 2025-06-26 02:55:41,119 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data2.tsv is closed by libhdfs3_client_rand_0.468048_count_17_pid_624_tid_280658394315392 2025-06-26 02:55:41,231 INFO hdfs.StateChange: BLOCK* allocate blk_1073741830_1006, replicas=127.0.0.1:36823 for /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data3.tsv 2025-06-26 02:55:41,234 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741830_1006 src: /127.0.0.1:33366 dest: /127.0.0.1:36823 2025-06-26 02:55:41,238 INFO DataNode.clienttrace: src: /127.0.0.1:33366, dest: /127.0.0.1:36823, bytes: 2, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.468048_count_19_pid_624_tid_280658394315392, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741830_1006, duration(ns): 2471019 2025-06-26 02:55:41,239 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741830_1006, type=LAST_IN_PIPELINE terminating 2025-06-26 02:55:41,240 INFO hdfs.StateChange: BLOCK* fsync: /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data3.tsv for libhdfs3_client_rand_0.468048_count_19_pid_624_tid_280658394315392 2025-06-26 02:55:41,242 INFO hdfs.StateChange: DIR* completeFile: /02845_table_function_hdfs_filter_by_virtual_columns_test_nnl9fqcp.data3.tsv is closed by libhdfs3_client_rand_0.468048_count_19_pid_624_tid_280658394315392 2025-06-26 02:58:30,808 INFO namenode.FSEditLog: Number of transactions: 38 Total time for transactions(ms): 37 Number of transactions batched in Syncs: 6 Number of syncs: 32 SyncTimes(ms): 2 1 2025-06-26 02:58:31,619 INFO hdfs.StateChange: BLOCK* allocate blk_1073741831_1007, replicas=127.0.0.1:36823 for /02368_data_6.jsonl 2025-06-26 02:58:31,631 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741831_1007 src: /127.0.0.1:48124 dest: /127.0.0.1:36823 2025-06-26 02:58:31,675 INFO hdfs.StateChange: BLOCK* allocate blk_1073741832_1008, replicas=127.0.0.1:36823 for /02368_data_9.jsonl 2025-06-26 02:58:31,687 INFO hdfs.StateChange: BLOCK* allocate blk_1073741833_1009, replicas=127.0.0.1:36823 for /02368_data_10.jsonl 2025-06-26 02:58:31,691 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741832_1008 src: /127.0.0.1:48132 dest: /127.0.0.1:36823 2025-06-26 02:58:31,714 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741833_1009 src: /127.0.0.1:48140 dest: /127.0.0.1:36823 2025-06-26 02:58:31,801 INFO hdfs.StateChange: BLOCK* allocate blk_1073741834_1010, replicas=127.0.0.1:36823 for /02368_data_3.jsonl 2025-06-26 02:58:31,826 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741834_1010 src: /127.0.0.1:48152 dest: /127.0.0.1:36823 2025-06-26 02:58:31,879 INFO hdfs.StateChange: BLOCK* allocate blk_1073741835_1011, replicas=127.0.0.1:36823 for /02368_data_5.jsonl 2025-06-26 02:58:31,902 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741835_1011 src: /127.0.0.1:48168 dest: /127.0.0.1:36823 2025-06-26 02:58:31,918 INFO hdfs.StateChange: BLOCK* allocate blk_1073741836_1012, replicas=127.0.0.1:36823 for /02368_data_8.jsonl 2025-06-26 02:58:31,966 INFO hdfs.StateChange: BLOCK* allocate blk_1073741837_1013, replicas=127.0.0.1:36823 for /02368_data_1.jsonl 2025-06-26 02:58:31,967 INFO hdfs.StateChange: BLOCK* allocate blk_1073741838_1014, replicas=127.0.0.1:36823 for /02368_data_7.jsonl 2025-06-26 02:58:31,978 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741836_1012 src: /127.0.0.1:48178 dest: /127.0.0.1:36823 2025-06-26 02:58:31,980 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741837_1013 src: /127.0.0.1:48180 dest: /127.0.0.1:36823 2025-06-26 02:58:32,037 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741838_1014 src: /127.0.0.1:48192 dest: /127.0.0.1:36823 2025-06-26 02:58:32,048 INFO hdfs.StateChange: BLOCK* allocate blk_1073741839_1015, replicas=127.0.0.1:36823 for /02368_data_4.jsonl 2025-06-26 02:58:32,072 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741839_1015 src: /127.0.0.1:48206 dest: /127.0.0.1:36823 2025-06-26 02:58:32,145 INFO hdfs.StateChange: BLOCK* allocate blk_1073741840_1016, replicas=127.0.0.1:36823 for /02368_data_2.jsonl 2025-06-26 02:58:32,156 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741840_1016 src: /127.0.0.1:48216 dest: /127.0.0.1:36823 2025-06-26 02:58:32,307 INFO DataNode.clienttrace: src: /127.0.0.1:48124, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741831_1007, duration(ns): 656870536 2025-06-26 02:58:32,307 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741831_1007, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,310 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944 2025-06-26 02:58:32,312 INFO hdfs.StateChange: BLOCK* allocate blk_1073741841_1017, replicas=127.0.0.1:36823 for /02368_data_6.jsonl 2025-06-26 02:58:32,316 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741841_1017 src: /127.0.0.1:48218 dest: /127.0.0.1:36823 2025-06-26 02:58:32,333 INFO DataNode.clienttrace: src: /127.0.0.1:48168, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741835_1011, duration(ns): 400062755 2025-06-26 02:58:32,333 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741835_1011, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,342 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560 2025-06-26 02:58:32,347 INFO hdfs.StateChange: BLOCK* allocate blk_1073741842_1018, replicas=127.0.0.1:36823 for /02368_data_5.jsonl 2025-06-26 02:58:32,351 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741842_1018 src: /127.0.0.1:48232 dest: /127.0.0.1:36823 2025-06-26 02:58:32,403 INFO DataNode.clienttrace: src: /127.0.0.1:48140, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741833_1009, duration(ns): 687333094 2025-06-26 02:58:32,403 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741833_1009, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,404 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088 2025-06-26 02:58:32,414 INFO DataNode.clienttrace: src: /127.0.0.1:48178, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741836_1012, duration(ns): 412935517 2025-06-26 02:58:32,414 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741836_1012, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,417 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688 2025-06-26 02:58:32,419 INFO hdfs.StateChange: BLOCK* allocate blk_1073741843_1019, replicas=127.0.0.1:36823 for /02368_data_10.jsonl 2025-06-26 02:58:32,420 INFO hdfs.StateChange: BLOCK* allocate blk_1073741844_1020, replicas=127.0.0.1:36823 for /02368_data_8.jsonl 2025-06-26 02:58:32,436 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741843_1019 src: /127.0.0.1:48246 dest: /127.0.0.1:36823 2025-06-26 02:58:32,445 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741844_1020 src: /127.0.0.1:48256 dest: /127.0.0.1:36823 2025-06-26 02:58:32,452 INFO DataNode.clienttrace: src: /127.0.0.1:48206, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741839_1015, duration(ns): 364406030 2025-06-26 02:58:32,453 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741839_1015, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,453 INFO DataNode.clienttrace: src: /127.0.0.1:48132, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741832_1008, duration(ns): 738364020 2025-06-26 02:58:32,453 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741832_1008, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,453 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400 2025-06-26 02:58:32,453 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416 2025-06-26 02:58:32,471 INFO hdfs.StateChange: BLOCK* allocate blk_1073741845_1021, replicas=127.0.0.1:36823 for /02368_data_9.jsonl 2025-06-26 02:58:32,473 INFO DataNode.clienttrace: src: /127.0.0.1:48192, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741838_1014, duration(ns): 396764461 2025-06-26 02:58:32,474 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741838_1014, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,474 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328 2025-06-26 02:58:32,477 INFO hdfs.StateChange: BLOCK* allocate blk_1073741846_1022, replicas=127.0.0.1:36823 for /02368_data_4.jsonl 2025-06-26 02:58:32,480 INFO hdfs.StateChange: BLOCK* allocate blk_1073741847_1023, replicas=127.0.0.1:36823 for /02368_data_7.jsonl 2025-06-26 02:58:32,496 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741846_1022 src: /127.0.0.1:48280 dest: /127.0.0.1:36823 2025-06-26 02:58:32,496 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741847_1023 src: /127.0.0.1:48296 dest: /127.0.0.1:36823 2025-06-26 02:58:32,496 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741845_1021 src: /127.0.0.1:48266 dest: /127.0.0.1:36823 2025-06-26 02:58:32,521 INFO DataNode.clienttrace: src: /127.0.0.1:48152, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741834_1010, duration(ns): 646335523 2025-06-26 02:58:32,521 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741834_1010, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,522 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904 2025-06-26 02:58:32,523 INFO DataNode.clienttrace: src: /127.0.0.1:48180, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741837_1013, duration(ns): 507463248 2025-06-26 02:58:32,524 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741837_1013, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,524 INFO hdfs.StateChange: BLOCK* allocate blk_1073741848_1024, replicas=127.0.0.1:36823 for /02368_data_3.jsonl 2025-06-26 02:58:32,524 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120 2025-06-26 02:58:32,530 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741848_1024 src: /127.0.0.1:48298 dest: /127.0.0.1:36823 2025-06-26 02:58:32,542 INFO hdfs.StateChange: BLOCK* allocate blk_1073741849_1025, replicas=127.0.0.1:36823 for /02368_data_1.jsonl 2025-06-26 02:58:32,549 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741849_1025 src: /127.0.0.1:48304 dest: /127.0.0.1:36823 2025-06-26 02:58:32,616 INFO DataNode.clienttrace: src: /127.0.0.1:48216, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741840_1016, duration(ns): 426696134 2025-06-26 02:58:32,617 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741840_1016, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,618 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776 2025-06-26 02:58:32,621 INFO hdfs.StateChange: BLOCK* allocate blk_1073741850_1026, replicas=127.0.0.1:36823 for /02368_data_2.jsonl 2025-06-26 02:58:32,624 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741850_1026 src: /127.0.0.1:48310 dest: /127.0.0.1:36823 2025-06-26 02:58:32,805 INFO DataNode.clienttrace: src: /127.0.0.1:48232, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741842_1018, duration(ns): 452218216 2025-06-26 02:58:32,805 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741842_1018, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,808 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560 2025-06-26 02:58:32,809 INFO hdfs.StateChange: BLOCK* allocate blk_1073741851_1027, replicas=127.0.0.1:36823 for /02368_data_5.jsonl 2025-06-26 02:58:32,821 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741851_1027 src: /127.0.0.1:48326 dest: /127.0.0.1:36823 2025-06-26 02:58:32,822 INFO DataNode.clienttrace: src: /127.0.0.1:48218, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741841_1017, duration(ns): 501792719 2025-06-26 02:58:32,822 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741841_1017, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,823 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944 2025-06-26 02:58:32,826 INFO hdfs.StateChange: BLOCK* allocate blk_1073741852_1028, replicas=127.0.0.1:36823 for /02368_data_6.jsonl 2025-06-26 02:58:32,846 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741852_1028 src: /127.0.0.1:48328 dest: /127.0.0.1:36823 2025-06-26 02:58:32,851 INFO DataNode.clienttrace: src: /127.0.0.1:48246, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741843_1019, duration(ns): 404280380 2025-06-26 02:58:32,851 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741843_1019, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,854 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088 2025-06-26 02:58:32,856 INFO hdfs.StateChange: BLOCK* allocate blk_1073741853_1029, replicas=127.0.0.1:36823 for /02368_data_10.jsonl 2025-06-26 02:58:32,858 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741853_1029 src: /127.0.0.1:48338 dest: /127.0.0.1:36823 2025-06-26 02:58:32,915 INFO DataNode.clienttrace: src: /127.0.0.1:48266, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741845_1021, duration(ns): 415521677 2025-06-26 02:58:32,915 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741845_1021, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,915 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416 2025-06-26 02:58:32,918 INFO hdfs.StateChange: BLOCK* allocate blk_1073741854_1030, replicas=127.0.0.1:36823 for /02368_data_9.jsonl 2025-06-26 02:58:32,920 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741854_1030 src: /127.0.0.1:48342 dest: /127.0.0.1:36823 2025-06-26 02:58:32,974 INFO DataNode.clienttrace: src: /127.0.0.1:48256, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741844_1020, duration(ns): 517560847 2025-06-26 02:58:32,974 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741844_1020, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,976 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688 2025-06-26 02:58:32,978 INFO hdfs.StateChange: BLOCK* allocate blk_1073741855_1031, replicas=127.0.0.1:36823 for /02368_data_8.jsonl 2025-06-26 02:58:32,982 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741855_1031 src: /127.0.0.1:48352 dest: /127.0.0.1:36823 2025-06-26 02:58:32,988 INFO DataNode.clienttrace: src: /127.0.0.1:48298, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741848_1024, duration(ns): 437456504 2025-06-26 02:58:32,989 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741848_1024, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:32,991 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904 2025-06-26 02:58:32,993 INFO hdfs.StateChange: BLOCK* allocate blk_1073741856_1032, replicas=127.0.0.1:36823 for /02368_data_3.jsonl 2025-06-26 02:58:32,999 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741856_1032 src: /127.0.0.1:48364 dest: /127.0.0.1:36823 2025-06-26 02:58:33,017 INFO DataNode.clienttrace: src: /127.0.0.1:48296, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741847_1023, duration(ns): 518402381 2025-06-26 02:58:33,018 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741847_1023, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,021 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328 2025-06-26 02:58:33,021 INFO DataNode.clienttrace: src: /127.0.0.1:48280, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741846_1022, duration(ns): 520034606 2025-06-26 02:58:33,023 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741846_1022, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,023 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400 2025-06-26 02:58:33,027 INFO hdfs.StateChange: BLOCK* allocate blk_1073741857_1033, replicas=127.0.0.1:36823 for /02368_data_7.jsonl 2025-06-26 02:58:33,029 INFO hdfs.StateChange: BLOCK* allocate blk_1073741858_1034, replicas=127.0.0.1:36823 for /02368_data_4.jsonl 2025-06-26 02:58:33,031 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741857_1033 src: /127.0.0.1:48374 dest: /127.0.0.1:36823 2025-06-26 02:58:33,031 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741858_1034 src: /127.0.0.1:48376 dest: /127.0.0.1:36823 2025-06-26 02:58:33,043 INFO DataNode.clienttrace: src: /127.0.0.1:48304, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741849_1025, duration(ns): 487819457 2025-06-26 02:58:33,043 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741849_1025, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,044 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120 2025-06-26 02:58:33,047 INFO hdfs.StateChange: BLOCK* allocate blk_1073741859_1035, replicas=127.0.0.1:36823 for /02368_data_1.jsonl 2025-06-26 02:58:33,050 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741859_1035 src: /127.0.0.1:48382 dest: /127.0.0.1:36823 2025-06-26 02:58:33,121 INFO DataNode.clienttrace: src: /127.0.0.1:48310, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741850_1026, duration(ns): 469796210 2025-06-26 02:58:33,121 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741850_1026, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,123 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776 2025-06-26 02:58:33,125 INFO hdfs.StateChange: BLOCK* allocate blk_1073741860_1036, replicas=127.0.0.1:36823 for /02368_data_2.jsonl 2025-06-26 02:58:33,146 INFO DataNode.clienttrace: src: /127.0.0.1:48326, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741851_1027, duration(ns): 320339371 2025-06-26 02:58:33,147 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741860_1036 src: /127.0.0.1:38218 dest: /127.0.0.1:36823 2025-06-26 02:58:33,148 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560 2025-06-26 02:58:33,149 INFO hdfs.StateChange: DIR* completeFile: /02368_data_5.jsonl is closed by libhdfs3_client_rand_0.838532_count_34_pid_624_tid_280645522258560 2025-06-26 02:58:33,148 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741851_1027, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,171 INFO DataNode.clienttrace: src: /127.0.0.1:48338, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741853_1029, duration(ns): 307273044 2025-06-26 02:58:33,171 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741853_1029, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,172 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088 2025-06-26 02:58:33,178 INFO namenode.FSNamesystem: BLOCK* blk_1073741853_1029 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02368_data_10.jsonl 2025-06-26 02:58:33,224 INFO DataNode.clienttrace: src: /127.0.0.1:48328, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741852_1028, duration(ns): 372987240 2025-06-26 02:58:33,225 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741852_1028, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,226 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944 2025-06-26 02:58:33,232 INFO hdfs.StateChange: DIR* completeFile: /02368_data_6.jsonl is closed by libhdfs3_client_rand_0.838532_count_30_pid_624_tid_280689377122944 2025-06-26 02:58:33,240 INFO DataNode.clienttrace: src: /127.0.0.1:48352, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741855_1031, duration(ns): 246905210 2025-06-26 02:58:33,241 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688 2025-06-26 02:58:33,243 INFO hdfs.StateChange: DIR* completeFile: /02368_data_8.jsonl is closed by libhdfs3_client_rand_0.838532_count_39_pid_624_tid_280589035010688 2025-06-26 02:58:33,245 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741855_1031, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,271 INFO DataNode.clienttrace: src: /127.0.0.1:48342, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741854_1030, duration(ns): 322447481 2025-06-26 02:58:33,271 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741854_1030, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,274 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416 2025-06-26 02:58:33,277 INFO namenode.FSNamesystem: BLOCK* blk_1073741854_1030 is COMMITTED but not COMPLETE(numNodes= 0 < minimum = 1) in file /02368_data_9.jsonl 2025-06-26 02:58:33,286 INFO DataNode.clienttrace: src: /127.0.0.1:48364, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741856_1032, duration(ns): 267398413 2025-06-26 02:58:33,286 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741856_1032, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,287 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904 2025-06-26 02:58:33,289 INFO hdfs.StateChange: DIR* completeFile: /02368_data_3.jsonl is closed by libhdfs3_client_rand_0.838532_count_28_pid_624_tid_280657954699904 2025-06-26 02:58:33,303 INFO DataNode.clienttrace: src: /127.0.0.1:48382, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741859_1035, duration(ns): 238734521 2025-06-26 02:58:33,303 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741859_1035, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,305 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120 2025-06-26 02:58:33,308 INFO hdfs.StateChange: DIR* completeFile: /02368_data_1.jsonl is closed by libhdfs3_client_rand_0.838532_count_38_pid_624_tid_280589060373120 2025-06-26 02:58:33,337 INFO DataNode.clienttrace: src: /127.0.0.1:48374, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741857_1033, duration(ns): 301007382 2025-06-26 02:58:33,337 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741857_1033, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,338 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328 2025-06-26 02:58:33,339 INFO hdfs.StateChange: DIR* completeFile: /02368_data_7.jsonl is closed by libhdfs3_client_rand_0.838532_count_29_pid_624_tid_280657920883328 2025-06-26 02:58:33,362 INFO DataNode.clienttrace: src: /127.0.0.1:48376, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741858_1034, duration(ns): 326658626 2025-06-26 02:58:33,362 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741858_1034, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,362 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400 2025-06-26 02:58:33,364 INFO hdfs.StateChange: DIR* completeFile: /02368_data_4.jsonl is closed by libhdfs3_client_rand_0.838532_count_31_pid_624_tid_280589018102400 2025-06-26 02:58:33,375 INFO DataNode.clienttrace: src: /127.0.0.1:38218, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741860_1036, duration(ns): 221278886 2025-06-26 02:58:33,375 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741860_1036, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:33,378 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776 2025-06-26 02:58:33,379 INFO hdfs.StateChange: DIR* completeFile: /02368_data_2.jsonl is closed by libhdfs3_client_rand_0.838532_count_43_pid_624_tid_280658064603776 2025-06-26 02:58:33,581 INFO hdfs.StateChange: DIR* completeFile: /02368_data_10.jsonl is closed by libhdfs3_client_rand_0.838532_count_41_pid_624_tid_280689385577088 2025-06-26 02:58:33,678 INFO hdfs.StateChange: DIR* completeFile: /02368_data_9.jsonl is closed by libhdfs3_client_rand_0.838532_count_40_pid_624_tid_280618472012416 2025-06-26 02:58:33,871 INFO hdfs.StateChange: BLOCK* allocate blk_1073741861_1037, replicas=127.0.0.1:36823 for /02368_data_3.jsonl 2025-06-26 02:58:33,875 INFO hdfs.StateChange: BLOCK* allocate blk_1073741862_1038, replicas=127.0.0.1:36823 for /02368_data_7.jsonl 2025-06-26 02:58:33,879 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741862_1038 src: /127.0.0.1:38222 dest: /127.0.0.1:36823 2025-06-26 02:58:33,881 INFO hdfs.StateChange: BLOCK* allocate blk_1073741863_1039, replicas=127.0.0.1:36823 for /02368_data_4.jsonl 2025-06-26 02:58:33,884 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741863_1039 src: /127.0.0.1:38240 dest: /127.0.0.1:36823 2025-06-26 02:58:33,884 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741861_1037 src: /127.0.0.1:38234 dest: /127.0.0.1:36823 2025-06-26 02:58:33,887 INFO hdfs.StateChange: BLOCK* allocate blk_1073741864_1040, replicas=127.0.0.1:36823 for /02368_data_5.jsonl 2025-06-26 02:58:33,895 INFO hdfs.StateChange: BLOCK* allocate blk_1073741865_1041, replicas=127.0.0.1:36823 for /02368_data_1.jsonl 2025-06-26 02:58:33,895 INFO hdfs.StateChange: BLOCK* allocate blk_1073741866_1042, replicas=127.0.0.1:36823 for /02368_data_8.jsonl 2025-06-26 02:58:33,897 INFO hdfs.StateChange: BLOCK* allocate blk_1073741867_1043, replicas=127.0.0.1:36823 for /02368_data_10.jsonl 2025-06-26 02:58:33,900 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741864_1040 src: /127.0.0.1:38256 dest: /127.0.0.1:36823 2025-06-26 02:58:33,901 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741865_1041 src: /127.0.0.1:38264 dest: /127.0.0.1:36823 2025-06-26 02:58:33,902 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741867_1043 src: /127.0.0.1:38266 dest: /127.0.0.1:36823 2025-06-26 02:58:33,902 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741866_1042 src: /127.0.0.1:38272 dest: /127.0.0.1:36823 2025-06-26 02:58:33,908 INFO hdfs.StateChange: BLOCK* allocate blk_1073741868_1044, replicas=127.0.0.1:36823 for /02368_data_2.jsonl 2025-06-26 02:58:33,910 INFO hdfs.StateChange: BLOCK* allocate blk_1073741869_1045, replicas=127.0.0.1:36823 for /02368_data_6.jsonl 2025-06-26 02:58:33,928 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741869_1045 src: /127.0.0.1:38280 dest: /127.0.0.1:36823 2025-06-26 02:58:33,930 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741868_1044 src: /127.0.0.1:38292 dest: /127.0.0.1:36823 2025-06-26 02:58:33,934 INFO hdfs.StateChange: BLOCK* allocate blk_1073741870_1046, replicas=127.0.0.1:36823 for /02368_data_9.jsonl 2025-06-26 02:58:33,938 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741870_1046 src: /127.0.0.1:38306 dest: /127.0.0.1:36823 2025-06-26 02:58:34,329 INFO DataNode.clienttrace: src: /127.0.0.1:38264, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741865_1041, duration(ns): 424439797 2025-06-26 02:58:34,329 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741865_1041, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,330 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104 2025-06-26 02:58:34,335 INFO hdfs.StateChange: BLOCK* allocate blk_1073741871_1047, replicas=127.0.0.1:36823 for /02368_data_1.jsonl 2025-06-26 02:58:34,351 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741871_1047 src: /127.0.0.1:38312 dest: /127.0.0.1:36823 2025-06-26 02:58:34,394 INFO DataNode.clienttrace: src: /127.0.0.1:38256, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741864_1040, duration(ns): 464544068 2025-06-26 02:58:34,397 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741864_1040, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,396 INFO DataNode.clienttrace: src: /127.0.0.1:38292, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741868_1044, duration(ns): 439028427 2025-06-26 02:58:34,398 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741868_1044, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,402 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376 2025-06-26 02:58:34,402 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248 2025-06-26 02:58:34,412 INFO hdfs.StateChange: BLOCK* allocate blk_1073741872_1048, replicas=127.0.0.1:36823 for /02368_data_2.jsonl 2025-06-26 02:58:34,413 INFO hdfs.StateChange: BLOCK* allocate blk_1073741873_1049, replicas=127.0.0.1:36823 for /02368_data_5.jsonl 2025-06-26 02:58:34,423 INFO DataNode.clienttrace: src: /127.0.0.1:38240, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741863_1039, duration(ns): 528255791 2025-06-26 02:58:34,423 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741863_1039, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,423 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088 2025-06-26 02:58:34,424 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741872_1048 src: /127.0.0.1:38322 dest: /127.0.0.1:36823 2025-06-26 02:58:34,425 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741873_1049 src: /127.0.0.1:38324 dest: /127.0.0.1:36823 2025-06-26 02:58:34,428 INFO hdfs.StateChange: BLOCK* allocate blk_1073741874_1050, replicas=127.0.0.1:36823 for /02368_data_4.jsonl 2025-06-26 02:58:34,444 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741874_1050 src: /127.0.0.1:38328 dest: /127.0.0.1:36823 2025-06-26 02:58:34,458 INFO DataNode.clienttrace: src: /127.0.0.1:38222, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741862_1038, duration(ns): 574659921 2025-06-26 02:58:34,459 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741862_1038, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,459 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976 2025-06-26 02:58:34,465 INFO hdfs.StateChange: BLOCK* allocate blk_1073741875_1051, replicas=127.0.0.1:36823 for /02368_data_7.jsonl 2025-06-26 02:58:34,479 INFO DataNode.clienttrace: src: /127.0.0.1:38234, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741861_1037, duration(ns): 589705957 2025-06-26 02:58:34,479 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741861_1037, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,482 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792 2025-06-26 02:58:34,486 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741875_1051 src: /127.0.0.1:38330 dest: /127.0.0.1:36823 2025-06-26 02:58:34,490 INFO DataNode.clienttrace: src: /127.0.0.1:38266, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741867_1043, duration(ns): 583522220 2025-06-26 02:58:34,491 INFO hdfs.StateChange: BLOCK* allocate blk_1073741876_1052, replicas=127.0.0.1:36823 for /02368_data_3.jsonl 2025-06-26 02:58:34,491 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741867_1043, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,492 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072 2025-06-26 02:58:34,494 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741876_1052 src: /127.0.0.1:38336 dest: /127.0.0.1:36823 2025-06-26 02:58:34,498 INFO hdfs.StateChange: BLOCK* allocate blk_1073741877_1053, replicas=127.0.0.1:36823 for /02368_data_10.jsonl 2025-06-26 02:58:34,501 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741877_1053 src: /127.0.0.1:38340 dest: /127.0.0.1:36823 2025-06-26 02:58:34,523 INFO DataNode.clienttrace: src: /127.0.0.1:38272, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741866_1042, duration(ns): 615173358 2025-06-26 02:58:34,523 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741866_1042, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,524 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472 2025-06-26 02:58:34,529 INFO DataNode.clienttrace: src: /127.0.0.1:38306, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741870_1046, duration(ns): 582881488 2025-06-26 02:58:34,529 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741870_1046, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,535 INFO DataNode.clienttrace: src: /127.0.0.1:38280, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741869_1045, duration(ns): 602747921 2025-06-26 02:58:34,535 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741869_1045, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,537 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072 2025-06-26 02:58:34,537 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208 2025-06-26 02:58:34,538 INFO hdfs.StateChange: BLOCK* allocate blk_1073741878_1054, replicas=127.0.0.1:36823 for /02368_data_8.jsonl 2025-06-26 02:58:34,542 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741878_1054 src: /127.0.0.1:38350 dest: /127.0.0.1:36823 2025-06-26 02:58:34,542 INFO hdfs.StateChange: BLOCK* allocate blk_1073741879_1055, replicas=127.0.0.1:36823 for /02368_data_9.jsonl 2025-06-26 02:58:34,546 INFO hdfs.StateChange: BLOCK* allocate blk_1073741880_1056, replicas=127.0.0.1:36823 for /02368_data_6.jsonl 2025-06-26 02:58:34,554 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741880_1056 src: /127.0.0.1:38368 dest: /127.0.0.1:36823 2025-06-26 02:58:34,555 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741879_1055 src: /127.0.0.1:38358 dest: /127.0.0.1:36823 2025-06-26 02:58:34,870 INFO DataNode.clienttrace: src: /127.0.0.1:38328, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741874_1050, duration(ns): 418577343 2025-06-26 02:58:34,870 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741874_1050, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,872 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088 2025-06-26 02:58:34,877 INFO DataNode.clienttrace: src: /127.0.0.1:38324, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741873_1049, duration(ns): 433526778 2025-06-26 02:58:34,877 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741873_1049, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,878 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376 2025-06-26 02:58:34,878 INFO hdfs.StateChange: BLOCK* allocate blk_1073741881_1057, replicas=127.0.0.1:36823 for /02368_data_4.jsonl 2025-06-26 02:58:34,881 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741881_1057 src: /127.0.0.1:38378 dest: /127.0.0.1:36823 2025-06-26 02:58:34,884 INFO hdfs.StateChange: BLOCK* allocate blk_1073741882_1058, replicas=127.0.0.1:36823 for /02368_data_5.jsonl 2025-06-26 02:58:34,909 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741882_1058 src: /127.0.0.1:38394 dest: /127.0.0.1:36823 2025-06-26 02:58:34,930 INFO DataNode.clienttrace: src: /127.0.0.1:38330, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741875_1051, duration(ns): 427602285 2025-06-26 02:58:34,930 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741875_1051, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,930 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976 2025-06-26 02:58:34,935 INFO hdfs.StateChange: BLOCK* allocate blk_1073741883_1059, replicas=127.0.0.1:36823 for /02368_data_7.jsonl 2025-06-26 02:58:34,938 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741883_1059 src: /127.0.0.1:38408 dest: /127.0.0.1:36823 2025-06-26 02:58:34,964 INFO DataNode.clienttrace: src: /127.0.0.1:38312, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741871_1047, duration(ns): 591594104 2025-06-26 02:58:34,964 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741871_1047, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:34,965 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104 2025-06-26 02:58:34,970 INFO hdfs.StateChange: BLOCK* allocate blk_1073741884_1060, replicas=127.0.0.1:36823 for /02368_data_1.jsonl 2025-06-26 02:58:34,977 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741884_1060 src: /127.0.0.1:38420 dest: /127.0.0.1:36823 2025-06-26 02:58:35,028 INFO DataNode.clienttrace: src: /127.0.0.1:38336, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741876_1052, duration(ns): 532272730 2025-06-26 02:58:35,028 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741876_1052, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,029 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792 2025-06-26 02:58:35,039 INFO hdfs.StateChange: BLOCK* allocate blk_1073741885_1061, replicas=127.0.0.1:36823 for /02368_data_3.jsonl 2025-06-26 02:58:35,048 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741885_1061 src: /127.0.0.1:38428 dest: /127.0.0.1:36823 2025-06-26 02:58:35,065 INFO DataNode.clienttrace: src: /127.0.0.1:38322, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741872_1048, duration(ns): 636622491 2025-06-26 02:58:35,065 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741872_1048, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,066 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248 2025-06-26 02:58:35,071 INFO DataNode.clienttrace: src: /127.0.0.1:38340, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741877_1053, duration(ns): 561054222 2025-06-26 02:58:35,071 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741877_1053, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,073 INFO hdfs.StateChange: BLOCK* allocate blk_1073741886_1062, replicas=127.0.0.1:36823 for /02368_data_2.jsonl 2025-06-26 02:58:35,074 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072 2025-06-26 02:58:35,076 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741886_1062 src: /127.0.0.1:38444 dest: /127.0.0.1:36823 2025-06-26 02:58:35,079 INFO hdfs.StateChange: BLOCK* allocate blk_1073741887_1063, replicas=127.0.0.1:36823 for /02368_data_10.jsonl 2025-06-26 02:58:35,086 INFO DataNode.clienttrace: src: /127.0.0.1:38358, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741879_1055, duration(ns): 529063079 2025-06-26 02:58:35,086 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741879_1055, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,087 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072 2025-06-26 02:58:35,090 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741887_1063 src: /127.0.0.1:38448 dest: /127.0.0.1:36823 2025-06-26 02:58:35,097 INFO hdfs.StateChange: BLOCK* allocate blk_1073741888_1064, replicas=127.0.0.1:36823 for /02368_data_9.jsonl 2025-06-26 02:58:35,102 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741888_1064 src: /127.0.0.1:38464 dest: /127.0.0.1:36823 2025-06-26 02:58:35,103 INFO DataNode.clienttrace: src: /127.0.0.1:38350, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741878_1054, duration(ns): 536181630 2025-06-26 02:58:35,103 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741878_1054, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,105 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472 2025-06-26 02:58:35,110 INFO DataNode.clienttrace: src: /127.0.0.1:38368, dest: /127.0.0.1:36823, bytes: 67108864, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741880_1056, duration(ns): 549478679 2025-06-26 02:58:35,110 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741880_1056, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,110 INFO hdfs.StateChange: BLOCK* allocate blk_1073741889_1065, replicas=127.0.0.1:36823 for /02368_data_8.jsonl 2025-06-26 02:58:35,112 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208 2025-06-26 02:58:35,118 INFO hdfs.StateChange: BLOCK* allocate blk_1073741890_1066, replicas=127.0.0.1:36823 for /02368_data_6.jsonl 2025-06-26 02:58:35,125 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741889_1065 src: /127.0.0.1:38468 dest: /127.0.0.1:36823 2025-06-26 02:58:35,126 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741890_1066 src: /127.0.0.1:38484 dest: /127.0.0.1:36823 2025-06-26 02:58:35,360 INFO DataNode.clienttrace: src: /127.0.0.1:38378, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741881_1057, duration(ns): 447341905 2025-06-26 02:58:35,360 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741881_1057, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,361 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_4.jsonl for libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088 2025-06-26 02:58:35,362 INFO hdfs.StateChange: DIR* completeFile: /02368_data_4.jsonl is closed by libhdfs3_client_rand_0.093629_count_48_pid_624_tid_280588823657088 2025-06-26 02:58:35,408 INFO DataNode.clienttrace: src: /127.0.0.1:38394, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741882_1058, duration(ns): 485805749 2025-06-26 02:58:35,408 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741882_1058, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,410 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_5.jsonl for libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376 2025-06-26 02:58:35,413 INFO hdfs.StateChange: DIR* completeFile: /02368_data_5.jsonl is closed by libhdfs3_client_rand_0.093629_count_57_pid_624_tid_280588840565376 2025-06-26 02:58:35,426 INFO DataNode.clienttrace: src: /127.0.0.1:38408, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741883_1059, duration(ns): 477124372 2025-06-26 02:58:35,426 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741883_1059, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,427 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_7.jsonl for libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976 2025-06-26 02:58:35,430 INFO hdfs.StateChange: DIR* completeFile: /02368_data_7.jsonl is closed by libhdfs3_client_rand_0.093629_count_54_pid_624_tid_280589051918976 2025-06-26 02:58:35,445 INFO DataNode.clienttrace: src: /127.0.0.1:38468, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741889_1065, duration(ns): 306456772 2025-06-26 02:58:35,445 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741889_1065, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,446 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_8.jsonl for libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472 2025-06-26 02:58:35,447 INFO hdfs.StateChange: DIR* completeFile: /02368_data_8.jsonl is closed by libhdfs3_client_rand_0.093629_count_60_pid_624_tid_280657929337472 2025-06-26 02:58:35,466 INFO DataNode.clienttrace: src: /127.0.0.1:38428, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741885_1061, duration(ns): 413835337 2025-06-26 02:58:35,466 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741885_1061, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,466 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_3.jsonl for libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792 2025-06-26 02:58:35,468 INFO hdfs.StateChange: DIR* completeFile: /02368_data_3.jsonl is closed by libhdfs3_client_rand_0.093629_count_45_pid_624_tid_280663524145792 2025-06-26 02:58:35,486 INFO DataNode.clienttrace: src: /127.0.0.1:38420, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741884_1060, duration(ns): 484388485 2025-06-26 02:58:35,487 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741884_1060, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,487 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_1.jsonl for libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104 2025-06-26 02:58:35,489 INFO hdfs.StateChange: DIR* completeFile: /02368_data_1.jsonl is closed by libhdfs3_client_rand_0.093629_count_55_pid_624_tid_280658377407104 2025-06-26 02:58:35,527 INFO DataNode.clienttrace: src: /127.0.0.1:38444, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741886_1062, duration(ns): 440900162 2025-06-26 02:58:35,527 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741886_1062, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,527 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_2.jsonl for libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248 2025-06-26 02:58:35,529 INFO hdfs.StateChange: DIR* completeFile: /02368_data_2.jsonl is closed by libhdfs3_client_rand_0.093629_count_50_pid_624_tid_280588950469248 2025-06-26 02:58:35,548 INFO DataNode.clienttrace: src: /127.0.0.1:38448, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741887_1063, duration(ns): 452451463 2025-06-26 02:58:35,548 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741887_1063, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,549 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_10.jsonl for libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072 2025-06-26 02:58:35,550 INFO hdfs.StateChange: DIR* completeFile: /02368_data_10.jsonl is closed by libhdfs3_client_rand_0.093629_count_61_pid_624_tid_280658140691072 2025-06-26 02:58:35,567 INFO DataNode.clienttrace: src: /127.0.0.1:38464, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741888_1064, duration(ns): 442249143 2025-06-26 02:58:35,568 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741888_1064, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,568 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_9.jsonl for libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072 2025-06-26 02:58:35,569 INFO hdfs.StateChange: DIR* completeFile: /02368_data_9.jsonl is closed by libhdfs3_client_rand_0.093629_count_63_pid_624_tid_280644025875072 2025-06-26 02:58:35,580 INFO DataNode.clienttrace: src: /127.0.0.1:38484, dest: /127.0.0.1:36823, bytes: 58492872, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741890_1066, duration(ns): 436754737 2025-06-26 02:58:35,581 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741890_1066, type=LAST_IN_PIPELINE terminating 2025-06-26 02:58:35,581 INFO hdfs.StateChange: BLOCK* fsync: /02368_data_6.jsonl for libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208 2025-06-26 02:58:35,583 INFO hdfs.StateChange: DIR* completeFile: /02368_data_6.jsonl is closed by libhdfs3_client_rand_0.093629_count_51_pid_624_tid_280629000174208 2025-06-26 02:58:35,763 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741831_1007 replica FinalizedReplica, blk_1073741831_1007, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741831 for deletion 2025-06-26 02:58:35,766 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741832_1008 replica FinalizedReplica, blk_1073741832_1008, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741832 for deletion 2025-06-26 02:58:35,767 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741833_1009 replica FinalizedReplica, blk_1073741833_1009, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741833 for deletion 2025-06-26 02:58:35,767 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741834_1010 replica FinalizedReplica, blk_1073741834_1010, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741834 for deletion 2025-06-26 02:58:35,767 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741835_1011 replica FinalizedReplica, blk_1073741835_1011, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741835 for deletion 2025-06-26 02:58:35,768 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741836_1012 replica FinalizedReplica, blk_1073741836_1012, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741836 for deletion 2025-06-26 02:58:35,768 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741837_1013 replica FinalizedReplica, blk_1073741837_1013, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741837 for deletion 2025-06-26 02:58:35,768 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741838_1014 replica FinalizedReplica, blk_1073741838_1014, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741838 for deletion 2025-06-26 02:58:35,768 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741839_1015 replica FinalizedReplica, blk_1073741839_1015, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741839 for deletion 2025-06-26 02:58:35,768 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741840_1016 replica FinalizedReplica, blk_1073741840_1016, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741840 for deletion 2025-06-26 02:58:35,768 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741841_1017 replica FinalizedReplica, blk_1073741841_1017, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741841 for deletion 2025-06-26 02:58:35,769 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741842_1018 replica FinalizedReplica, blk_1073741842_1018, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741842 for deletion 2025-06-26 02:58:35,769 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741843_1019 replica FinalizedReplica, blk_1073741843_1019, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741843 for deletion 2025-06-26 02:58:35,769 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741844_1020 replica FinalizedReplica, blk_1073741844_1020, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741844 for deletion 2025-06-26 02:58:35,769 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741845_1021 replica FinalizedReplica, blk_1073741845_1021, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741845 for deletion 2025-06-26 02:58:35,769 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741846_1022 replica FinalizedReplica, blk_1073741846_1022, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741846 for deletion 2025-06-26 02:58:35,769 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741847_1023 replica FinalizedReplica, blk_1073741847_1023, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741847 for deletion 2025-06-26 02:58:35,770 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741848_1024 replica FinalizedReplica, blk_1073741848_1024, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741848 for deletion 2025-06-26 02:58:35,770 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741849_1025 replica FinalizedReplica, blk_1073741849_1025, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741849 for deletion 2025-06-26 02:58:35,770 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741850_1026 replica FinalizedReplica, blk_1073741850_1026, FINALIZED getNumBytes() = 67108864 getBytesOnDisk() = 67108864 getVisibleLength()= 67108864 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741850 for deletion 2025-06-26 02:58:35,770 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741851_1027 replica FinalizedReplica, blk_1073741851_1027, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741851 for deletion 2025-06-26 02:58:35,772 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741852_1028 replica FinalizedReplica, blk_1073741852_1028, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741852 for deletion 2025-06-26 02:58:35,772 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741853_1029 replica FinalizedReplica, blk_1073741853_1029, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741853 for deletion 2025-06-26 02:58:35,772 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741854_1030 replica FinalizedReplica, blk_1073741854_1030, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741854 for deletion 2025-06-26 02:58:35,772 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741855_1031 replica FinalizedReplica, blk_1073741855_1031, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741855 for deletion 2025-06-26 02:58:35,772 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741856_1032 replica FinalizedReplica, blk_1073741856_1032, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741856 for deletion 2025-06-26 02:58:35,773 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741857_1033 replica FinalizedReplica, blk_1073741857_1033, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741857 for deletion 2025-06-26 02:58:35,773 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741858_1034 replica FinalizedReplica, blk_1073741858_1034, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741858 for deletion 2025-06-26 02:58:35,773 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741859_1035 replica FinalizedReplica, blk_1073741859_1035, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data1 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741859 for deletion 2025-06-26 02:58:35,773 INFO impl.FsDatasetAsyncDiskService: Scheduling blk_1073741860_1036 replica FinalizedReplica, blk_1073741860_1036, FINALIZED getNumBytes() = 58492872 getBytesOnDisk() = 58492872 getVisibleLength()= 58492872 getVolume() = /hadoop-3.3.1/target/test/data/dfs/data/data2 getBlockURI() = file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741860 for deletion 2025-06-26 02:58:35,780 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741832_1008 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741832 2025-06-26 02:58:35,782 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741831_1007 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741831 2025-06-26 02:58:35,792 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741834_1010 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741834 2025-06-26 02:58:35,794 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741833_1009 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741833 2025-06-26 02:58:35,805 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741836_1012 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741836 2025-06-26 02:58:35,806 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741835_1011 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741835 2025-06-26 02:58:35,816 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741838_1014 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741838 2025-06-26 02:58:35,818 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741837_1013 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741837 2025-06-26 02:58:35,827 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741840_1016 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741840 2025-06-26 02:58:35,830 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741839_1015 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741839 2025-06-26 02:58:35,840 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741842_1018 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741842 2025-06-26 02:58:35,842 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741841_1017 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741841 2025-06-26 02:58:35,851 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741844_1020 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741844 2025-06-26 02:58:35,854 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741843_1019 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741843 2025-06-26 02:58:35,862 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741845_1021 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741845 2025-06-26 02:58:35,865 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741846_1022 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741846 2025-06-26 02:58:35,873 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741848_1024 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741848 2025-06-26 02:58:35,877 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741847_1023 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741847 2025-06-26 02:58:35,883 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741850_1026 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741850 2025-06-26 02:58:35,888 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741849_1025 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741849 2025-06-26 02:58:35,893 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741852_1028 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741852 2025-06-26 02:58:35,902 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741851_1027 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741851 2025-06-26 02:58:35,906 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741854_1030 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741854 2025-06-26 02:58:35,911 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741853_1029 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741853 2025-06-26 02:58:35,917 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741856_1032 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741856 2025-06-26 02:58:35,921 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741855_1031 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741855 2025-06-26 02:58:35,927 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741858_1034 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741858 2025-06-26 02:58:35,937 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741857_1033 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741857 2025-06-26 02:58:35,937 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741860_1036 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data2/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741860 2025-06-26 02:58:35,947 INFO impl.FsDatasetAsyncDiskService: Deleted BP-653333143-172.17.0.2-1750877079302 blk_1073741859_1035 URI file:/hadoop-3.3.1/target/test/data/dfs/data/data1/current/BP-653333143-172.17.0.2-1750877079302/current/finalized/subdir0/subdir0/blk_1073741859 2025-06-26 03:08:43,986 INFO namenode.FSEditLog: Number of transactions: 318 Total time for transactions(ms): 66 Number of transactions batched in Syncs: 115 Number of syncs: 203 SyncTimes(ms): 15 6 2025-06-26 03:08:43,991 INFO hdfs.StateChange: BLOCK* allocate blk_1073741891_1067, replicas=127.0.0.1:36823 for /test_02725_1.tsv 2025-06-26 03:08:43,993 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741891_1067 src: /127.0.0.1:34478 dest: /127.0.0.1:36823 2025-06-26 03:08:43,996 INFO DataNode.clienttrace: src: /127.0.0.1:34478, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.963423_count_66_pid_624_tid_280658368952960, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741891_1067, duration(ns): 414164 2025-06-26 03:08:43,996 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741891_1067, type=LAST_IN_PIPELINE terminating 2025-06-26 03:08:43,996 INFO hdfs.StateChange: BLOCK* fsync: /test_02725_1.tsv for libhdfs3_client_rand_0.963423_count_66_pid_624_tid_280658368952960 2025-06-26 03:08:43,998 INFO hdfs.StateChange: DIR* completeFile: /test_02725_1.tsv is closed by libhdfs3_client_rand_0.963423_count_66_pid_624_tid_280658368952960 2025-06-26 03:08:44,117 INFO hdfs.StateChange: BLOCK* allocate blk_1073741892_1068, replicas=127.0.0.1:36823 for /test_02725_2.tsv 2025-06-26 03:08:44,119 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741892_1068 src: /127.0.0.1:34486 dest: /127.0.0.1:36823 2025-06-26 03:08:44,121 INFO DataNode.clienttrace: src: /127.0.0.1:34486, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.048456_count_68_pid_624_tid_280658368952960, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741892_1068, duration(ns): 369723 2025-06-26 03:08:44,121 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741892_1068, type=LAST_IN_PIPELINE terminating 2025-06-26 03:08:44,122 INFO hdfs.StateChange: BLOCK* fsync: /test_02725_2.tsv for libhdfs3_client_rand_0.048456_count_68_pid_624_tid_280658368952960 2025-06-26 03:08:44,124 INFO hdfs.StateChange: DIR* completeFile: /test_02725_2.tsv is closed by libhdfs3_client_rand_0.048456_count_68_pid_624_tid_280658368952960 2025-06-26 03:09:59,618 INFO namenode.FSEditLog: Number of transactions: 330 Total time for transactions(ms): 66 Number of transactions batched in Syncs: 117 Number of syncs: 213 SyncTimes(ms): 17 6 2025-06-26 03:09:59,624 INFO hdfs.StateChange: BLOCK* allocate blk_1073741893_1069, replicas=127.0.0.1:36823 for /test_02536.jsonl 2025-06-26 03:09:59,627 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741893_1069 src: /127.0.0.1:42692 dest: /127.0.0.1:36823 2025-06-26 03:09:59,629 INFO DataNode.clienttrace: src: /127.0.0.1:42692, dest: /127.0.0.1:36823, bytes: 27, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.425889_count_77_pid_624_tid_280663583324800, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741893_1069, duration(ns): 607286 2025-06-26 03:09:59,629 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741893_1069, type=LAST_IN_PIPELINE terminating 2025-06-26 03:09:59,630 INFO hdfs.StateChange: BLOCK* fsync: /test_02536.jsonl for libhdfs3_client_rand_0.425889_count_77_pid_624_tid_280663583324800 2025-06-26 03:09:59,632 INFO hdfs.StateChange: DIR* completeFile: /test_02536.jsonl is closed by libhdfs3_client_rand_0.425889_count_77_pid_624_tid_280663583324800 2025-06-26 03:11:08,740 INFO namenode.FSEditLog: Number of transactions: 336 Total time for transactions(ms): 68 Number of transactions batched in Syncs: 118 Number of syncs: 218 SyncTimes(ms): 18 6 2025-06-26 03:11:08,744 INFO hdfs.StateChange: BLOCK* allocate blk_1073741894_1070, replicas=127.0.0.1:36823 for /test_02458_1.tsv 2025-06-26 03:11:08,746 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741894_1070 src: /127.0.0.1:44084 dest: /127.0.0.1:36823 2025-06-26 03:11:08,748 INFO DataNode.clienttrace: src: /127.0.0.1:44084, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.293128_count_84_pid_624_tid_280658326682240, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741894_1070, duration(ns): 621005 2025-06-26 03:11:08,748 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741894_1070, type=LAST_IN_PIPELINE terminating 2025-06-26 03:11:08,749 INFO hdfs.StateChange: BLOCK* fsync: /test_02458_1.tsv for libhdfs3_client_rand_0.293128_count_84_pid_624_tid_280658326682240 2025-06-26 03:11:08,751 INFO hdfs.StateChange: DIR* completeFile: /test_02458_1.tsv is closed by libhdfs3_client_rand_0.293128_count_84_pid_624_tid_280658326682240 2025-06-26 03:11:08,788 INFO hdfs.StateChange: BLOCK* allocate blk_1073741895_1071, replicas=127.0.0.1:36823 for /test_02458_2.tsv 2025-06-26 03:11:08,790 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741895_1071 src: /127.0.0.1:44094 dest: /127.0.0.1:36823 2025-06-26 03:11:08,792 INFO DataNode.clienttrace: src: /127.0.0.1:44094, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.293128_count_86_pid_624_tid_280658326682240, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741895_1071, duration(ns): 405723 2025-06-26 03:11:08,792 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741895_1071, type=LAST_IN_PIPELINE terminating 2025-06-26 03:11:08,793 INFO hdfs.StateChange: BLOCK* fsync: /test_02458_2.tsv for libhdfs3_client_rand_0.293128_count_86_pid_624_tid_280658326682240 2025-06-26 03:11:08,794 INFO hdfs.StateChange: DIR* completeFile: /test_02458_2.tsv is closed by libhdfs3_client_rand_0.293128_count_86_pid_624_tid_280658326682240 2025-06-26 03:15:35,577 INFO namenode.FSEditLog: Number of transactions: 348 Total time for transactions(ms): 69 Number of transactions batched in Syncs: 120 Number of syncs: 228 SyncTimes(ms): 18 6 2025-06-26 03:15:35,581 INFO hdfs.StateChange: BLOCK* allocate blk_1073741896_1072, replicas=127.0.0.1:36823 for /test_1.tsv 2025-06-26 03:15:35,583 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741896_1072 src: /127.0.0.1:55734 dest: /127.0.0.1:36823 2025-06-26 03:15:35,586 INFO DataNode.clienttrace: src: /127.0.0.1:55734, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.996792_count_104_pid_624_tid_280663972215424, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741896_1072, duration(ns): 748126 2025-06-26 03:15:35,586 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741896_1072, type=LAST_IN_PIPELINE terminating 2025-06-26 03:15:35,586 INFO hdfs.StateChange: BLOCK* fsync: /test_1.tsv for libhdfs3_client_rand_0.996792_count_104_pid_624_tid_280663972215424 2025-06-26 03:15:35,588 INFO hdfs.StateChange: DIR* completeFile: /test_1.tsv is closed by libhdfs3_client_rand_0.996792_count_104_pid_624_tid_280663972215424 2025-06-26 03:15:35,622 INFO hdfs.StateChange: BLOCK* allocate blk_1073741897_1073, replicas=127.0.0.1:36823 for /test_2.tsv 2025-06-26 03:15:35,624 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741897_1073 src: /127.0.0.1:55744 dest: /127.0.0.1:36823 2025-06-26 03:15:35,627 INFO DataNode.clienttrace: src: /127.0.0.1:55744, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.996792_count_106_pid_624_tid_280663972215424, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741897_1073, duration(ns): 418443 2025-06-26 03:15:35,627 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741897_1073, type=LAST_IN_PIPELINE terminating 2025-06-26 03:15:35,628 INFO hdfs.StateChange: BLOCK* fsync: /test_2.tsv for libhdfs3_client_rand_0.996792_count_106_pid_624_tid_280663972215424 2025-06-26 03:15:35,629 INFO hdfs.StateChange: DIR* completeFile: /test_2.tsv is closed by libhdfs3_client_rand_0.996792_count_106_pid_624_tid_280663972215424 2025-06-26 03:15:35,638 INFO hdfs.StateChange: BLOCK* allocate blk_1073741898_1074, replicas=127.0.0.1:36823 for /test_3.tsv 2025-06-26 03:15:35,640 INFO datanode.DataNode: Receiving BP-653333143-172.17.0.2-1750877079302:blk_1073741898_1074 src: /127.0.0.1:55748 dest: /127.0.0.1:36823 2025-06-26 03:15:35,643 INFO DataNode.clienttrace: src: /127.0.0.1:55748, dest: /127.0.0.1:36823, bytes: 6, op: HDFS_WRITE, cliID: libhdfs3_client_rand_0.996792_count_108_pid_624_tid_280663972215424, offset: 0, srvID: 34872996-582a-4416-bd83-d7de6ac81ddb, blockid: BP-653333143-172.17.0.2-1750877079302:blk_1073741898_1074, duration(ns): 458083 2025-06-26 03:15:35,643 INFO datanode.DataNode: PacketResponder: BP-653333143-172.17.0.2-1750877079302:blk_1073741898_1074, type=LAST_IN_PIPELINE terminating 2025-06-26 03:15:35,644 INFO hdfs.StateChange: BLOCK* fsync: /test_3.tsv for libhdfs3_client_rand_0.996792_count_108_pid_624_tid_280663972215424 2025-06-26 03:15:35,645 INFO hdfs.StateChange: DIR* completeFile: /test_3.tsv is closed by libhdfs3_client_rand_0.996792_count_108_pid_624_tid_280663972215424